MetaJobBot is METAJob's automated crawler that searches websites for jobs. MetaJobBot complies with the Robots Exclusion Standard. MetaJobBot respects the robots meta tags index/noindex and follow/nofollow. There are at least 5 seconds between 2 consecutive accesses from pages of the same domain There is at least 7 times the last observed response times between 2 accesses. MetaJobBot is a "topical" or "focused" crawler that is only interested in finding jobs.