# robots.txt to be used in the development site. # reference: http://www.robotstxt.org/wc/norobots.html User-agent: * Disallow: /admin Disallow: /svc Disallow: /kforcesvc Disallow: /WebResource.axd Disallow: /campaigns/proven-performers/ Disallow: /search-jobs/job-detail/apply-online.aspx Disallow: /*apply-online/ Disallow: /*apply-online.aspx Disallow: /*apply-online Crawl-delay: 30 User-agent: YandexImages Disallow: / User-agent: YandexBot Disallow: / User-agent: Baiduspider Disallow: /