# robots.txt generated at http://mynewtechnologies.com User-agent: * Crawl-delay: 5 Disallow: /cgi-bin/ Disallow: /crm/ Sitemap: http://www.soberjobs.com/sitemap.xml