# robots.txt for domain: http://www.mafrecruiting.com # All robots will spider the domain User-agent: InternetSeer Disallow: / User-agent: InternetSeer.com Disallow: / User-agent: sitecheck.internetseer.com Disallow: /