# robots.txt prevents files from being harvested by SE spiders User-agent: * # don't allow spidering of the following (specifics first) Disallow: /.htaccess Disallow: /robots.txt Disallow: /logs/ Disallow: /_private/ Disallow: /Scripts/ Disallow: /Templates/ Disallow: /Contact/ Disallow: /Css/ Disallow: /partnership/secure/ Disallow: /community/test_site/