# Robots.txt for domain: http://home.techsoup.org # crawl-delay has been set to 30 seconds per hit User-Agent: * Disallow: /Search/ Disallow: /_layouts/ Disallow: /ReusableContent/ Disallow: /Reports%20List/ Disallow: /WorkflowTasks/ Disallow: /SiteCollectionDocuments/ Disallow: /SiteCollectionImages/ Disallow: /Documents/Forms/ Disallow: /Pages/Forms/ Disallow: /products/* Crawl-Delay: 30 User-Agent: Slurp User-Agent: msnbot Disallow: /Search/ Disallow: /_layouts/ Disallow: /ReusableContent/ Disallow: /Reports%20List/ Disallow: /WorkflowTasks/ Disallow: /SiteCollectionDocuments/ Disallow: /SiteCollectionImages/ Disallow: /Documents/Forms/ Disallow: /Pages/Forms/ Disallow: /products/* Crawl-Delay: 30 User-agent: gigabot Disallow: