# Robots.txt file updated 2010/01/18 # For Domain: http://www.whatscooking.nl # # Design Note: Any blank line in the robots.txt file will cause an error. No blank lines # # All (other) robots will spider the domain User-agent: * Disallow: /cgi-bin/ Disallow: /tmp/ Disallow: /junk/ # Disallow: /blocks/ Disallow: /classes/ Disallow: /cms/ Disallow: /cron/ Disallow: /default_site/ Disallow: /include/ Disallow: /php/ Disallow: /templates/ # Sitemap: http://www.whatscooking.nl/sitemap.xml