# /robots.txt file for all crawler/ # http://www.seekport.co.uk/help/webmaster_robot.html --> ist der neu? # /http://www.robotstxt.org/wc/faq.html#kinds/ # Ganze Site freigeben User-agent: * Disallow: /emails.htm Disallow: /cgi_bin/ Disallow: /email/ Disallow: /gaestebuch/ Disallow: /intern/ Disallow: /logs/ Disallow: /neujahr/ Disallow: /newsgrabber/ Disallow: /pics/ Disallow: /puzzle/ Disallow: /scripts/ Disallow: /showit/ Disallow: /styles/ User-agent: Googlebot Disallow: /*.txt$ Disallow: /*.exe$