# /robots.txt - 30.11.2004 pat # # Keeps Webcrawlers and Spiders (a.k.a robots) from # accessing webpages # #This keeps all robots out of everything #User-agent: * #Disallow: / #This keeps all robots out of anything that starts #with the given path User-agent: * Disallow: /