# All robots will spider the domain #commented out 20060503 as a test User-agent: * Disallow: / #commented out 20060503 as a test #User-agent: googlebot #Disallow: / # Disallow directory /cgi-bin #User-agent: * #Disallow: /cgi-bin #Disallow: /~_lacywil #Disallow: /homepages.html #End robots.txt