User-agent: * Disallow: /cgi-bin/ Disallow: /asp_class/ Disallow: /scripts/ User-Agent: Googlebot-Image Disallow: / # the above lets ALL SEs spider WHOLE site # except cgi-bin # see http://www.searchtools.com/robots/robots-txt.html # for more info # and stops google indexing any images