############################### # # robots.txt file for scrapjazz.com # # addresses all robots by using wild card * # User-agent: * # list folders robots are not allowed to index Disallow: /beta/ Disallow: /beta_vol1/ Disallow: /stvol1/samples/ Disallow: /downloads/ Disallow: /webalizer/ Disallow: /stats/ Disallow: /images/ Disallow: /downloads/ Disallow: /test/ # Used for Google Text Ads User-agent: Mediapartners-Google* Disallow: # Block Google's Image Bot User-agent: Googlebot-Image Disallow: / # # # End of robots.txt file # ###############################