# VITA-SUP.com # Robot Exclusion File -- robots.txt # Author: Jacques # Last Updated : 9/14/07 User-Agent: * Disallow: /admin/ Disallow: /images/ Disallow: /img/ Disallow: /images123/ Disallow: /lib/ Disallow: /modlogan/ Disallow: /pub/ Disallow: /scripts/ Disallow: /templates/ Disallow: /awstats/ Disallow: /beta/ Disallow: /download/ Disallow: /cgi-bin/ Disallow: /cp/ #Block All Images Disallow: *.gif Disallow: *.jpg Disallow: /*.gif$ Disallow: /*.jpg$ # # #Block out things that are secure or login oriented Disallow: /add.php Disallow: /login.html # IF YOU DO NOT WISH TO HAVE THE GOOGLE IMAGE BOT SCAN YOUR DOMAIN FOR IMAGES # THEN YOU CAN INCLUDE THE FOLLOWING IN YOUR ROBOTS FILE. # I FOUND THAT MY BANDWIDTH USAGE DROPPED BY A MASSIVE AMOUNT AFTER I GOT RID # OF THE GOOGLE IMAGE BOT. ALL I HAD WAS IMAGE HUNTERS STEALING PRODUCT SHOTS # AND NOT EVEN BROWSING THE SITE. #User-agent: Googlebot-Image #Disallow: /