# Robot Exclusion File -- robots.txt User-Agent: * Disallow: /admin/ Disallow: /adimages/ Disallow: /banners/ Disallow: /cache/ Disallow: /coupon_images/ Disallow: /coupon_styles/ Disallow: /exceldata/ Disallow: /img/ Disallow: /include/ Disallow: /lang/ Disallow: /plugins/ Disallow: /rss_template/ Disallow: /SSL/ Disallow: /style/ Disallow: /xsl/ # #Block out things that are secure or login oriented Disallow: /login.php Disallow: /logout.php Disallow: /register.php Disallow: /register_done.php # IF YOU DO NOT WISH TO HAVE THE GOOGLE IMAGE BOT SCAN YOUR DOMAIN FOR IMAGES # THEN YOU CAN INCLUDE THE FOLLOWING IN YOUR ROBOTS FILE. # I FOUND THAT MY BANDWIDTH USAGE DROPPED BY A MASSIVE AMOUNT AFTER I GOT RID # OF THE GOOGLE IMAGE BOT. ALL I HAD WAS IMAGE HUNTERS STEALING PRODUCT SHOTS # AND NOT EVEN BROWSING THE SITE. User-agent: Googlebot-Image Disallow: /