In continuing with my Google Webmaster tips one of the items Google suggests to include is a robot text file (robot.txt) this is a simple text file that you can create to tell which search engines you want to index your site.
Also with a robot.txt file you can tell the search engines where you want them to (or not) look. Places like your download folders or hidden folders you don’t want others to find.
I have located a free online robot text generator that is pretty good to use and explains in detail the options.
Let me know if these resources are useful for you.
All the best and much success in everything you do.
Frank Deardurff – ThatOneWebGuy.com