Monday, August 31, 2009

Block or remove pages using a robots.txt file - Webmasters/Site owners Help

You need a robots.txt file in your site fils, only if your site includes
content that you don't want search engines to index. If you want
search engines to index everything in your site, you don't need a
robots.txt file (not even an empty one

0 comments: