▼

Wednesday, July 7, 2010

The use of robots.txt

Crawler Exclusion - Site Administration - server loading


at

1 comment:

  1. TorontoAugust 17, 2012 at 8:59 AM

    I was looking to see how you can use a robots.txt with Google Blogger

    ReplyDelete

Please do not enter links that are just promoting your own website or ones to those that you are shilling.
Comments with hyperlinks (that are not relevant to the original post) will be re-posted or deleted.
Sorry, this is to discourage "blog spam"