-
April 27th, 2006, 05:39 AM
#1
MSNBot Spider: I do not understand. Good or bad?
Are these "spiders/web crawlers" bad or good? I really do not understand. Are they suppose to help the pages rank in a search engine?
"MSNBot Spider" is on my forum right now. I have never seen this or any other spider there before. What is it doing?
I found this: http://www.robotstxt.org/wc/faq.html#what, but it's not very much help in figuring out how this "spider" got to my site, and why it's there.
Thank you in advance, AO.
Posting Permissions
- You may not post new threads
- You may not post replies
- You may not post attachments
- You may not edit your posts
-
Forum Rules
|
|