-
May 18th, 2004, 05:39 PM
#1
MSNBot
Has anyone had any hits on there servers from MSNBot ? I have had some weird activity from the MSNBot and I was wondering what I can do to block this bot from connecting and reviewing my server.
-
May 18th, 2004, 05:45 PM
#2
I am assuming you are talking about a webserver?
Add a robots.txt file to the root of your website.
Then put this in the robots.txt:
"User-agent: MSNBot
Disallow: /"
(Without quotes)
That should block it from indexing your site. What kind of weird traffic are you recieving?
Edit: Looking at our stats for our company website, we have been visited only once (for 96 hits - about the number that we have pages on our public site) in the last month by "The Microsoft network."
N00b> STFU i r teh 1337 (english: You must be mistaken, good sir or madam. I believe myself to be quite a good player. On an unrelated matter, I also apparently enjoy math.)
-
May 18th, 2004, 05:49 PM
#3
Maybe I pulled it off for some reason, because the last time I checked this was in place.
My logs are leaving me urls instead of information and the way I am getting hit seems like it is looping my site.
Posting Permissions
- You may not post new threads
- You may not post replies
- You may not post attachments
- You may not edit your posts
-
Forum Rules
|
|