May 18th, 2004, 06:39 PM
Has anyone had any hits on there servers from MSNBot ? I have had some weird activity from the MSNBot and I was wondering what I can do to block this bot from connecting and reviewing my server.
May 18th, 2004, 06:45 PM
I am assuming you are talking about a webserver?
Add a robots.txt file to the root of your website.
Then put this in the robots.txt:
That should block it from indexing your site. What kind of weird traffic are you recieving?
Edit: Looking at our stats for our company website, we have been visited only once (for 96 hits - about the number that we have pages on our public site) in the last month by "The Microsoft network."
N00b> STFU i r teh 1337 (english: You must be mistaken, good sir or madam. I believe myself to be quite a good player. On an unrelated matter, I also apparently enjoy math.)
May 18th, 2004, 06:49 PM
Maybe I pulled it off for some reason, because the last time I checked this was in place.
My logs are leaving me urls instead of information and the way I am getting hit seems like it is looping my site.