Has anyone had any hits on there servers from MSNBot ? I have had some weird activity from the MSNBot and I was wondering what I can do to block this bot from connecting and reviewing my server.
Printable View
Has anyone had any hits on there servers from MSNBot ? I have had some weird activity from the MSNBot and I was wondering what I can do to block this bot from connecting and reviewing my server.
I am assuming you are talking about a webserver?
Add a robots.txt file to the root of your website.
Then put this in the robots.txt:
"User-agent: MSNBot
Disallow: /"
(Without quotes)
That should block it from indexing your site. What kind of weird traffic are you recieving?
Edit: Looking at our stats for our company website, we have been visited only once (for 96 hits - about the number that we have pages on our public site) in the last month by "The Microsoft network."
Maybe I pulled it off for some reason, because the last time I checked this was in place.
My logs are leaving me urls instead of information and the way I am getting hit seems like it is looping my site.