a decent google security tutorial was posted by soda last year to prevent crawlers from caching files like those mentioned. read more here: http://www.antionline.com/showthread...hreadid=260714
Printable View
a decent google security tutorial was posted by soda last year to prevent crawlers from caching files like those mentioned. read more here: http://www.antionline.com/showthread...hreadid=260714
a decent google security tutorial was posted by soda last year to prevent crawlers from caching files like those mentioned. read more here: http://www.antionline.com/showthread...hreadid=260714
Hello,
Just a sidebar, if you ever find a website of yours on Google, or information on Google you do not want there, go to the following site: http://www.google.com/webmasters/remove.html
According to the website, the following actions can be taken:
FYI, remove it from your OWN website first, otherwise Google will pick it right back up again. Also, this will only remove it from Google, not the other search engines!Quote:
- Remove your entire website
- Remove part of your website
- Remove snippets
- Remove cached pages
- Remove an outdated ("dead") link
- Remove an image from Google's Image Search
- Remove a blog from Blog Search
- Remove a RSS or Atom feed (i.e., block Feedfetcher)
- Remove transcoded pages
-Deeboe
Hello,
Just a sidebar, if you ever find a website of yours on Google, or information on Google you do not want there, go to the following site: http://www.google.com/webmasters/remove.html
According to the website, the following actions can be taken:
FYI, remove it from your OWN website first, otherwise Google will pick it right back up again. Also, this will only remove it from Google, not the other search engines!Quote:
- Remove your entire website
- Remove part of your website
- Remove snippets
- Remove cached pages
- Remove an outdated ("dead") link
- Remove an image from Google's Image Search
- Remove a blog from Blog Search
- Remove a RSS or Atom feed (i.e., block Feedfetcher)
- Remove transcoded pages
-Deeboe
I'd rather then removing those pages make 'm do a permanent redirect..
Searchengines will (usualy delist 'm and use the new url they point to)..
Such redirects are a lot more friendly then a 404 error to innocent passers by..
And making 'm redirect to your site's AUP also might scare scriptkiddies ;)
There are loads of ways you can make those permanent redirects.. php imho is the easiest..PHP Code:<?php
header ('HTTP/1.1 301 Moved Permanently');
header ('Location: http://domain.tld/page' );
exit;
?>
I'd rather then removing those pages make 'm do a permanent redirect..
Searchengines will (usualy delist 'm and use the new url they point to)..
Such redirects are a lot more friendly then a 404 error to innocent passers by..
And making 'm redirect to your site's AUP also might scare scriptkiddies ;)
There are loads of ways you can make those permanent redirects.. php imho is the easiest..PHP Code:<?php
header ('HTTP/1.1 301 Moved Permanently');
header ('Location: http://domain.tld/page' );
exit;
?>
Thanks for that Jinx, that is extremly useful. Only issue I have with that is the caching that Google does. They will cache old pages... that includes pages that you are redirecting. You should contact Google regardless to have those removed... in addition to the redirect.Quote:
Originally posted here by the_JinX
I'd rather then removing those pages make 'm do a permanent redirect..
Searchengines will (usualy delist 'm and use the new url they point to)..
Such redirects are a lot more friendly then a 404 error to innocent passers by..
And making 'm redirect to your site's AUP also might scare scriptkiddies ;)
-Deeboe
Thanks for that Jinx, that is extremly useful. Only issue I have with that is the caching that Google does. They will cache old pages... that includes pages that you are redirecting. You should contact Google regardless to have those removed... in addition to the redirect.Quote:
Originally posted here by the_JinX
I'd rather then removing those pages make 'm do a permanent redirect..
Searchengines will (usualy delist 'm and use the new url they point to)..
Such redirects are a lot more friendly then a 404 error to innocent passers by..
And making 'm redirect to your site's AUP also might scare scriptkiddies ;)
-Deeboe
This is nothing new... There are a couple of google hacking tutorials here on AO... One of them was written by me last year...
This is nothing new... There are a couple of google hacking tutorials here on AO... One of them was written by me last year...