|
-
January 16th, 2006, 03:52 PM
#11
a decent google security tutorial was posted by soda last year to prevent crawlers from caching files like those mentioned. read more here: http://www.antionline.com/showthread...hreadid=260714
-
January 16th, 2006, 03:52 PM
#12
a decent google security tutorial was posted by soda last year to prevent crawlers from caching files like those mentioned. read more here: http://www.antionline.com/showthread...hreadid=260714
-
January 16th, 2006, 04:23 PM
#13
Hello,
Just a sidebar, if you ever find a website of yours on Google, or information on Google you do not want there, go to the following site: http://www.google.com/webmasters/remove.html
According to the website, the following actions can be taken:
- Remove your entire website
- Remove part of your website
- Remove snippets
- Remove cached pages
- Remove an outdated ("dead") link
- Remove an image from Google's Image Search
- Remove a blog from Blog Search
- Remove a RSS or Atom feed (i.e., block Feedfetcher)
- Remove transcoded pages
FYI, remove it from your OWN website first, otherwise Google will pick it right back up again. Also, this will only remove it from Google, not the other search engines!
-Deeboe
If you know the enemy and know yourself, you need not fear the result of a hundred battles. If you know yourself but not the enemy, for every victory gained you will also suffer a defeat. If you know neither the enemy nor yourself, you will succumb in every battle.
- Sun Tzu, The Art of War
http://tazforum.**********.com/
-
January 16th, 2006, 04:23 PM
#14
Hello,
Just a sidebar, if you ever find a website of yours on Google, or information on Google you do not want there, go to the following site: http://www.google.com/webmasters/remove.html
According to the website, the following actions can be taken:
- Remove your entire website
- Remove part of your website
- Remove snippets
- Remove cached pages
- Remove an outdated ("dead") link
- Remove an image from Google's Image Search
- Remove a blog from Blog Search
- Remove a RSS or Atom feed (i.e., block Feedfetcher)
- Remove transcoded pages
FYI, remove it from your OWN website first, otherwise Google will pick it right back up again. Also, this will only remove it from Google, not the other search engines!
-Deeboe
If you know the enemy and know yourself, you need not fear the result of a hundred battles. If you know yourself but not the enemy, for every victory gained you will also suffer a defeat. If you know neither the enemy nor yourself, you will succumb in every battle.
- Sun Tzu, The Art of War
http://tazforum.**********.com/
-
January 16th, 2006, 04:38 PM
#15
I'd rather then removing those pages make 'm do a permanent redirect..
Searchengines will (usualy delist 'm and use the new url they point to)..
Such redirects are a lot more friendly then a 404 error to innocent passers by..
And making 'm redirect to your site's AUP also might scare scriptkiddies 
There are loads of ways you can make those permanent redirects.. php imho is the easiest..
PHP Code:
<?php
header ('HTTP/1.1 301 Moved Permanently');
header ('Location: http://domain.tld/page' );
exit;
?>
ASCII stupid question, get a stupid ANSI.
When in Russia, pet a PETSCII.
Get your ass over to SLAYRadio the best station for C64 Remixes !
-
January 16th, 2006, 04:38 PM
#16
I'd rather then removing those pages make 'm do a permanent redirect..
Searchengines will (usualy delist 'm and use the new url they point to)..
Such redirects are a lot more friendly then a 404 error to innocent passers by..
And making 'm redirect to your site's AUP also might scare scriptkiddies 
There are loads of ways you can make those permanent redirects.. php imho is the easiest..
PHP Code:
<?php
header ('HTTP/1.1 301 Moved Permanently');
header ('Location: http://domain.tld/page' );
exit;
?>
ASCII stupid question, get a stupid ANSI.
When in Russia, pet a PETSCII.
Get your ass over to SLAYRadio the best station for C64 Remixes !
-
January 16th, 2006, 06:31 PM
#17
Originally posted here by the_JinX
I'd rather then removing those pages make 'm do a permanent redirect..
Searchengines will (usualy delist 'm and use the new url they point to)..
Such redirects are a lot more friendly then a 404 error to innocent passers by..
And making 'm redirect to your site's AUP also might scare scriptkiddies
Thanks for that Jinx, that is extremly useful. Only issue I have with that is the caching that Google does. They will cache old pages... that includes pages that you are redirecting. You should contact Google regardless to have those removed... in addition to the redirect.
-Deeboe
If you know the enemy and know yourself, you need not fear the result of a hundred battles. If you know yourself but not the enemy, for every victory gained you will also suffer a defeat. If you know neither the enemy nor yourself, you will succumb in every battle.
- Sun Tzu, The Art of War
http://tazforum.**********.com/
-
January 16th, 2006, 06:31 PM
#18
Originally posted here by the_JinX
I'd rather then removing those pages make 'm do a permanent redirect..
Searchengines will (usualy delist 'm and use the new url they point to)..
Such redirects are a lot more friendly then a 404 error to innocent passers by..
And making 'm redirect to your site's AUP also might scare scriptkiddies
Thanks for that Jinx, that is extremly useful. Only issue I have with that is the caching that Google does. They will cache old pages... that includes pages that you are redirecting. You should contact Google regardless to have those removed... in addition to the redirect.
-Deeboe
If you know the enemy and know yourself, you need not fear the result of a hundred battles. If you know yourself but not the enemy, for every victory gained you will also suffer a defeat. If you know neither the enemy nor yourself, you will succumb in every battle.
- Sun Tzu, The Art of War
http://tazforum.**********.com/
-
January 17th, 2006, 12:23 AM
#19
This is nothing new... There are a couple of google hacking tutorials here on AO... One of them was written by me last year...
-
January 17th, 2006, 12:23 AM
#20
This is nothing new... There are a couple of google hacking tutorials here on AO... One of them was written by me last year...
Posting Permissions
- You may not post new threads
- You may not post replies
- You may not post attachments
- You may not edit your posts
-
Forum Rules
|
|