-
May 27th, 2004, 12:21 AM
#1
Search Engine Spiders
Can anyone explain (or have any links to sites explaining) how search engine spiders (bots, indexers, whatever you want to call them) work ? How to they find the sites? Where do they start looking ? etc etc
-
May 27th, 2004, 12:28 AM
#2
Well, they kinda work similiar to search engine's. They use context and word's in the meta tag's and word's that are on the site. For instance, AntiOnline has word's dealing with security on the front page and in it's source code. Spider's will go to AntiOnline then find a site with those meta tag's and header's in it's source and on the website itself.
-
May 27th, 2004, 12:30 AM
#3
any idea how the search bot knows that antionline.com was here in the first place ?
-
May 27th, 2004, 12:30 AM
#4
-
May 27th, 2004, 12:32 AM
#5
Thanks alot dude, that was extactly what i was looking for.
-
May 27th, 2004, 12:36 AM
#6
Damn you Negative Smart bastard..
Posting Permissions
- You may not post new threads
- You may not post replies
- You may not post attachments
- You may not edit your posts
-
Forum Rules
|
|