I was lookin' in the
Whose Online and come across these:
http://www.jemsite.com/forums/online...c&pp=30&page=5
So I 'goolged' it and here's some of what they said:
Quote:
|
i think Yahoo is competing with Google to see who can index the most LOL
|
& this:
Quote:
Well, no one will be finding your sites though yahoo if you don't let them spider, there is a crawl delay setting which will slow thme down slightly.
Its not good to ban any of the major SE's unless you just dont want any trafic from them ever.
|
http://www.vbulletin.com/forum/showthread.php?t=175051
Quote:
|
Ditto, nadlay. Slurp pops in regularly and then every now and then goes on a Slurp frenzy -- but whether it's browsing or slurping doesn't seem to have any real effect on what it actually adds to the index...
|
http://forums.digitalpoint.com/showthread.php?t=3928
The verbiage is that these 'hits' don't really hurt the server...or do they slow the/any site down? There's a couple 'o' dozen of Yahoo's 'spiders' in the
Whose Online forum right now but only one Google.
