Page 1 of 1

Downsides to high Page Rank and frequent spidering

Posted: Sat 11 Sep, 2004 8:19 pm
by maz
Out of interest, it sometimes gets mentioned that when you have a higher page rank, you get spidered more often, which is great fun. However, a side-effect to this seems to be if your hosting provider goes down for a few days, guess what! You get spidered, you no longer exist, and then oh oh .. weeks of fun getting the links to slowly build up again. I had some close-knit affiliate links through lots of mininet sites that suffered a real knock-on effect that's lasted over a week even though the webhost only went down about 24 hours. OK while Google has my main site spidered again, it seems to have lost the relationship it built up between the links that flowed down to the other sites - and this is where the huge loss of income has now occurred!

Posted: Wed 01 Feb, 2006 6:53 pm
by Bobb
Ever considered sueing? 8)
I think you have taught us the importance of "Dont put all your eggs in one basket" .

Posted: Tue 13 Jun, 2006 11:57 am
by claw
hahha that sucks man, a whole lot of bad luck but maybe u shouldnt have "put all your eggs in one basket"?

is it better to have a back up plan for that sorta thing or do u AM's just seem to fix stuff as it occurs?



Posted: Tue 13 Jun, 2006 2:21 pm
by Bobb

Posted: Wed 14 Jun, 2006 1:38 am
by Nick
The frequency with Googlebot will visit and spider your site is primarily determined by how often it sees changes on your site, hence one of the reasons for considering some degree of dynamic content on your site e.g. newsfeeds etc.

It is highly unlikely now that your site will disappear out of Google because your site goes offline for a day or so... in fact on one of my sites I made a bit of a stupid mistake and deteleted some pages 18 months ago. But they still appear in Google even after all this time. Golden Rule - never remove a page if it has any Page Rank. Instead use the page for something else but leave the name of the page the same. It is not easy to get decent PR on internal pages - so don't throw them away.