Image
EAN-130794043694226   EAN-13 barcode 0794043694226
UPC-A794043694226   UPC-A barcode 794043694226
Product NameProof
LanguageEnglish
CategoryElectronics / Photography: A/V Media
Short DescriptionDvd
Amazon.comA Buy on Amazon ~ B0002XNT12
Similar Items9780767897402: Rough Magic
9398701430198: Romper Stomper
1775404832012: A Moment In Time Filipino DVD Coco Martin Julia Montes
3000000062012: The Crossing
9780792851790: Lonely Hearts
0786936296303: Proof
9780233001852: Russell Crowe: The Biography
9780825672835: Russell Crowe: The Unauthorized Biography
9780788820595: Insider
9781842224236: Russell Crowe: The Biography
9780767859516: No Way Back
Created07-01-2006
Modified01-07-2020 12:20:58pm
MD57646b468373963ad655e203fb340c913
SHA256ddcd7a7a6841b4d10c064c1fc1f62c5453db375d2b3f245b1207ad269d02a7b3
Search Googleby EAN or by Title
Query Time0.0213799

Article of interest

This is just a general comment to those that might be interested in some technical info about our site and how Google interacts with it.

Google is frigging amazing!

Their programmers are very curtious when it comes to their spiders and how they interact with various web sites. Apparently, they are sensative to the load that their spiders place on a web server and do a darn good job when it comes to not overloading a server.

Another major search engine is not quite so nice. If you don't tell them to leave you alone, they will hammer the heck out of your site and potentially bring you to your knees.

Over the past vew days, we have been doing a massive system backup to a couple new off-site backup servers. Normally, this process is pretty quick but because these were new servers they required fully syncronization. Well, I forgot to take into account the drain this could place on our server and I let more than one backup run at a time.

This caused our main server to experience a high load for several days. Google detected this load and backed off its crawling process which was very kind of them. The only bad thing is that when Google backed off, our monitoring process (mostly manual at this point) assumed everything was only slightly higher than normal.

Google may be awesome, but it can be frustrating some times too.

This cool and wonderful feature that Google has in place to prevent overloading a server had an unexpected side affect. Because Google thought our site was super busy (which it was) it reduced the number of people it was referring to the site too. DOH!

As we noticed the visitor count slowly drop we got very confused because the system load was still very high. And we noticed Google wasn't visiting as often as usual and then we saw it... The backup process had overloaded the system. Not to the extreme but enough to make Google think there was a problem. We still actually had plenty of bandwidth for real users just not as much for the bots that visit (which we limit when bandwidth is limited).

Anyway, it was a good learning experience and we are now seeing the referrals climb back up and the Google spider is picking up its pace again too.

We had to force a couple other bots (including that othe big search engine) to play nice because they were trying to take more than their share of our data.

All in all, Google is AWESOME and very powerful. So THANKS GOOGLE for playing nice with others!

Close

Search

Close

Share