Google: Processing 20 Terabytes Per Day and Counting!

Jan 10, 2008 | 2,881 views | by Navneet Kaushal
VN:F [1.9.20_1166]
Rating: 0.0/5 (0 votes cast)

Recently, Google's engineers disclosed in a white paper just how large is the magnitude of processing that Google undertakes each day to index the Web, serve up ads and process search results, etc.

A break-up of how Google's computing capacity has grown over the years has been given by Niall Kennedy. See below:

mapreduce Google: Processing 20 Terabytes Per Day and Counting!

Till about September last year it was already computing 20,000 terabytes of data in a single day. It achieves this magnanimous feat through average of 100,000 MapReduce jobs which are distributed across very large computing clusters. Perhaps, this data crunching ability of Google gives it the leadership position compared to other search engines.

4.thumbnail Google: Processing 20 Terabytes Per Day and Counting!

Navneet Kaushal

Navneet Kaushal is the founder and CEO of PageTraffic, an SEO Agency in India with offices in Chicago, Mumbai and London. A leading search strategist, Navneet helps clients maintain an edge in search engines and the online media. Navneet's expertise has established PageTraffic as one of the most awarded and successful search marketing agencies.
4.thumbnail Google: Processing 20 Terabytes Per Day and Counting!
4.thumbnail Google: Processing 20 Terabytes Per Day and Counting!