Google has been busy. In the past few years, researchers have cooked up a complex and powerful new data-warehousing system called Mesa.
Mesa was born out of Google’s core business: Internet advertising. To serve its advertising customers and internal needs, Google collects detailed information about a given ad, and it has to record and process that data in real time, according to a new research paper on the system.
Mesa deals with these data at great scale, taking in data in near real time. Mesa “handles petabytes of data, processes millions of row updates per second, and serves billions of queries that fetch trillions of rows per day,” the paper’s authors wrote. Moreover, they wrote, Mesa is datacenter-failure-proof, as it’s “geo-replicated across multiple datacenters.”
It’s possible that Mesa will lead to a new cloud service available on the Google Cloud Platform. That could help the company further distinguish itself in its cloud warfare against Amazon Web Services, which has a data-warehousing service called Redshift, and Microsoft Azure, which can and do drop cloud prices and frequently release new cloud services, just like Google.
Such a development wouldn’t be too farfetched. After Google introduced the Dremel query system in a research paper, the company created BigQuery based on Dremel and made it available as a cloud service on the Google Cloud Platform.
Architecturally, Mesa’s developers made some important decisions about what to optimize for that make it different, from, say, Dremel:
Montash is a multi-award winning, global IT recruitment business. Specialising in permanent and contract positions across mid-senior appointments across a wide range of industry sectors and IT functions, including:
ERP, BI & Data, Information Security, IT Architecture & Strategy, Energy & Technologies, Demand IT and Business Engagement, Digital and E-commerce, Leadership Talent, Infrastructure and Service Delivery, Project and Programme Delivery.
Montash is headquartered in Old Street, London, in the heart of the technology hub. Montash has completed assignments in over 30 countries and has appointed technical professionals from board level to senior and mid management in permanent and contract roles.