Connecting to LinkedIn...



Big data software finds common ground with EDWs, governance programs

14/03/2014 by


Big data software deployments might be launched because existing data warehouse systems are beginning to sag under the weight of the data that’s flooding into organizations. But that doesn’t mean data warehouses are all of a sudden obsolete — just that the nature of warehousing data is changing to make room for big data.

“Different styles of data warehouse architecture have come and gone over the years,” said Philip Russom, data management research director at The Data Warehousing Institute (TDWI) in Renton, Wash. “As we move to bigger volumes and diversity of data, we have to again evolve the data warehouse, just as we have in the past.”

Hadoop-based big data systems initially were viewed as potential data warehouse killers, but that sentiment has largely given way to expectations of peaceful coexistence. For example, 78% of 263 IT professionals, business users and consultants surveyed by TDWI in November 2012 said they thought Hadoop systems could be a useful complement to their data warehouses for supporting advanced analytics applications. In addition, 41% saw Hadoop as an effective staging area for information on its way to an enterprise data warehouse (EDW). Asked if Hadoop clusters could fully replace an EDW, more than half of the respondents said no; just 4% said yes.

Russom thinks that using Hadoop to stage data for loading into data warehouses is a “beachhead” for big data technologies in companies. But the staging process itself is one aspect of data warehousing that has changed significantly in recent years, he said. In many cases, raw data is likely to pile up in Hadoop clusters and initially be analyzed there. “In the old days, the data staging area was pretty temporary,” Russom said. “But it has evolved to become a kind of archive.”

This article has been extracted from, please click on this link to read the article in full

Montash is a multi-award winning , global IT recruitment firm. Specialising in permanent and contract positions across mid-senior appointments across a wide range of industry sectors and IT functions including:

ERP, BI & Data, Information Security, IT Architecture & Strategy, Scientific Technologies, Demand IT and Business Engagement, Digital and E-commerce, Infrastructure and Service Delivery, Project and Programme Delivery.

For more information please contact us on +44 (0) 20 7014 0230 or alternatively send us an email on

comments powered by Disqus

Social Stream

Latest News


Humans remain largest security flaw in cloud ...

2016-10-21 14:00:00 +0100

With a vast number of companies moving some, if not all, of their operations to the cloud, security continues to be of major concern. Whilst there are numerous patches and firewalls to safeguard defences, it has been highlighted that the most difficult area to protect against is human interaction. This is the view of Jamie Woodruff, a penetration tester and ethical hacker. Woodruff’s views come after he was contracted to conduct a penetration test in or...


Offshore exploration providing boost for oil ...

2016-10-19 09:00:00 +0100

The oil and gas industry has had a notoriously challenging time of late, with the prices of oil plummeting and causing many firms to tighten their belts. However, offshore exploration is providing a much-needed bright spot for the sector, with an increasing number of governments becoming more accommodating. In the past week, it has been revealed that there are big changes afoot for Brazil’s petroleum laws. Shell has already begun to move on this opportu...