Connecting to LinkedIn...

W1siziisijiwmtuvmdqvmtuvmdgvntqvmzgvnzi1l01ptlrbu0hfqkxpr19vtljftkrfukvex0lnqudfx3jlc2l6zwrfyw5kx3jlbmrlcmvklmpwzyjdlfsiccisinrodw1iiiwimtkymhgxmjuwiyjdxq

Blog

DataTorrent Brings Real-Time Streaming Analytics to Hadoop

5/06/2014 by

W1siziisijiwmtqvmtavmjgvmtuvmzkvmjavmjq4l2zpbguixsxbinailcj0ahvtyiisijywmhg0mdbcdtawm2uixv0

When it comes to Hadoop, the popular perception is that the open source data management framework is limited to mainly batch-oriented applications. As a result, running any serious real-time analytics application would require deploying expensive, massively parallel database systems.

Looking to lay that misperception to rest, DataTorrent this week announced the general availability of DataTorrent RTS, an implementation of a real-time streaming processing platform on Hadoop. It can be deployed on just about any flavor of Hadoop.

DataTorrent CEO Phu Hoang says that with the advent of Yet Another Resource Manager 2.0 for Hadoop environments, it’s now feasible to run all kinds of real-time applications on Hadoop. In fact, DataTorrent claims its platform can process more than one billion data events per second, which the company says is equivalent to processing 46 cumulative hours of streaming Twitter data in one second.

The implications of that for data warehouse environments is particularly profound. If Hadoop becomes the platform where those applications wind up residing, the cost of delivering a bevy of analytics applications will substantially drop.

Rather than bringing data to the application, DataTorrent and other Hadoop proponents say it makes a lot more sense to bring Java applications to where the data resides. That not only eliminates the need for complex extract, transform and load (ETL) processes that often introduce errors, it reduces the amount of IT infrastructure that needs to be managed.

This article has been extracted from http://www.itbusinessedge.com, please click on this link to read the article in full http://www.itbusinessedge.com/blogs/it-unmasked/datatorrent-brings-real-time-streaming-analytics-to-hadoop.html

Montash is a multi-award winning, global IT recruitment firm. Specialising in permanent and contract positions across mid-senior appointments which cover a wide range of industry sectors and IT functions, including:

ERP, BI & Data, Information Security, IT Architecture & Strategy, Scientific Technologies, Demand IT and Business Engagement, Digital and E-commerce, Infrastructure and Service Delivery, Project and Programme Delivery.

With offices based in London, Montash has completed assignments in over 30 countries and has appointed technical professionals from board level to senior and mid-management in permanent and contract roles.

comments powered by Disqus

Social Stream

Latest News

W1siziisijiwmtcvmdqvmjqvmtqvmzqvmzuvnjg3l3nodxr0zxjzdg9ja182mdq2otc5nziuanbnil0swyjwiiwidgh1bwiilcizodb4mtawiyjdxq

What Does A Snap Election Mean For Recruitment?

2017-04-25 08:00:00 +0100

On Tuesday 18th April, Prime Minister Theresa May called a snap general election for 8th June, taking the nation by surprise. Rather than waiting until 2020, voters will now be casting their ballots in a matter of weeks. The hope for the government is that a Tory victory give the prime minister a strong mandate in parliament as Brexit negotiations begin. This sudden decision has been embraced by many in the recruitment industry due to the anticipated st...

W1siziisijiwmtcvmdqvmtkvmtuvndivntgvnjcyl3nodxr0zxjzdg9ja18xmja3mdi1ndcuanbnil0swyjwiiwidgh1bwiilcizodb4mtawiyjdxq

Evolve or Die: The Importance of Being Agile

2017-04-19 18:00:00 +0100

In the high-speed world of IT, agility is essential if you want to stay on top. Over the last 20 years, Montash Managing Director Roy Dungworth has experienced many changes in the industry. But two things never change - the need for business agility and the importance of people. Roy shares his insights after two decades in the industry. The pace of the IT industry increases every year. The way people buy or consume information today is having an enormou...