Connecting to LinkedIn...

W1siziisijiwmtuvmdqvmtuvmdgvntqvmzgvnzi1l01ptlrbu0hfqkxpr19vtljftkrfukvex0lnqudfx3jlc2l6zwrfyw5kx3jlbmrlcmvklmpwzyjdlfsiccisinrodw1iiiwimtkymhgxmjuwiyjdxq

Blog

Big data remains challenging for enterprises

24/06/2016 by Sharon Shahzad

W1siziisijiwmtyvmdyvmjqvmdgvntuvmtgvotk5l0rhdgegzmxvdybjb25jzxb0lmpwzyjdlfsiccisinrodw1iiiwinjawedqwmfx1mdazzsjdxq

Despite big data offering companies around the world the opportunity to gain invaluable insights into their industry and customers, many firms continue to struggle with the volume of information available. Various problems are experienced, from preventing bad data incidences, to ensuring that data flows continuously to aid operational efficiency. It means that there’s a lot of work still to be done if firms are to gain every scrap of value from the data collected.

In new research, StreamSets, the data performance management company, highlighted that almost 90 per cent of businesses asked reported that they still had bad data flowing into their stores. Meanwhile, only 12 per cent of those surveyed believe that their data flow performance management operates well. One of the most heavily cited issues for big data management is the quality of the information, with corrupted, misleading or inaccurate data causing problems. Even for those committed to cleansing data throughout its lifecycle, bad data storage remains. In addition, despite having the ability to detect diverging data values being highlighted as valuable by the majority of those asked, just 34 per cent of firms rated themselves capable of the task.

The findings also highlighted specific weak links in big data management. For example, performance degradation and increasing error rates were mentioned by 44 per cent of people. Overall, an obvious trend was noted in that there’s a notable gap between the capabilities that firms have and the reported value of each individual competency.

StreamSets Chief Executive Officer Girish Pancha said: “In today’s world of real-time analytics, data flows are the lifeblood of an enterprise. The industry has long been solely fixated on managing data at rest and this myopia creates a real risk for enterprises as they attempt to harness big and fast data. It is imperative that we shift our mindset towards building continuous data operations capabilities that are in tune with the time-sensitive, dynamic nature of today’s data.”

Finally, another issue highlighted in the report is the continuing problem of data drift. In fact, 85 per cent of survey respondents said that unexpected changes in data semantics and structure could have a substantial impact upon operations. Because of this, 53 per cent of firms have to make alterations to data flow pipelines many times each month, with 23 per cent making changes on a weekly basis, if not more. Hand coding remains a popular way of designing pipelines, with firms also using data integration solutions and legacy ETL (Extract, Transform and Load) tools. 

 

 

 

Montash

 

About Us

Montash is a multi-award winning global technology recruitment business. Specialising in permanent and contract positions across mid-senior appointments across a wide range of industry sectors and IT functions, including:

ERP Recruitment, BI & Data Recruitment, Information Security Recruitment, Enterprise Architecture & Strategy Recruitment , Energy Technology Recruitment, Demand IT and Business Engagement Recruitment, Digital and E-commerce Recruitment, Leadership Talent, Infrastructure and Service Delivery Recruitment, Project and Programme Delivery Recruitment.

Montash is headquartered in Old Street, London, in the heart of the technology hub. Montash has completed assignments in over 30 countries and has appointed technical professionals from board level to senior and mid management in permanent and contract roles.

comments powered by Disqus

Social Stream

Latest News

W1siziisijiwmtcvmdcvmtgvmdgvndcvmduvntu5l2jpz3n0b2nrluv4b3rpyy1qyxjhzglzzs1ucmf2zwwtvg91cmktmtc2mju4ndm3lmpwzyjdlfsiccisinrodw1iiiwimzgwedewmcmixv0

Getting Ready to Switch Off

2017-07-17 09:00:00 +0100

According to research by online travel company Expedia, just 53% of workers come back feeling rested after they’ve been on holiday. When you bring work-related stress on holiday with you, you’re never going to be able to truly switch off. So if you've got a summer holiday coming up, what should you do to switch off and unwind? Before you leave... Plan ahead As soon as you know when your last day of work is, make a plan. You don't want to get to that fin...

W1siziisijiwmtcvmdyvmzavmtyvmtgvmjavmtg5l3nodxr0zxjzdg9ja182njkxody3mdkuanbnil0swyjwiiwidgh1bwiilcizodb4mtawiyjdxq

In Her Shoes... SAP Contracting

2017-07-03 09:00:00 +0100

In IT, being a freelancer is very common; due to the nature of project work or other life commitments. SAP is an area in which a quality freelancer can really thrive. We sat down with one of our SAP freelancers, who has 20 years' experience, to find out more about SAP and working under a contract employment model. "After getting a degree in computing, I started my career as a training assistant, but I've always liked to fix things. I used to fix my own ...