Intel is eyeing off the world of Big Data with the latest round of updates to its Parallel Studio Suite.
In the latest update, Chipzilla has added a Data Analytics Acceleration Library (DAAL) to its venerable Math Kernel Library (MKL).
DAAL's aim is to speed the operation of data analysis platforms like Hadoop, Spark, Matlab, and R.
Among other things, DAAL is designed to overcome a limitation in the MKL. As James Reinders writes in the blog post, “most of Intel MKL was designed for when all the data to operate upon fits in memory at once. Intel DAAL can handle situations when data is too big to fit in memory all at once, which can be referred to as having an ‘out of core’ algorithm”.
Over at The Register's HPC sister publication The Platform, Nicole Hemsoth quotes Reinders as saying “no matter what the function or algorithm is, DAAL combines the data handling intelligence with the computational algorithms to manage both the data handling and the number crunching.”
Another challenge using big data in HPC environments is that “the data is in many formats and comes from many different streams and oftentimes, these were not collected and prepared with complex algorithms or computations in mind”.
DAAL is designed to help with this as well, to help find the data, prepare it for computation, and maximise the computation efficiency.
This article has been extracted from http://www.theregister.co.uk, please click on this link to read the article in fullhttp://www.theregister.co.uk/2015/08/26/intel_adds_big_data_functions_to_math_libraries/
Montash is a multi-award winning global technology recruitment business. Specialising in permanent and contract positions across mid-senior appointments across a wide range of industry sectors and IT functions, including:
ERP Recruitment, BI & Data Recruitment, Information Security Recruitment, Enterprise Architecture & Strategy Recruitment , Energy Technology Recruitment, Demand IT and Business Engagement Recruitment, Digital and E-commerce Recruitment, Leadership Talent, Infrastructure and Service Delivery Recruitment, Project and Programme Delivery Recruitment.
Montash is headquartered in Old Street, London, in the heart of the technology hub. Montash has completed assignments in over 30 countries and has appointed technical professionals from board level to senior and mid management in permanent and contract roles.