WITH TALEND INTEGRATION SUITE MPX, TALEND INTRODUCES EXTREMELY SCALABLE DATA INTEGRATION FOR LARGE DATA VOLUMES
Benchmark on New Sun Blade Server Proves Talend´s Latest Solution
has Risen Above all Performance and Scalability Standards in a
Complex Data Processing Environment
LOS ALTOS, Calif., May 19, 2009à¢â‚¬à¢â‚¬Talend, the recognized market leader in open source data integration software, today announced the availability of Talend Integration Suite MPX, a new enterprise data integration platform specially designed to help organizations attain the highest levels of performance and shatter the limits typically associated with traditional data integration processes.
Based on Talend´s award winning, enterprise-grade data integration platform Talend Integration Suite, the new solution introduces the company´s FileScale technology. The latest breakthrough technology, FileScale, allows organizations to conduct highly parallelized processing. FileScale enables enterprises to process large volumes of data in even less time, while also eliminating the limitations inherent in traditional data integration architectures.
à¢â‚¬à…“Even as data volumes grow exponentially and processing windows shrink, organizations are under pressure to process and load data even faster to support time-sensitive, data-driven business methods, like operational business intelligence, performance management, just-in-time inventory, one-to-one marketing, and so on, said Philip Russom, a research manager at The Data Warehousing Institute (TDWI). à¢â‚¬à…“Delivering large data volumes in a short period of time demands a data integration infrastructure that seamlessly processes data in parallel at every step of the way.
Fully compatible with projects developed with Talend Integration Suite, MPX leverages two key sets of features to attain extreme scalability:
à¢â‚¬¢ FileScale Talend's latest technology is based on the MapReduce architecture originally developed by Google for highly distributed processing of data in a data set mode. The FileScale components in Talend Integration Suite MPX allows integration processes to sort, filter and merge data, perform aggregation and arithmetic functions and transform and ensure the compliance of data. FileScale components are especially optimized for each supported platform, ensuring the highest possible performance.
à¢â‚¬¢ Massive Parallelization Talend Integration Suite MPX also features multiple levels of massive parallelization, allowing the execution of separate sub-processes in parallel, break down of data sets into many parallel streams and the ability to leverage parallel database loaders.
With Talend Integration Suite MPX, IT organizations are able to process high volumes of data very quickly, providing the most up to date insight into the enterprise´s operations. Data warehouses and analytic applications can be refreshed more often and can include more granular data for more accurate analysis all in efforts to equip the enterprise to make more informed and accurate business decisions.
"More customers are realizing their data is an untapped resource and looking for an effective solution to leverage their data. Talend Integration Suite MPX addresses the true needs of the enterprise by providing high volume data processing," said Fabrice Bonan, co-founder and COO of Talend. "This new solution, which has outperformed all benchmarks, introduces a new implementation of ground-breaking technology and algorithms and takes data processing to the next level."
A benchmark was performed with Sun Microsystems on a Sun Blade X6270 server, featuring two Xeon 5520 quadcore processors at 2,26GHz and 24 GB of RAM, and running Solaris 10 update 6. In this benchmark, Talend Integration Suite MPX reached levels of scalability in sorting and calculation tests that have never been met before. The benchmark was performed with industry-standard TPC-H data sets, ranging in size from six million to 3.3 billion records.
Results of the benchmark highlighted the following performance metrics:
à¢â‚¬¢ In-memory sorting of data reaching up to one million records per second with linear scalability.
à¢â‚¬¢ Record-breaking sorting of large data sets (3.3 billion records) at a speed of 200,000 to 400,000 records per second.
à¢â‚¬¢ Average calculation on large data sets (3.3 billion records) reaching 220,000 records per second.
Full results of the benchmark, analyzed and noted by Sun's performance expert, Amir Javanshir, can be obtained here: http://blogs.sun.com/aja/entry/talend_s_new_data_processing.
Talend Integration Suite MPX is available immediately and has been optimized on the following platforms: Windows 32 & 64 bit, Solaris & OpenSolaris (SPARC & Intel x86), IBM AIX, HP-UX and Linux 32 & 64 bit. For more information, please visit http://www.talend.com.
About Talend
Talend is the recognized market leader in open source data integration. More than 500 paying customers around the globe, including Yahoo!, Virgin Mobile, Sony and Swiss Life, use the Talend Integration Suite of products and services to optimize the costs of data integration, ETL and data quality. With more than four million lifetime downloads and 900,000 core product downloads, Talend´s solutions are the most widely used and deployed data integration solutions in the world. The company has major offices in North America, Europe and Asia, and a global network of technical and services partners. For more information, please visit http://www.talend.com.