Talend and MapR Technologies announced on Wednesday that Talend Open Studio for Big Data, an open source big data integration solution, has been certified to use with MapR’s Hadoop Distribution, providing users of Hadoop in the enterprise with high performance and scalable integration options.

Offered under the Apache Software License, Talend Open Studio for Big Data is a powerful and versatile open source solution for big data integration that natively supports Apache Hadoop. By leveraging Apache Hadoop’s MapReduce architecture for highly distributed data processing, Talend Open Studio for Big Data generates native Hadoop code and runs data transformations directly inside Hadoop for maximum scalability. Its easy-to-use graphical development environment dramatically improves the efficiency of data integration job design.

According to a recent report from Forrester Research, “Big data is all about processing and analyzing very large amounts of structured, unstructured, or semi-structured data very quickly. Although Hadoop offers a scalable data platform to process very large amounts of data for analytics purposes, getting data into the Hadoop platform is often not easy. Most leading ETL vendors are extending their solutions to integrate with Hadoop to offload large amounts of data from databases and data warehouses.” ¹

Talend Open Studio for Big Data bridges the gap between Hadoop and the rest of the information system, thanks to the broadest palette of connectors currently available on the market – both for Hadoop and many other data platforms and IT systems. Hadoop connectors included in Talend Open Studio for Big Data, and which are certified to use with MapR’s Distribution for Hadoop, include:

• Hadoop Distributed File System (HDFS), to load and extract data from Hadoop, in batch or streaming mode.
• NFS, to load, extract and stream data using MapR’s high performance standard file-base access.
• HBase, to load, extract and transform data into Hadoop’s column-oriented database.
• Pig (Pig Latin generation) and Hive (HiveQL generation), to process Hadoop data in place, leveraging the power of the MapR cluster.
• Sqoop, for building direct Hadoop-to-database links without coding.

MapR’s Distribution is also available as the EMC Greenplum MR Edition and available with Cisco UCS.

To ensure connectivity of Hadoop with the rest of the information system, Talend Open Studio for Big Data also provides an unmatched set of connectors for:

• Databases, such as Oracle, MS SQL Server, MySQL, DB2, PostgreSQL, Teradata, Vertica, EMC Greenplum, Infobright, etc.
• ERP/CRM systems, such as SAP, MS Dynamics, Salesforce.com, etc.
• SaaS, Cloud and Social platforms, including Amazon Web Services, NetSuite, Marketo, Google, Twitter, etc.
• Files – structured, poly-structured and semi-structured, flat, XML, etc.
• Mainframes & midrange systems, Cobol files, etc.