Data Integration Tools

• ETL : Extraction, Transformation and Load Software
• ELT : Extraction, Load and Transformation Software

• Do it once at night vs. do it every time for a query
• The “360 degree view of the enterprise” is a commonly discussed goal that really means data integration.

• Oracle Warehouse Builder
• Informatica - Powercenter
• Oracle Data Integrator (Sunopsis)
• SQL Server Integration Services

• Talend
• Jaspersoft
• Ingres
• Kickfire

• Futur of Data Integration
• The ELT approach
• Kimball University: Should You Use An ETL Tool? You can still hand-code an extract, transform and load system, but in most cases the self-documentation, structured development path and extensibility of an ETL tool is well worth the cost. Here's a close look at the pros and cons of buying rather than building.
• Data Integration - Methods / Design Pattern
• Data Mining
• Data Integration - XREF, cross-reference, lookup
• Data Integration - Data Latency

A full Data Vault loading cycle might take 40 or 50 minutes total time, (50 staging tables, 1 terabyte incomming data) – where a so-called “traditional” (type 2 dimension + facts) loading cycle for the same data sets would take about 3 to 4 hours…. It can all happen in PARALLEL…

Reference : Warehouse Builder 11g - What is new and where do we go from here?

• Magic Quadrant for Data Integration Tools - Gartner

• Optimize data flows within processes and SOA
• Reduce overhead on source production systems
• Greater control and visibility of data across systems
• Increase performance for data integration
• Migration away from custom code, custom SQL, or proprietary ETL
• Enabling lower-latency or real-time data integration