Overview

Microsoft Integration Services is a platform for building enterprise-level data integration and data transformations solutions. You use Integration Services to solve complex business problems by copying or downloading files, sending e-mail messages in response to events, updating data warehouses, cleaning and mining data, and managing SQL Server objects and data. The packages can work alone or in concert with other packages to address complex business needs. Integration Services can extract and transform data from a wide variety of sources such as XML data files, flat files, and relational data sources, and then load the data into one or more destinations.

Orders & Details in SSIS

FIRST STEPS With INTEGRATION SERVICES

In this first article of Integration Services, we will build a process of ETL, reading from SQL Server Databases and flat files, calculating metrics like ‘Monto Renglon’ and lookups. These are the basic components to do the comparision among the Pentaho, Adeptia and the others tools.

Objectives:

• Metrics calculation
• Dimensions Calculation
• Join DATA & Split the flow.
• Load the “Clientes_Agrupados” Table

(Integration Services) Stress Test 1: Flat to Flat

First stress test: Pass 6 millions of records from a Flat File, to CSV file.

(Integration Services) Stress Test 2: Flat to MySQL


The Second stress test involves, Transfering 6 millions of records from a Flat File, to a table in MySQL.

(Integration Services) Stress Test 3: Lookups & Filters


Another analysis to do is measure the time taken for the transformation of "lookup" and "filter" with the same file that the previous tests.