Data Integrations thoughts

Data Tranformations:
1. merge – combining multiple data sets into a single data set (sql merge)
2. aggregation – combining data to show summary views (OLAP – min, max, avg, etc… sql group by)
3. enrichment – taking a master file and joining additional details from another source that’s believed to have trust worthy information to gain deeper insights
4. summarization – readily digestible information to help make decisions
5. filtering – getting just the records you want to focus on – where clause of a sql statement

What is a triggered ETL process
Triggered – an event such a recurring job or an event triggers a ETL process
Extract – extracting data from source system
Transformation – transforming the data fields (data types and values) and record format
Load – loading the data into a target system

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s