Pentaho Data Integration provides the capability to create an ETL framework using Meta data ingestion method. This approach will allow to generalize ETL transformations that can change the behavior during run time. Instead of creating individual ETL transformations for each source entity, Pentaho Data Integration can create a template transformation for a specific functionality and ingest meta data information to this template from property files or data base tables.
Advantages of using Pentaho Data Integration Metadata approach
With Meta data Injection, developer agility and productivity will accelerate.
Instead of creating and maintaining dozens of transformations built with a common pattern, developers define a single transformation template and change its run time behavior by gathering and injecting meta data from property files or database tables.
Maintenance and updates required for any ETL change will be very minimal. We may need to change only the Meta data information if there is any change in the source. For e.g., additional columns, sata type changes, removing columns, etc.
