Challenges
- Client EBI sources data from various internal/third party applications and transforms aggregates, generates metrics as needed
- Sourcing data from multiple systems results in data discrepancies and inconsistencies
- The following problems were scoped for EBI team to address the following:
- Existing workflows were not designed to support history loads
- Inconsistencies in the Environment
- Standardization of Processes
Solutions
- Modified Workflow: Identified and analyzed the workflows, modified it to support the history loads
- Stabilized the Environment: Performed end-to-end analysis of the systems to analyze and fix the root cause for data discrepancies
- Standardized Data Procurement and Data Validation Processes: Defined data procurement plans specific to the environment. Automated ETL load validations
Tools & Technologies
SQL Server, Informatica, Oracle, MySQL
Key benefits
- Improved overall quality by analyzing the system, identifying technical flaws in existing designs
- Modified and standardized the testing processes to suit client’s environment
- Reduced costs by developing tools for ETL load validations
- Provided a reliable and scalable architecture to meet the requirements
- Improved the operational efficiency by reducing the amount of time spent on preparing the information for decision making
