Turning Data Ingestion into a Scalable, Reusable Framework for Enterprise Integration & Analytics
Customer Challenge
An insurance company had dozens of data warehouses they could not query at the same time, causing the effort to compare data to take months.
Innovative Solution
Illumination Works provided pre-built ingestion patterns to the enterprise data warehouses enabling complex analytics on two or more data sets with speed and flexibility for better decision making.
Benefits/Outcomes
- Developed flexible and extensible metadata-driven ingestion framework for a Hadoop target
- Ingested structured and semi-structured data into Hadoop, making data available in a single, centralized data warehouse, thereby eliminating data silos
- Provided active online storage capabilities at a low cost (commodity hardware) using Hadoop
Toolbox
- Data ingestion framework
- Hadoop platform
