Large-Scale Data Integration

Customer Challenge

The USAF requires reduction in the number of systems and point-to-point interfaces across agencies, organizations, and geographic locations.

Innovative Solution

Illumination Works supported the Air Force Chief Data Office (CDO) leveraging Informatica Axon Data Governance tools hosted in the CDO data lake environment. The CDO data ingestion processes and framework were being built to accommodate an automated metadata collection process. To facilitate rapid system ingestion, our team developed templates to define common language and parameters to define any given ingestion, including transmission methods, metadata, and appropriate security controls, across all systems regardless of file size, format and transmission method.

Benefits/Outcomes

  • Documented templates for persistent system interfaces
  • Kylo/Nifi workflow that can be duplicated across systems

Toolbox

  • Streaming data ingestion, profiling, cleansing
  • Big data frameworks
  • Data science exploitation (machine learning, advanced analytics, and artificial intelligence)
  • Kylo, Apache Nifi, Informatica Axon

Related Case Studies You May Like

Turning Physical Operations into Real-Time Supply Chain Insight (Retail)

Turning Physical Operations into Real-Time Supply Chain Insight (Retail)

Modernizing Nuclear Asset Accountability Across the Sustainment Enterprise (Air Force)

Modernizing Nuclear Asset Accountability Across the Sustainment Enterprise (Air Force)

Enabling What-If Scenario Planning for Predictive Logistics Decisions (Air Force)

Enabling What-If Scenario Planning for Predictive Logistics Decisions (Air Force)

Data Pipeline for Improved Data Management (Insurance/Retail)

Data Pipeline for Improved Data Management (Insurance/Retail)

Data Science & Architecture Assessment (Marketing)

Data Science & Architecture Assessment (Marketing)

Turning Raw Behavioral Data into Predictive Customer Insight with Deep Learning (Retail)

Turning Raw Behavioral Data into Predictive Customer Insight with Deep Learning (Retail)

Database Tuning & Optimization (Retail)

Database Tuning & Optimization (Retail)

Big Data Ingestion & Cloud Architecture

Big Data Ingestion & Cloud Architecture

Data Integration Hub Modernization (Air Force)

Data Integration Hub Modernization (Air Force)

Data Warehousing & Business Intelligence

Data Warehousing & Business Intelligence

Big Data Engineering for Improved Analytics (Retail)

Big Data Engineering for Improved Analytics (Retail)

Turning Transaction Data into Secure, Scalable Analytics & Business Insight (Retail)

Turning Transaction Data into Secure, Scalable Analytics & Business Insight (Retail)

Cloud-Based Big Data Analytics (Retail)

Cloud-Based Big Data Analytics (Retail)

Predictive Analytics for the Aircraft Digital Thread (Air Force)

Predictive Analytics for the Aircraft Digital Thread (Air Force)

Predicting Contract Performance Risks to Enable Proactive Acquisition Management (Air Force)

Predicting Contract Performance Risks to Enable Proactive Acquisition Management (Air Force)

Turning Sensor Data into Predictive Maintenance Insight for Improved Asset Performance (Retail)

Turning Sensor Data into Predictive Maintenance Insight for Improved Asset Performance (Retail)

Data Cleansing and Migration (Energy)

Data Cleansing and Migration (Energy)

Application Modernization (Healthcare)

Application Modernization (Healthcare)

Large-Scale Data Integration (Air Force)

Large-Scale Data Integration (Air Force)

Turning Raw Data into Scalable, Analytics-Ready Pipelines for Data Science & AI (Energy)

Turning Raw Data into Scalable, Analytics-Ready Pipelines for Data Science & AI (Energy)

Transformation to Modern Analytics Framework (Energy)

Transformation to Modern Analytics Framework (Energy)

Agile Big Data Analytics Framework (Retail)

Agile Big Data Analytics Framework (Retail)

Big Data Hadoop Administration (Retail)

Big Data Hadoop Administration (Retail)

Turning Data Ingestion into a Scalable, Reusable Framework for Enterprise Integration & Analytics (Insurance)

Turning Data Ingestion into a Scalable, Reusable Framework for Enterprise Integration & Analytics (Insurance)

Engines Forecast Reporting Tool (Air Force)

Engines Forecast Reporting Tool (Air Force)

Data Quality & Lineage Mapping (Retail)

Interested In Working With Us?