As mentioned in the previous blog; in this digital economy, we are generating petabytes of data by the minute. The information is in the form of Social media, Online shopping, Online banking, Travel, Reservations, Healthcare, IoT, Medical and Machine data. There is an infinite amount of information and intelligence buried in this data.
If we can harness the intelligence buried in this data, it can help us in making superior decisions. So how do we analyze this data. The key steps involved in value extraction are: Ingestion, Transformation, Modeling, Data Analytics and Visualization as shown in the diagram below.
Shown in the flow diagram below, are all the building blocks and the tasks that are performed under each block.
Ingestion
- Validating Data
- Data Import
- Real time Data
- Batch Data
- Storage
- Validating Ingestion results
Transformation
- Data Mapping
- Code generation
- Data migration
- Data conversion
- ETL
- Data wrangling
Modeling
- Data Models
- Conceptual, logical + physical schemas
- Process + methods
- Entity relationships
- Generic + Semantic data modelling
Analytics
- Cognitive
- Predictive
- Derived value
- Filter, sort, range
- Clusters, correlate, anomalies and patterns
- Data Mapping
Visualization
- Interactive Charts, Dashboards + Reports
- Easy data discovery
- Identify critical drivers
- Key Relationships
- Clusters + Trends
- Auto-charting
In our next Blog, we will discuss, how Cloud and Cloud Computing is helping to accelerate the Digital Transformation.