Img-Reboot

Operationalized a data platform to streamline analytics and create an Insights Organization that provides same day data and platform provisioning

Summary

Client was facing challenges w.r.t making data available on-time without costs, delays, and data quality issues

  • Local copies of data scattered in the ecosystem made the data unreliable and increased storage costs
  • Provisioning data on-time and consumers had to wade through long request queues
  • Lack of skillsets to glean insights from data further compounded the problem

Approach

The approach to address the client’s challenge included:

  • Setting up a central Cloud-Data warehouse as a single source of truth
  • Laying the foundational data-architecture which classified requests to zones based on repeatability and usage
  • Introducing a metadata driven- UI based governance framework to capture data-requests
  • Building re-usable frameworks to enable the platform to serve personas with data requests, platform usage requests and insights requests
  • Harnessing the power of Data-Bricks on Azure for workload based dynamic, auto-scalable ingestion layer creation

Key Benefits

  • Azure native solution easily integrable with Rest-API driven governance framework on Collibra for organization wide transparency
  • Handles, changing records, unified streaming, and in-built data-quality layer using the delta-lake feature of data-bricks
  • Loosely coupled frameworks for logging/Alerting & monitoring which are cloud-agnostic and can be re-configured and used as need be

Results

Icon Boost

The time to on-board data decreased to a 24-hour cycle

Icon Boost

Overall storage and compute cost slashed by 30%

Icon Boost

One platform – For Bring your own data, Platform & data services and Insights services

Talk To Us