From six hours to 22 minutes.
A warehouse migration to Snowflake shortened the nightly batch without interrupting reporting.
An anonymized client engagement.
- Engagement
- 14 weeks
- Delivery team
- 2 data engineers
with an Inpro technical lead
Reporting could not pause for a migration.
The existing on-premise warehouse needed six hours to complete its nightly batch. Moving it to Snowflake meant changing the data platform while people still relied on its reports.
The constraint shaped the delivery: keep the legacy reporting path available until the new route had been reconciled.
Explore our data engineering workValidate the new path before cutover.
The new platform ran alongside the existing warehouse. Reporting stayed on the legacy path until the new route was reconciled.
Keep reporting live
Reports keep reading from the existing warehouse while the new platform is built beside it.
Result No reporting interruption
Validate in parallel
Both paths run the same nightly workload until the results are reconciled.
Result Reconciled results on Snowflake
Switch the path
Reporting moves to the new route; the legacy path is retired once it is no longer needed.
Result A 22-minute nightly batch
Built in the client’s production stack.
Two data engineers and an Inpro lead worked across migration, cutover and handover. The warehouse, transformations, orchestration and infrastructure were delivered together.
dbt
The transformation layer. Data transformations managed as code within the production stack.
Airflow
The job orchestration. Coordinating the jobs that make up the nightly data workflow.
Snowflake
The target warehouse. The new platform for the nightly workload and the reporting it supports.
Terraform
The infrastructure. Repeatable infrastructure definitions for the new environment.
A smaller window for the same nightly workload.
The same nightly workload went from six hours to 22 minutes, while reporting remained available during the migration.
Results from the anonymized engagement described here.
Planning a warehouse migration?
Tell us what runs today, where the bottlenecks are, and which reporting needs to stay available. We’ll start there.
