Redefining Data Engineering in the Age of AI

Why It Matters

The shift toward unstructured data and real‑time pipelines is increasing technical complexity and operational risk, raising stakes for hiring, tooling and investment to sustain AI deployments.

Summary

A survey of 400 senior data and technology executives by MIT Technology Review Insights finds data engineers are becoming central to corporate AI efforts, with 72% of respondents—and 86% at the largest, most AI‑mature firms—saying data engineers are integral to the business. The share of time data engineers spend on AI projects has risen from 19% in 2023 to 37% in 2025 and is expected to reach 61% within two years, while 77% of respondents report growing workloads. The shift toward unstructured data and real‑time pipelines is increasing technical complexity and operational risk, raising stakes for hiring, tooling and investment to sustain AI deployments.