The Value of AI - Where Is the Data?

Why It Matters

Understanding who truly benefits from AI tools and addressing security concerns prevents wasted investment and ensures that productivity gains are real, not just perceived.

Key Takeaways

• Data scarcity hampers accurate measurement of AI's business value.
• AI boosts productivity for some developers, but not universally.
• Conduct ethnographic analysis to gauge engineer sentiment toward AI tools.
• Security teams often resist newly introduced AI-driven solutions.
• Proliferation of AI tools demands careful selection and integration.

Summary

The video centers on the difficulty of quantifying AI’s true business value due to a lack of robust data. The speaker acknowledges personal benefits—helping her husband and herself write—but stresses that beyond anecdotal wins, the impact remains fuzzy, especially when organizations consider AI‑driven development tools.

Key insights include the uneven productivity gains across engineering teams, the necessity of an ethnographic approach to understand internal sentiment, and the natural reluctance of security engineers to adopt nascent AI solutions. The speaker argues that without profiling who within a company will benefit, firms risk over‑investing in tools that only serve a subset of developers.

Illustrative quotes highlight this tension: “It helps my husband work… it helps me write things, cool,” followed by a challenge to the blanket narrative that AI universally accelerates development. She also notes that security teams are “reluctant to support AI products… that have just been built in a couple months,” underscoring cultural and risk‑management barriers.

For businesses, the implication is clear: before scaling AI tools, leaders must gather internal usage data, map engineer attitudes, and align security policies. Thoughtful selection and integration, rather than a one‑size‑fits‑all rollout, will determine whether AI translates into measurable productivity and competitive advantage.

Original Description

In this clip with Sam Barlien Giovanna Faso breaks down the the fuzzy value of AI for IT organizations, and the understandable hesitancy security teams have when approaching it.

If you’re trying to succeed with platform engineering in a secure way, this is a practical look at what matters most, especially as AI reshapes how teams build and operate platforms.

👉 Full episode covers the intersection between platform engineering, and security, and how security teams can prepare themselves for a future dominated by platforms and AI.

👉 https://youtu.be/aXPUY16ivyA