Is "Testing in Production" Actually the Safest Way to Ship?
•February 27, 2026
0
Why It Matters
Testing in production, when backed by strong observability and feedback loops, transforms risk into rapid learning, enabling firms to ship faster while maintaining reliability—a competitive advantage in today’s software‑driven market.
Key Takeaways
- •Durable code requires incremental, production‑tested changes to maintain system stability
- •Observability and fast feedback loops enable safe testing in production
- •Hiring elite engineers alone doesn’t guarantee high‑performing teams
- •Trust, diverse roles, and responsibility drive effective software delivery
- •Continuous deployment with guardrails makes failure safe and learning rapid
Summary
The podcast episode explores whether testing in production is the safest way to ship software, contrasting disposable code generated by AI with durable, production‑tested code that underpins critical systems.
Speakers argue that incremental, observable changes are essential; observability‑driven development, continuous deployment, and separating deploy from release create fast feedback loops that let engineers verify behavior in live environments. They also critique the myth of hiring only top‑percent engineers, citing Google’s Project Aristotle and Belbin’s team‑role research that show trust, diversity, and shared responsibility outperform raw talent.
A memorable line from the conversation: “There’s only one way to test – in prod or live a lie,” underscoring the necessity of real‑world validation. The hosts cite Coinbase’s brag about hiring the 0.1% of applicants and contrast it with the need for sociotechnical systems that give every engineer rapid, safe feedback.
The takeaway for leaders is to invest in observability tooling, automate safe rollbacks, and cultivate cultures where failure is a learning signal. By doing so, organizations can ship more frequently, accelerate skill development, and reduce reliance on elite hiring as a shortcut to performance.
Original Description
The video features a discussion between Dave Farley and Charity Majors about the bifurcation of software into disposable and durable code. Majors emphasizes the growing importance of code generation for knowledge workers, contrasting it with the development of durable, long-lasting code. This conversation highlights the future of programming and the role of AI in website builder comparison.
This clip is taken from this FULL podcast episode ➡️ https://open.spotify.com/episode/6jURtP1FGSUU6U6Klw7xOh?si=96b9bba0c50c4f57
-
⭐ Only Patreon Supporters get to see the FULL VIDEO Episodes of The Engineering Room, sign up here ➡️ https://www.patreon.com/c/continuousdelivery
-
🗣️ THE ENGINEERING ROOM PODCAST:
-
🙏The Engineering Room series is SPONSORED BY EQUAL EXPERTS
Equal Experts is a product software development consultancy with a network of over 1,000 experienced technology consultants globally. They increase the pace of innovation by using modern software engineering practices that embrace Continuous Delivery, Security, and Operability from the outset ➡️ https://bit.ly/3ASy8n0
-
#code #programming #ai #softwareengineering #softwaredevelopment
0
Comments
Want to join the conversation?
Loading comments...