The AI Upskill Most Teams Are Overlooking | Gartner CIO Leadership Forum

Why It Matters

Prioritizing human‑centric soft skills ensures AI initiatives deliver reliable outcomes, protecting organizations from costly errors and maximizing ROI.

Key Takeaways

• Human judgment and critical thinking outpace AI technical prowess.
• CIOs must partner with HR to embed soft‑skill training.
• Hallucination hunts teach developers to validate AI outputs.
• Contextual awareness prevents automation bias and costly errors.
• Prompt engineering remains essential for reliable AI model interaction.

Summary

The Gartner CIO Leadership Forum session highlighted that the most valuable AI upskill today isn’t a new programming language but human‑first soft skills. Analyst Mandi Bishop argued that critical thinking, judgment, contextual awareness and healthy skepticism are the differentiators between AI value and AI failure, and she presented a practical "soft‑skills academy" to cultivate them.

Key insights include the need for CIOs to collaborate closely with HR, using scoring rubrics and maturity models to measure competencies across the enterprise. Bishop emphasized that over half of CIOs already rank core human judgment among top hiring criteria, yet these attributes remain hard to capture. She introduced "hallucination hunts"—exercises where developers spot AI‑generated errors—to reinforce validation habits.

Illustrative examples ranged from a personal autocross racing analogy—comparing AI to a Formula 1 car that still requires a skilled driver—to a healthcare‑focused hallucination hunt that exposed a mis‑redaction of patient IDs. The session also covered prompt engineering as an extension of critical thinking, showing how precise prompts reduce hallucinations and improve cost efficiency.

The implications are clear: without deliberate soft‑skill development, organizations risk automation bias, compliance breaches, and missed financial returns from AI investments. CIOs who embed measurable soft‑skill training can safeguard AI deployments, boost workforce confidence, and unlock sustainable AI‑driven value.

Original Description

Are you upskilling the right skills that AI can’t replace?

Attend a Gartner CIO Conference near you: https://gtnr.it/4tE9X7r

See why Gartner is the world authority on AI: https://gtnr.it/4vqoRQi

In this episode of ThinkCast, recorded from a live session at Gartner CIO Leadership Forum, Gartner Distinguished VP Analyst Mandi Bishop breaks down why so‑called “soft skills” have quietly become the hardest — and most essential — capability to scale in the age of AI. From practical workforce exercises to Mandi’s own racing experience, hear how over‑reliance, complacency and automation bias creep in — and how CIOs can rebuild critical thinking, judgment and contextual awareness to turn AI tools into true performance accelerators.

Try out AskGartner for more AI-powered insights: https://gtnr.it/421EXT6

Watch more ThinkCast episodes: https://youtube.com/playlist?list=PLk5mazZ3BVLIz4tL5Idhh2b7e9BPQTQM5&si=0oxQi3ueITIa8z4u

Timestamps:

00:00 Intro

00:40 Soft Skills Aren’t Optional

03:35 AI Is a Formula 1 Car

08:36 Hallucination Hunts

14:46 Prompting Is Still a Critical Skill

22:25 The “So What” Studio in Practice

Subscribe for more insights from Gartner on tech, AI and the future of business: https://www.youtube.com/user/Gartnervideo/

LEARN MORE ABOUT GARTNER

Gartner delivers actionable, objective business and technology insights to executives and their teams. Our expert guidance and tools enable faster, smarter decisions and stronger performance on an organization’s mission-critical priorities.

Website: https://www.gartner.com/

LinkedIn: https://www.linkedin.com/company/gartner

Twitter: https://twitter.com/Gartner_inc

Instagram: https://www.instagram.com/gartner_inc/

Podcast: https://www.gartner.com/en/podcasts/thinkcast

#gartner #thinkcast #techpodcast #aiskills #ai