The results underscore the limits of generic AI for specialized enterprise networking and argue for domain-trained models to improve reliability and accuracy; Cisco’s human-in-loop remediation model reflects cautious operational deployment to maintain trust and safety.
Cisco tested its proprietary deep networking model against generalist LLMs (GPT-5, Lambda/Gemma, GPTO OSS) on a 590-question MCQ benchmark and reported roughly a 20% performance advantage. The company credits that lead to training on its own networking data, yielding more specific and correct answers for enterprise use cases. Cisco demonstrated troubleshooting workflows—such as QoS fixes—that can execute via APIs, but the system is designed to keep humans in the loop and prompt for confirmation before making changes. The approach prioritizes accuracy and operator trust over fully autonomous remediation.
Comments
Want to join the conversation?
Loading comments...