Your AI Feature Is Quietly Destroying Your Gross Margin

Key Takeaways

• AI adds variable COGS, dropping SaaS gross margin from 80% to 65%
• 2026 AI product builders expect average gross margin ~52%, per ICONIQ
• Isolate AI COGS by revenue stream to avoid hidden margin erosion
• Align pricing with usage‑based AI costs via tiered or token fees
• Track AI cost metrics—cost per user, request, and margin—monthly

Pulse Analysis

The rise of generative AI has turned the once‑predictable cost structure of SaaS into a usage‑driven model. Traditional COGS—hosting, support, and DevOps—scaled efficiently with revenue, allowing companies to maintain 70‑80% gross margins. Today, each prompt, token, or workflow incurs a real, variable expense that can quickly eat into those margins, as illustrated by the ICONIQ 2026 survey and Salesforce’s Agentforce rollout processing 20 trillion tokens. This shift forces finance leaders to rethink the P&L, separating AI‑related costs from legacy SaaS expenses to avoid hidden margin erosion.

Financial discipline now hinges on granular visibility. By mapping AI COGS to specific revenue streams—subscription, usage‑based, or professional services—CFOs can calculate true gross margins for each line item. Pricing strategies must evolve from flat‑fee models to hybrid structures that combine a platform fee with usage tiers, token credits, or overage charges. Monitoring metrics such as AI cost per active user, cost per request, and AI‑specific gross margin on a monthly dashboard provides early warning signals before margin compression impacts CAC payback, Rule of 40, or valuation.

Looking ahead, token prices are expected to decline as models commoditize, offering a path back toward traditional SaaS margins. However, the journey requires a proactive margin roadmap: optimizing model routing, leveraging smaller models where appropriate, implementing caching, and refining prompt engineering. Companies that transparently isolate AI costs, align pricing with usage, and communicate a clear improvement plan will retain investor confidence and sustain growth, while those that ignore the new cost dynamics risk eroding profitability and market valuation.