The AI Gateway Advantage: Value over Spend. Smart Work over Hard Work
Description
A practitioner's operating model for scaling enterprise AI without vendor lock-in. This paper argues that token spend is the wrong metric, shows how an organization-owned AI gateway turns telemetry into governable value, sets out how to engineer exit cost toward zero, and reframes sovereignty as an enforced routing policy rather than a paragraph in a policy document. Revision 2 (October 2026) records the market's move to automatic, per-request model selection behind the gateway and points to the companion paper that governs it, Who Picked the Model?. Part of the Sovereign Digital Resilience series.
Notes (English)
Revision 2 (October 2026): records the market's move to automatic, per-request model selection; Layers 3 and 4, the L4 Coaching layer, the six-month plan and the long-term outlook updated; revision note and references 15–18 added.
Files
ai-gateway-advantage.pdf
Additional details
Related works
- Is supplement to
- Preprint: https://www.sanjeetkumar.com/papers/ai-gateway-advantage (URL)
References
- TrueFoundry, "A Detailed LiteLLM Review: Features, Pricing, Pros and Cons," 2026. truefoundry.com/blog
- Eden AI, "Top LiteLLM Alternatives in 2026: Compared by Cost, Performance & Features," 2026. edenai.co
- Maxim AI, "Top 5 LiteLLM Alternatives in 2026," 2026. getmaxim.ai
- Techsy, "Best LLM Gateway 2026: 9 Tools Ranked & Tested," 2026. techsy.io
- Amazon Web Services, "Application Inference Profiles," Amazon Bedrock User Guide. docs.aws.amazon.com/bedrock
- Amazon Web Services, "Understanding Intelligent Prompt Routing in Amazon Bedrock," Amazon Bedrock User Guide. docs.aws.amazon.com/bedrock
- Amazon Web Services, "Reduce Costs and Latency with Amazon Bedrock Intelligent Prompt Routing and Prompt Caching," AWS News Blog. aws.amazon.com/blogs/aws
- Anthropic, "2026 Agentic Coding Trends Report," 2026. resources.anthropic.com
- Forrester, "The State of Agentic Software Development, 2026," 2026. forrester.com
- Osler, Hoskin & Harcourt LLP, "Data Sovereignty: Looking to the Past as Canada Decides How to Move Forward," 2025. osler.com
- Torys LLP, "Canada Promotes Investment in Sovereign, Large-Scale AI Data Centres," January 2026. torys.com
- Borden Ladner Gervais LLP, "Canada's New AI for All Strategy: A Business Outlook on AI Governance, Adoption, and Data Sovereignty," June 2026. blg.com
- Innovation, Science and Economic Development Canada, "Enabling Large-Scale Sovereign AI Data Centres," Government of Canada, 2026. ised-isde.canada.ca
- Shared Services Canada, "2026–27 Departmental Plan," Government of Canada, 2026. canada.ca
- GitHub, "Auto model selection is generally available in GitHub Copilot in Visual Studio Code," GitHub Changelog, 10 December 2025. github.blog/changelog
- GitHub, "Auto model selection now routes based on your task in VS Code," GitHub Changelog, 20 May 2026. github.blog/changelog
- GitHub, "Changes to model selection for Free and Student plans," GitHub Changelog, 24 June 2026. github.blog/changelog
- Microsoft, "Use model router for Microsoft Foundry," Microsoft Learn, 2026. learn.microsoft.com/azure/ai-foundry/openai/how-to/model-router