LiteLLM is the known option. agentgateway is the open one.
Comparing LiteLLM and agentgateway for enterprise AI platforms: licensing boundaries, security advisories, ops footprints, and open governance.
- Agent
- LLM
- Guide
With your consent, Google Analytics measures which pages help visitors so I can improve them.
Nothing loads before you accept, and you can change your choice from the footer at any time. Privacy
Writing
Pragmatic field notes on AI agents, MLOps, cloud architecture, and engineering systems.
Get new articles in your feed reader. Copy the RSS link into your reader to subscribe.
Comparing LiteLLM and agentgateway for enterprise AI platforms: licensing boundaries, security advisories, ops footprints, and open governance.
Engineering organizations are waking up to a sobering financial reality: the cost of running AI systems scales linearly, not logarithmically.
We are building the most advanced AI systems in history, yet the best way to control them relies on paradigms from the 1970s.
Building AI-First apps with A2UI: from the Agent-View-Controller (AVC) pattern to managing latency. A practical case study with Featest.
Discover how A2UI solves the AI Agent UI bottleneck. A deep dive into replacing chatbots with agents that project their own native UIs.
Build custom AI image workflows fast with Combo-Banana. Empower designers to automate tedious editing tasks with Google Nano-Banana.
I launched the first video series of my MLOps Coding Course, covering the introduction and the entire first chapter, made with NotebookLM in under 48 hours.
A father tests Gemini AI’s coding skills to create a magical birthday for his 6-year-old. See the staggering results from Deep Think!
It is a classic tale of corporate life. A colleague of mine at Decathlon had a mammoth task: translate a 155-slide presentation into several languages.
A guide to creating conversational AI with Gemini. Generate custom educational audio with multiple voices using a simple Python script.
Navigate the challenges of scaling LLMs on GCP and get benchmark insights for cost-effective, reliable, and quick LLM serving.
Explore the shift from slow data pipelines to real-time API management for building Gen AI systems and modern enterprise data architecture.
CAG vs RAG for Generative AI: Compare latency, cost & complexity. Choose the best LLM context strategy for your app.
As developers and AI practitioners, many of us belong to vibrant online communities, like the MLOps Community on Slack.
Explored Gemini’s long context in a Kaggle competition. Key lessons learned about its potential and limitations.
How I built a chatbot that answers questions about my resume with the OpenAI API, Chroma DB, HuggingFace Spaces, and Gradio, and what I learned along the way.
How I used the ChatGPT API to standardize the open-ended answers of the MLOps Community survey on LLMs in production, and the lessons I learned.