Day 17 examined what every call carries on the way in — the system prompt, the tool catalog, the examples, the payload that pays a bill on every request whether it needs to or not. Today's issue steps back from the call itself. Every AI feature leaves…
Day 18 of Green, Efficient AI is live — The Forever Data. Every AI system carries two footprints. The work it performs, and the data it leaves behind. The second one rarely gets named. A B2B platform running a retrieval assistant found that three routine…
AI doesn't need another breakthrough model. It needs a return to engineering fundamentals. Somewhere between foundation models and agentic AI, we confused capability with architecture. Because a model can reason doesn't mean every task requires reasoning.…
AI doesn't need another breakthrough model. It needs a return to engineering fundamentals. Somewhere between foundation models and agentic AI, we started confusing capability with architecture. Bigger models, more agents, longer context windows, and…
Day 16 traced the compute that safety adds on the outside of every call. Day 17 opens the same call up and looks at what is actually inside it — the request the model reads, not the message the user sent. The gap between the two is usually enormous. A user…
Day 17 of Green, Efficient AI is live — The Invisible Payload. A user asks a support agent to reset their password — seven words, roughly ten tokens. The trace shows the model actually receives thousands of tokens. A system prompt written months ago. Every…
Day 15 covered the routing discipline — the choice of which model answers a request, and the four-rung ladder of Filter, Classify, Route, Call that decides whether a call should ever reach a heavyweight model at all. That settles one piece of the system…
Day 16 of Green, Efficient AI is live — Every Guardrail Is a Call. The most overlooked line item in an AI system is the safety wrap. So why do most teams run four or five model-based checks on every request without ever costing them? In many production…
For decades, AI has lived behind screens—answering questions, generating content, and assisting human decision-making. But a new frontier is emerging. Physical AI is taking agentic intelligence beyond the digital realm and into the physical world. From…
Over the past few years, frontier AI has advanced at a pace few predicted. Bigger models. Stronger reasoning. Capabilities that genuinely felt out of reach two years ago are now routinely available through an API call. That progress matters. Frontier models…
The future of enterprise AI is not about maximizing intelligence. It is about delivering the minimum intelligence required to achieve the maximum business outcome. This idea has increasingly shaped how I think about the next phase of enterprise AI. Over the…
For decades, AI has lived behind screens—answering questions, generating content, and assisting human decision-making. But a new frontier is emerging. Physical AI is taking agentic intelligence beyond the digital realm and into the physical world. From…
A session at the Green Software Development Karlsruhe meetup on connecting Software Carbon Intensity (SCI) to agentic systems — why cost, energy, and carbon are deeply connected but not the same thing, and how to start measuring.
The model is usually the most expensive component in an AI system. The compute it consumes, the memory it occupies, and the energy it draws all converge on a single moment: inference. Yet in many production systems, every request still reaches the model. That…
Day 15 of Green, Efficient AI is live — The Route Before the Model. The model is usually the most expensive component in an AI system. So why does every request still reach it? In many production pipelines, the answer is reflex, not architecture. A telecom…
Most production AI systems run in a region somebody picked years ago, on hardware procured for a different workload, and on schedules chosen for operational convenience rather than carbon performance. None of those choices were carbon-aware. Most of them are…
Day 14 of Green, Efficient AI is live — The Grid You Didn't Choose. Most production AI runs in a region somebody picked years ago, on hardware procured for a different workload, and on schedules chosen for operational convenience rather than carbon…
Last week, I had the opportunity to deliver the keynote at the CleanEnviro Summit Singapore Catalyst 2026 in Singapore, hosted by the National Environment Agency. Dr. Janil Puthucheary, Senior Minister of State, Ministry of Sustainability and the Environment…
Keynote at CleanEnviro Summit Singapore Catalyst 2026, hosted by the National Environment Agency: why sustainability and business value are the same path, the shift to outcome-based metrics in Environmental Services, and the two dimensions of Green AI.
Most inference traffic is not waiting on a human. It is waiting on a loop. Embeddings for an index that refreshes hourly. Classifications for a moderation queue. Summaries for a digest that ships at seven in the morning. Evaluations that run overnight. None…
Day 13 of Green, Efficient AI is live — The Queue You Never Built. Most inference traffic is not waiting on a human. It is waiting on a loop. Embeddings for an index that refreshes hourly. Classifications for a moderation queue. Summaries for a morning…
Days 8–11 worked the loop itself — its turn count, its route, its tool shape, its context weight. That closes the loop chapter. This issue opens a new one. The next three days work on the platform underneath the loop, so the same work costs less every time it…
Day 12 of Green, Efficient AI is live — Cache What Doesn't Change. Depending on the workload, forty to ninety-five percent of every AI prompt is the same as the last one — the system prompt, the tools, the document the agent is reading. The model reprocesses…
What happens when the intelligence your AI agents depend on suddenly changes? In the age of Agentic AI, organizations are increasingly building workflows around frontier models for reasoning, planning, memory, orchestration, and decision-making. But what if…
What happens when the intelligence your AI agents depend on suddenly changes? In the age of Agentic AI, organizations are increasingly building workflows around frontier models for reasoning, planning, memory, orchestration, and decision-making. But what if…