New
articleMigrating a 20-Year WordPress Blog to Be Agent-Readytechnology bytesAGI Has Arrived. Now Give It a Simpler Problem.podcastEpisode 100: The Next Era of AI — From Agents to Enterprise IntelligencearticleMigrating a 20-Year WordPress Blog to Be Agent-Readytechnology bytesAGI Has Arrived. Now Give It a Simpler Problem.podcastEpisode 100: The Next Era of AI — From Agents to Enterprise Intelligence
Navveen Balani Making systems intelligent, efficient & responsible

Day 17 of Green, Efficient AI is live — The Invisible Payload.

Read on LinkedIn View as markdown

Day 17 of Green, Efficient AI is live — The Invisible Payload.

A user asks a support agent to reset their password — seven words, roughly ten tokens. The trace shows the model actually receives thousands of tokens. A system prompt written months ago. Every tool schema in the catalog, whether the tool is needed or not. Few-shot examples fixing behaviours long since stabilised. Formatting rules. Safety framing. The user’s question is at the bottom.

The prompt the model reads is not the prompt the user wrote. And the difference between the two is what shows up on the bill.

Four rungs inside: Inventory, Trim, Split, Amortise.

Read the full issue in today’s edition

Green Software Foundation #greenai #efficentai #aieconomics #leanagenticai

green softwareai economicsagentic ai