01 What happened
Salesforce introduced Koa Decisions—a decision model on Google’s Gemma that routes requests in 26 ms, compared to 1.4 seconds for a general-purpose LLM.
02 Key details
- Koa Decisions uses Google’s Gemma to classify requests in milliseconds, supporting images and audio.
- Testing shows it processes requests in ~26 ms, a 50x improvement over a general-purpose LLM (~1.4 s).
- Free Trailhead demo available for all users to test the model.
- Planned integrations include Salesforce flows, Apex, prompt templates, and a developer API.
03 Why it matters
Koa Decisions accelerates decision-making for enterprise agents, reducing LLM overhead for quick choices and improving workflow efficiency.
04 Who it matters to
AI product developers, voice interface developers, organizations with frequent repeatable requests, enterprise AI customers and AI infrastructure engineers.
Original source