Tagged “routing”
2 reports on this topic. All publications →
-
The Cruise Missile and the Lasagne: How to Make AI Chatbots Greener by Right-Sizing the Model to the Question
Most questions people ask AI chatbots are easy — a lasagne recipe, an email draft, a word explained. Yet the industry default is to answer every question with the largest model available, the way one might sink a dinghy with a cruise missile. This report…
Read the report → -
Every Turn Ends in a Tool Call: Reliable Tool Use for Mid-Size Open Models via Two-Stage Forced Routing
Production assistants want many tools; mid-size open models want few. Operating a Mistral-based assistant with more than twenty tools, we catalogued what actually goes wrong as tool count grows: the model answers from its priors in prose before deciding to…
Read the report →