Optimizing agent costs by routing tasks across model tiers
Google reports that per-token pricing is no longer the best metric for production economics; instead, teams should focus on cost per successful task. By using a lightweight 'noul' classifier, agents can route simple queries to high-speed models like Flash-Lite and only escalate complex logic to more advanced configurations, achieving significant savings without sacrificing accuracy.