'AI routing' startups are betting they can help companies grappling with token costs
Venture funds boost AI routing startups like OpenRouter and Concentrate AI as they help companies avoid token panic.
??????? #routing
4 headlines
Stochastic KV Routing: Enabling Adaptive Depth-Wise Cache Sharing
1 points, 0 comments on Hacker News
Model routing is a fix for AI overspending, a problem for OpenAI and Anthropic
3 points, 0 comments on Hacker News
Trace-Based Adaptive Cost-Efficient Routing
2 points, 1 comments on Hacker News