Show HN: Foreman, a self-hosted LLM gateway for cost aware model routing
dev_tools
According to Hacker News, Foreman is a self-hosted LLM gateway that intelligently routes requests between different language models based on cost. The tool lets teams use more economical models for straightforward tasks while reserving expensive APIs for complex requests.
Source: https://github.com/Northwood-Systems/foreman
Listen to this story
Hear this and more stories in a personalized audio briefing.
Open The Chonkerton