The Chonkerton

Show HN: Foreman, a self-hosted LLM gateway for cost aware model routing

dev_tools

According to Hacker News, Foreman is a self-hosted LLM gateway that intelligently routes requests between different language models based on cost. The tool lets teams use more economical models for straightforward tasks while reserving expensive APIs for complex requests.

Source: https://github.com/Northwood-Systems/foreman

Listen to this story

Hear this and more stories in a personalized audio briefing.

Open The Chonkerton