Introducing Hy4 Preview

On Saturday, Simon Willison's Weblog reports that Tencent has released Hy4 Preview, a new open-weight language model. The model boasts seven hundred seventy billion total parameters, forty-nine billion active, and a one million token context window — a major step up from the previous Hy3, which had two hundred ninety-five billion parameters. Willison tested the model's reasoning, which offers just two settings, high and no-think, and found its hidden reasoning trace uses truncated English. The model is available on Hugging Face, taking up one point five six terabytes.

Listen to this story

Hear this and more stories in a personalized audio briefing.

Open The Chonkerton