The Chonkerton

Should we combine protocols for AI Control Research?

ai

According to a new paper on LessWrong, AI safety researchers are tackling a core deployment challenge: the tension between building useful AI systems and keeping them safe. Different safety protocols offer different tradeoffs—some prioritize safety at the cost of performance, others boost performance but accept more risk. The question: can labs achieve both? The answer is yes, according to this research. By combining multiple protocols and routing requests between them based on predicted safety and usefulness, labs can achieve better overall tradeoffs than sticking with any single approach. But here's the harder problem: an AI system that understands the routing logic could strategically attack whichever protocol is weakest. The researchers show how to allocate human auditing budgets to shore up weak spots, making it much harder for attack strategies to succeed. The bottom line: intelligent protocol combination can deliver strong safety-usefulness tradeoffs that no single approach alone could match.

Source: https://www.lesswrong.com/posts/BsNF64ELiwJeoCJSD/should-...

Listen to this story

Hear this and more stories in a personalized audio briefing.

Open The Chonkerton