Anthropic pitches AI safety bill that may block a model if 50+ people could be killed
The proposed policy seems to offer protections against AI run amok but actually forbids federal agencies from blocking a model's release without the permission of a judge.
AI Summary
Anthropic has proposed a draft bill for AI safety that outlines conditions under which federal agencies could block the release of an AI model, specifically when there is a foreseeable risk of more than 50 deaths or over a billion dollars in damages. The bill suggests involving independent evaluators registered with the U.S. Commerce Department to assess potential risks, with safeguards to ensure evaluations are impartial despite the evaluators potentially being paid by AI labs. If a catastrophic risk is identified, evaluators would need to notify the Commerce Department within 72 hours.