Anthropic’s Threshold for AI Safety Intervention Raises Questions

As the push for AI regulation gathers pace, AI giant Anthropic has stepped up its efforts to shape a draft bill governing the industry, according to a report by Politico. The proposed legislation would allow the government to block the release of AI models it believes pose a danger to the public. However, the thresholds Anthropic has proposed for defining such risks have drawn fresh criticism over how the AI giant believes potentially dangerous models should be regulated.

As per the draft, “The bill would let the government block a model’s release or use only if it poses a foreseeable, imminent risk of more than $1 billion in damages, or of killing or seriously injuring more than 50 people,” Politico’s Owen Dahlkamp reported. This means that if a model were likely to kill or seriously injure fewer than 50 people, or cause less than $1 billion in property damage, the government would not be able to intervene under the proposed threshold.