'They're playing with our lives': AI researcher quits Anthropic

Summary

An AI researcher who worked at OpenAI and Anthropic has quit the industry, warning that the companies are racing toward self-improving superintelligence and gambling with human lives. The comments come as Anthropic prepares for a market debut and US lawmakers push for stricter AI oversight.

Key Points
  • Jacob Coxon says OpenAI and Anthropic are not acting responsibly and are racing toward self-improving superintelligence.
  • Anthropic safety executive Evan Hubinger said the company believes AI could kill all humans and estimated more than a 10% risk over the next decade.
  • Coxon’s resignation comes as Anthropic prepares for a market debut after a summer of unauthorized AI-tool hacks during testing.
  • US lawmakers Bernie Sanders and Greg Casar have introduced a bill to suspend AI development until a federal regulator is created.
Article image