A seasoned safety researcher at Anthropic has sparked internal alarm after resigning from the artificial intelligence giant with a stark warning to his colleagues. In a series of messages posted to the company’s Slack channels, Jacob Coxon cautioned that the pursuit of superintelligent AI could lead to catastrophic outcomes if current trajectories remain unchanged. He specifically warned that without a significant increase in caution and global cooperation, these advanced systems pose a legitimate risk of causing human extinction.
The timing of Coxon’s departure is particularly sensitive as Anthropic navigates a pivotal financial chapter. The company is currently preparing for an initial public offering that market analysts believe could propel its valuation beyond the one trillion dollar mark. This tension between rapid commercial scaling and rigorous safety protocols has become a recurring theme within the industry, but few warnings have been as direct or as dire as those delivered by a member of their own specialized safety team.
While Anthropic has positioned itself as a safety conscious alternative to other major players in the field, this public fracture suggests deep seated anxieties among those tasked with guarding against existential risks. By airing his concerns through an internal messaging platform before exiting, Coxon highlighted a growing friction between the corporate drive toward massive valuations and the scientific necessity of slowing down to ensure humanity can control what it creates.