Jacob Coxon warns of human extinction and triggers a preference cascade

I agree that there seems to have been some sort of tipping point on public awareness and willingness to talk about risks. This week I’ve had three “normies” independently bring up AI related X-risk in conversations with me. Before this week I’m not sure that’s ever happened. (I generally avoid the topic because it doesn’t make for great small talk and don’t want to be the weirdo talking about the potential end of the world)

Here’s Zvi’s companion compilation of quotes on the topic from AI lab employees: https://thezvi.substack.com/p/the-extinction-risk-preference...

For example, Drake Thomas from Anthropic: “ I would burn my equity to the ground in a heartbeat for a 1% higher chance we make it out of this situation alive. I expect a great many of my colleagues across the industry would as well.

I promise you, we are actually just fucking scared, it’s not galaxy brained marketing.”