AI Notkilleveryoneism

As Greg_Colbourn and Simeon_Cps explain, since FLI's Pause Letter and Yudkowsky's rebuttal, it's suddenly okay to talk about how

• Advanced AI is potentially dangerous
• Like, killing-all-humans dangerous
• Political oversight seems necessary
• This is a near-term concern; action is needed this term-in-office
• Basically it needs to be treated at least as seriously as nuclear weapons
• Maybe even with similar responses: International treaties, control of materials, facility inspections, etc.

So that's good.

Maybe it's even okay to talk about how very hard the problem is and how we're not really engaging with the hard parts of it yet, such that we may have to use social coordination to manage the problem for quite a long time before we find technical solutions?

It still feels weird to talk about the stakes being higher than merely killing all humans.

Hooray for progress.