DEV Community

Cover image for Superalignment or Extinction – The Manhattan Project of Our Time
Dmitry K
Dmitry K

Posted on • Edited on • Originally published at iwooky.substack.com

1

Superalignment or Extinction – The Manhattan Project of Our Time

A 21st century Manhattan Project – is it our last line of defense against an AI apocalypse? What experts are saying about the future of AI?

– The AI arms race is accelerating, with predictions of a state-sponsored superintelligence project launching in the US by 2026-2028, regardless of who's in the White House

– The scale of investment required is staggering – potentially reaching $1 trillion per year by 2027, dwarfing historical precedents like the Manhattan and Apollo programs

– Automated AI research could lead to an "intelligence explosion," compressing years of progress into months and potentially achieving full superintelligence by 2030

– The challenge of superalignment – ensuring superintelligent AI/AGI aligns with human values, remains a critical and unsolved problem

– New players like Safe Superintelligence Inc. are emerging, focusing solely on creating secure superintelligence

– Some organizations, like MIRI, are calling for drastic measures such as a global "power switch" to halt AI development if critical risks emerge

👉 Read my full piece in here

Superalignment or Extinction – The Manhattan Project of Our Time

Sentry image

Hands-on debugging session: instrument, monitor, and fix

Join Lazar for a hands-on session where you’ll build it, break it, debug it, and fix it. You’ll set up Sentry, track errors, use Session Replay and Tracing, and leverage some good ol’ AI to find and fix issues fast.

RSVP here →

Top comments (0)

Billboard image

The Next Generation Developer Platform

Coherence is the first Platform-as-a-Service you can control. Unlike "black-box" platforms that are opinionated about the infra you can deploy, Coherence is powered by CNC, the open-source IaC framework, which offers limitless customization.

Learn more

👋 Kindness is contagious

Please leave a ❤️ or a friendly comment on this post if you found it helpful!

Okay