Concerns over AI technology escaping human control are growing daily. To preemptively manage threats from advanced AI systems, two global superpowers—the United States and China—began important discussions in New York on September 20. The meeting, led by US Treasury Secretary Scott Bessent and Chinese Vice Premier He Lifeng, also serves as preparation for an upcoming summit between President Donald Trump and Xi Jinping.
At the discussions, besides AI issues, matters concerning trade and critical mineral resources are being thoroughly discussed. Beyond autonomous AI systems that operate without human oversight, the emergence of self-improving AI—systems capable of enhancing other AI systems—prompted the United States to open channels for cooperation with China on AI security frameworks, according to Treasury Secretary Bessent.
To prevent worst-case scenarios, experts from both nations have issued important recommendations. Key measures include keeping critical cyber operations and nuclear weapons systems under human control rather than AI, and establishing a special hotline for immediate communication if AI-related emergencies arise. While no binding agreement has been reached on banning self-improving AI systems for now, both countries continue seeking solutions through broader negotiations.
Ref: Technology Innovation
