At OpenAI’s New AI Startup, Sutskever was integral to the company’s efforts to improve AI safety with the rise of “superintelligent” AI systems, an area he worked on alongside Jan Leike, who co-led OpenAI’s Superalignment team. Yet both Sutskever and then Leike left the company in May after a dramatic falling out with leadership at OpenAI over how to approach AI safety. Leike now heads a team at rival AI shop Anthropic.
Sutskever has been shining a light on the thornier aspects of AI safety for a long time now. In a blog post published in 2023, Sutskever, writing with Leike, predicted that AI with intelligence superior to humans could arrive within the decade—and that when it does. it won’t necessarily be benevolent, necessitating research into ways to control and restrict it.
We plan to advance capabilities as fast as possible while making sure our safety always remains ahead. This way, we can scale in peace. Our singular focus means no distraction by management overhead or product cycles, and our business model means safety, security, and progress are all insulated from short-term commercial pressures.” said the announcement on X. Superintelligence Inc is based out of the US, with offices in Palo Alto and Tel Aviv. “We have deep roots and the ability to recruit top technical talent,” the announcement said.
“Our singular focus means no distraction by management overhead or product cycles, and our business model means safety, security, and progress are all insulated from short-term commercial pressures,” the post says.
Sutskever is joined as by former OpenAI researcher Daniel Levy and Daniel Gross, co-founder of Cue and a former AI lead at Apple as co-founders of Safe Superintelligence.
Sutskever left Microsoft-backed OpenAI in May after playing a key role in CEO Sam Altman’s dramatic firing and rehiring in November last year. Sutskever was removed from the company’s board after Altman returned.
In his announcement, Sutskever mentioned the company’s focus to safety and security in AI development. Stressing that the singular focus of Safe Superintelligence allows it to avoid distractions from management overhead or product cycles. He further noted that their business model is designed to insulate safety, security, and progress from short-term commercial pressures, ensuring a steadfast dedication to their goals.
Sutskever’s departure from OpenAI’s New AI Startup in May followed significant involvement in the dramatic events surrounding. The firing and rehiring of CEO Sam Altman in November of the previous year. After Altman’s return, Sutskever was removed from the company’s board, paving the way for his new endeavor with Safe Superintelligence.
