OpenAI sets up safety committee as it starts training new model
Committee will be responsible for making recommendations on safety and security decisions
28 May 2024 - 17:02
byMuhammad Tasim Zahid
Support our award-winning journalism. The Premium package (digital only) is R30 for the first month and thereafter you pay R129 p/m now ad-free for all subscribers.
OpenAI has formed a safety and security committee that will be led by board members, including CEO Sam Altman, as it begins training its next artificial intelligence model, the AI start-up says.
Directors Bret Taylor, Adam D’Angelo and Nicole Seligman will also lead the committee, OpenAI said on a company blog.
Microsoft-backed OpenAI’s chatbots with generative AI capabilities, such as engaging in human-like conversations and creating images based on text prompts, have stirred safety concerns as AI models become powerful.
Former chief scientist Ilya Sutskever and Jan Leike, who were leaders of OpenAI’s Superalignment team, which ensured AI stays aligned to the intended objectives, left the firm earlier this month.
OpenAI had disbanded the Superalignment team earlier in May, less than a year after the company created it, with some team members being reassigned to other groups, CNBC reported days after the high-profile departures.
The new committee will be responsible for making recommendations to the board on safety and security decisions for OpenAI’s projects and operations. Its first task will be to evaluate and further develop OpenAI’s existing safety practices over the next 90 days, after which it will share recommendations with the board.
After the board’s review, OpenAI would publicly share an update on adopted recommendations, the company said.
Others on the committee include newly appointed chief scientist Jakub Pachocki and Matt Knight, head of security.
The company will consult other experts, including Rob Joyce, a former US national security agency cybersecurity director and John Carlin, a former department of justice official.
OpenAI did not provide further details on the new “frontier” model it is training, except that it would bring its systems to the “next level of capabilities on our path to AGI”.
Earlier in May, it announced a new AI model capable of realistic voice conversation and interaction across text and images.
Support our award-winning journalism. The Premium package (digital only) is R30 for the first month and thereafter you pay R129 p/m now ad-free for all subscribers.
OpenAI sets up safety committee as it starts training new model
Committee will be responsible for making recommendations on safety and security decisions
OpenAI has formed a safety and security committee that will be led by board members, including CEO Sam Altman, as it begins training its next artificial intelligence model, the AI start-up says.
Directors Bret Taylor, Adam D’Angelo and Nicole Seligman will also lead the committee, OpenAI said on a company blog.
Microsoft-backed OpenAI’s chatbots with generative AI capabilities, such as engaging in human-like conversations and creating images based on text prompts, have stirred safety concerns as AI models become powerful.
Former chief scientist Ilya Sutskever and Jan Leike, who were leaders of OpenAI’s Superalignment team, which ensured AI stays aligned to the intended objectives, left the firm earlier this month.
OpenAI had disbanded the Superalignment team earlier in May, less than a year after the company created it, with some team members being reassigned to other groups, CNBC reported days after the high-profile departures.
The new committee will be responsible for making recommendations to the board on safety and security decisions for OpenAI’s projects and operations. Its first task will be to evaluate and further develop OpenAI’s existing safety practices over the next 90 days, after which it will share recommendations with the board.
After the board’s review, OpenAI would publicly share an update on adopted recommendations, the company said.
Others on the committee include newly appointed chief scientist Jakub Pachocki and Matt Knight, head of security.
The company will consult other experts, including Rob Joyce, a former US national security agency cybersecurity director and John Carlin, a former department of justice official.
OpenAI did not provide further details on the new “frontier” model it is training, except that it would bring its systems to the “next level of capabilities on our path to AGI”.
Earlier in May, it announced a new AI model capable of realistic voice conversation and interaction across text and images.
Reuters
Would you like to comment on this article?
Sign up (it's quick and free) or sign in now.
Please read our Comment Policy before commenting.
Most Read
Published by Arena Holdings and distributed with the Financial Mail on the last Thursday of every month except December and January.