You can be on Entrepreneur’s cover!

OpenAI Introduces New Governance Model for AI Safety Oversight Led by Aleksander Madry, a new team evaluates potential risks in unreleased AI models, focusing on cybersecurity threats and other dangers.

By Maxwell William

Key Takeaways

  • OpenAI's board can veto AI model releases, regardless of leadership approval.
  • A new safety approach includes teams for current products, advanced models, and potential risks from future powerful AI systems.
entrepreneur daily

This story originally appeared on

This story originally appeared on

OpenAI has introduced a new governance structure that grants its board the authority to withhold the release of AI models, even if company leadership has deemed them safe, according to a recent Bloomberg report. The decision, detailed in recently published guidelines, comes after a tumultuous period at OpenAI, including the temporary ousting of CEO Sam Altman. This event highlighted the delicate balance of power between the company's directors and its executive team.

OpenAI's newly formed "preparedness" team, led by Aleksander Madry of MIT, is tasked with continuously assessing the company's AI systems. The team will focus on identifying and mitigating potential cybersecurity threats and risks related to chemical, nuclear, and biological dangers. OpenAI defines "catastrophic" risks as those capable of causing extensive economic damage or significant harm to individuals.

Madry's team will provide monthly reports to an internal safety advisory group, which will then offer recommendations to Altman and the board. While the leadership team can decide on the release of new AI systems based on these reports, the board retains the final say, potentially overruling any decision made by the company's executives.

OpenAI's three-tiered approach to AI safety

OpenAI's approach to AI safety is structured around three distinct teams:

  1. Safety Systems: This team focuses on current products like GPT-4, ensuring they meet safety standards.
  2. Preparedness: The new team led by Madry evaluates unreleased, advanced AI models for potential risks.
  3. Superalignment: Led by Ilya Sutskever, the Superalignment team will concentrate on future, hypothetical AI systems that could possess immense power.

Each team plays a crucial role in assessing different aspects of AI safety, from existing products to future developments.

The preparedness team will rate AI models as "low," "medium," "high," or "critical" based on perceived risks. OpenAI plans to release only those models rated as "medium" or "low." The team will also implement changes to reduce identified dangers and evaluate the effectiveness of these modifications.

Madry expressed his hope to Bloomberg that other companies will adopt OpenAI's guidelines for their AI models. These guidelines formalize processes that OpenAI has previously used in evaluating and releasing AI technology. Madry emphasized the proactive role in shaping AI's impact: "AI is not something that just happens to us that might be good or bad. It's something we're shaping."

Want to be an Entrepreneur Leadership Network contributor? Apply now to join.

Side Hustle

This Dad Started a Side Hustle to Save for His Daughter's College Fund — Then It Earned $1 Million and Caught Apple's Attention

In 2015, Greg Kerr, now owner of Alchemy Merch, was working as musician when he noticed a lucrative opportunity.

Business News

This One Word Is a Giveaway That You Used ChatGPT to Write an Email, According to an Expert

"Delve" has increased its presence in written work since ChatGPT entered the scene.

Business News

Yes, You Can Buy a Foldable Tiny Home on Amazon — And Now It's Selling for Less Than $12,000

The waterproof and flameproof house was listed around $35,000 a few months ago.

Side Hustle

This Insurance Agent Started a Side Hustle Inspired By Nostalgia for His Home State — Now It Earns Nearly $40,000 a Month

After moving to New York City, Danny Trejo started a business to stay in touch with his roots — literally.

Starting a Business

4 Common Mistakes That Will Spell Doom Your Ecommerce Business

It's hard to spot a success story before it happens, yet it's easy to tell if a business will struggle. With that in mind, here are the four most common mistakes people make that you should avoid when starting an ecommerce business.

Business Ideas

63 Small Business Ideas to Start in 2024

We put together a list of the best, most profitable small business ideas for entrepreneurs to pursue in 2024.