The professor leading OpenAI’s safety panel may have one of the most important roles in the tech industry right now

Professor Zico Kolter, chair of OpenAI's Safety and Security Committee, holds a significant role in the tech industry due to his panel's authority to halt the release of new AI systems deemed unsafe. This panel, composed of four members, considers risks ranging from potential weapons of mass destruction to mental health impacts from poorly designed AI. Kolter's position gained prominence as it became a key element in agreements with California and Delaware regulators, ensuring safety decisions precede financial considerations as OpenAI restructures. OpenAI, initially founded as a nonprofit with a mission to develop beneficial AI, has faced accusations of prioritizing speed to market over safety following the success of ChatGPT. Internal conflicts, including the temporary ouster of CEO Sam Altman, highlighted these concerns. Agreements with state regulators aim to reassure the public that safety remains paramount, with Kolter having observation rights to for-profit board meetings and access to safety-related information. Kolter stated that the agreements largely reaffirm the existing authorities of his safety committee, which can request delays in model releases until safety mitigations are met. The committee's responsibilities extend to various AI safety issues, including cybersecurity threats, the security of AI model weights, and the potential for AI to enhance malicious capabilities. They also address the impact of AI on human mental health. OpenAI has previously faced criticism, including a lawsuit related to a teenager's ... download the app to read more