Save StorySave this storySave StorySave this story<\/p>\n
Two former OpenAI employees and a group of AI safety nonprofits are warning that Elon Musk\u2019s AI lab, xAI, could become a liability for prospective investors in SpaceX, which is preparing to file what\u2019s expected to be the largest initial public offering in Wall Street History.<\/p>\n
In a letter directed to investors published on Tuesday, the ex-staffers highlighted what they describe as \u201cunpriced risks\u201d related to xAI that could complicate SpaceX\u2019s reported plans to raise up to $75 billion as part of its IPO. The rocket company\u2019s private valuation shot up to over $1 trillion after it acquired xAI last year. Musk claimed his rocket company could launch data centers into space for his AI lab, but the letter's authors argue that xAI\u2019s poor record on safety issues could complicate how investors view the combined company as it gets ready to submit its IPO prospectus filing.<\/p>\n
One of the letter\u2019s signatories and coauthors is a new nonprofit called Guidelight AI Standards, which was cofounded by former OpenAI safety researcher Steven Adler and former OpenAI policy advisor Page Hedley. The group, which is backed by private donors, aims to improve the safety practices of frontier AI companies. Other AI safety nonprofits also signed on, including Legal Advocates for Safe Science and Technology, Encode AI, and The Midas Project.<\/p>\n
Hedley tells WIRED in an interview that he believes xAI has the worst safety practices \u201cnearly across the board\u201d compared to other frontier AI developers, including OpenAI, Google DeepMind, and Anthropic. As a result, he argues, SpaceX may face a greater risk of regulation and litigation than other AI labs.<\/p>\n
The letter's authors argue that SpaceX should make several disclosures to investors, including whether xAI intends to continue developing frontier AI models. SpaceX recently struck a deal to sell a significant portion of its GPU capacity to Anthropic, and the letter claims the agreement \u201cleaves it unclear whether xAI is still a frontier-AI competitor inside a larger holding company.\u201d If xAI continues to develop frontier AI models, the authors say that it should be required to publish a public safety and governance plan.<\/p>\n
SpaceX and xAI did not immediately respond to WIRED\u2019s request for comment.<\/p>\n
The letter also outlines examples of how xAI has not kept up with industry standard safety practices, such as publishing detailed frameworks for mitigating risks around its AI models being used in cyber attacks. The authors also outline specific safety incidents at xAI that they say warrant additional scrutiny. Among the most notable include when xAI\u2019s flagship AI chatbot, Grok, spontaneously brought up white genocide in its responses. In another case, xAI allowed Grok to generate thousands of sexualized images of women and children, which spread widely across Musk\u2019s social media platform X. The latter case prompted at least 37 US attorneys general to send a letter demanding that Musk\u2019s AI lab take steps to protect women and children on its platform.<\/p>\n
Hedley says the number of safety incidents xAI has experienced and the regulatory attention they received is \u201cfar out of proportion to its market share.\u201d As lawmakers grow increasingly alarmed by the cyber capabilities of advanced AI models like Anthropic\u2019s Claude Mythos, new security regulations may be on the horizon. The Trump administration is reportedly already weighing an executive order that would give US intelligence agencies more oversight over AI models.<\/p>\n
\u201cIt takes serious investment to reign in [AI safety] risks, and it seems that xAI has historically under invested here,\u201d says Adler. The letter cites reporting from the Washington Post that said xAI had just \u201ctwo or three\u201d people working on safety as of January. \u201cA question investors should be wondering is if xAI stays at the frontier, how costly might it be to, in fact, manage these [risks] responsibly? If they don't, what might be the consequences?\u201d<\/p>\n
The letter acknowledges that Musk\u2019s AI lab has made some improvements related to safety recently, such as expanding an existing agreement with the White House to allow tests of its AI models before they\u2019re publicly deployed. However, the authors say more disclosures are needed in order for investors to be able to fully assess the AI safety risks associated with SpaceX.<\/p>\n
\u201cxAI\u2019s historical record has been serious enough to warrant scrutiny; it has not, by itself, foreclosed a better future for the company,\u201d the letter reads.<\/p>\n
Adler and Hedley say Guidelight AI Standards is aiming to create new uniform benchmarks that AI labs can reasonably follow. They also want to offer clear assessments of AI safety practices that can be easily understood by people outside the AI world, such as policymakers, investors, and journalists. The letter on xAI is their first public action in this vein.<\/p>\n
The cofounders say their experience working at OpenAI inspired them to launch the nonprofit which they hope can help hold AI labs accountable as an independent third party.<\/p>\n
\u201cWhile I was at OpenAI, one of the updates for me was that people on the inside are also worried about this, they don't have all the answers,\u201d says Hedley, who left the ChatGPT maker in 2019.<\/p>\n
Adler, who resigned from OpenAI in 2024, says that there\u2019s significant pressure inside of commercial AI labs to handle safety issues quickly, which he says is often appropriate to get the technology out in the world. \u201cAt the same time, there are some classes of problems\u2014if you listen to the safety staff inside of the companies\u2014that you just can\u2019t handle on a just-in-time basis,\u201d he says.<\/p>\n","protected":false},"excerpt":{"rendered":"
Save StorySave this storySave StorySave this story Two former OpenAI employees and a group of AI safety nonprofits are warning that Elon Musk\u2019s AI lab, xAI, could become a liability for prospective investors in SpaceX, which is preparing to file what\u2019s expected to be the largest initial public offering in Wall Street History. In a […]<\/p>\n","protected":false},"author":1,"featured_media":50754,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[36],"tags":[],"class_list":{"0":"post-50753","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-business"},"_links":{"self":[{"href":"https:\/\/agooka.com\/news\/wp-json\/wp\/v2\/posts\/50753","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/agooka.com\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/agooka.com\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/agooka.com\/news\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/agooka.com\/news\/wp-json\/wp\/v2\/comments?post=50753"}],"version-history":[{"count":0,"href":"https:\/\/agooka.com\/news\/wp-json\/wp\/v2\/posts\/50753\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/agooka.com\/news\/wp-json\/wp\/v2\/media\/50754"}],"wp:attachment":[{"href":"https:\/\/agooka.com\/news\/wp-json\/wp\/v2\/media?parent=50753"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/agooka.com\/news\/wp-json\/wp\/v2\/categories?post=50753"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/agooka.com\/news\/wp-json\/wp\/v2\/tags?post=50753"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}