Save StorySave this storySave StorySave this story<\/p>\n
The video game Valorant, a fast-paced team-based shooter, has recently become a testing ground for a promising new direction in artificial intelligence research. The game\u2019s developers at Riot Games (a Tencent subsidiary) are using 3D-native AI models to prototype new characters, scenes, and storylines, according to a researcher familiar with the company\u2019s efforts who spoke on the condition of anonymity.<\/p>\n
While many AI models can generate text, images, and video, Tencent\u2019s Hunyuan (\u6df7\u5143 or \u201cfirst mix\u201d) family of models can dream up 3D objects and interactive scenes. The source says that Tencent\u2019s models are also being used by the developers of another Tencent game, GKART, and by some independent developers, too. Tencent declined to comment.<\/p>\n
\u201cThe games industry requires a lot of investment,\u201d the source says. \u201cPreviously you would need a month to design a character. Now you can just type in some text, and Hunyuan can give you four choices in 60 seconds.\u201d<\/p>\n
The news is an early signal that models capable of understanding and re-creating the physical world could become a standard ingredient in game design. In addition to generating game content, these models could also enable more advanced virtual and augmented reality and help robots learn to do new things.<\/p>\n
\u201cThere\u2019s a real explosion of 3D vision research nowadays,\u201d says Alexander Raistrick, a graduate student at Princeton University working on novel approaches to generating 3D content. \u201cThere are many killer applications: There's content creation, there\u2019s self driving, and there\u2019s a whole stack of problems involved in augmented reality.\u201d<\/p>\n
Raistrick adds that video games are an obvious application for 3D AI models. \u201cOutputting 3D meshes [a standard way of representing 3D objects] is your typical kind of bread and butter of game development,\u201d he says.<\/p>\n
But, as in other creative fields, using AI to create video games is controversial. Concerns about AI-fueled job loss loom large. Some developers say games should be labeled when they contain AI-made content. Others say it\u2019s too late: The technology is already ubiquitous in the industry.<\/p>\n
Tencent released HunyuanWorld 1.0, a model that generates interactive scenes, in July. I tested it a few months back, exploring a scene that looked like it was part of a Lego movie\u2014a valley of brightly colored blocks disappearing into the distance. More recently, I\u2019ve been playing with a more basic model, Hunyuan 3D, which can conjure up 3D objects. I used it to generate some very nice custom Dungeons & Dragons characters to 3D print. In October, Tencent released a new version of HunyuanWorld that lets users upload video to generate 3D scenes.<\/p>\n
Tencent\u2019s Hunyuan models point to a broader shift happening in AI research. Many experts believe that AI models will need a deeper understanding of the physical world to advance. Because of this, Tencent is far from alone in building 3D-native AI models. Microsoft, Meta, Stability AI, and Bytedance all offer 3D models, but Hunyuan sits at the top of one leaderboard designed to rank such tools.<\/p>\n
A number of startups are doing interesting work in this space, too. World Labs, founded by Fei-Fei Li, a Stanford computer scientist who played a key role in building modern AI, has developed a tool called Marble that produces fully consistent and persistent 3D scenes. This could be useful for generating games on the fly or producing reliable training data for robots.<\/p>\n
3D AI is also an exciting area for academic research. A Stanford University project called 3D Generalist used an LLM to decide how to modify scenes with new objects. Raistrick, the graduate student at Princeton, is developing a way of generating 3D scenes using code, an approach that makes it possible for LLMs to generate and interact with scenes in a more powerful way. And projects like Google DeepMind\u2019s SIMA 2 show how AI agents could interact with virtual worlds to create new forms of gameplay.<\/p>\n
As 3D-capable AI becomes more important, Tencent may emerge as an increasingly important player among a host of Chinese AI firms clamoring to win in this space. Besides producing some of the world\u2019s most popular video games and movies, it operates WeChat, a chat app with a wide range of other functions, that is ubiquitous in China. Tencent also has its own chatbot, called YuanBao, which is integrated into WeChat. But Tencent\u2019s video game skills may give it a distinct edge in an increasingly 3D AI world.<\/p>\n
This is an edition of<\/em> Will Knight\u2019s<\/strong><\/em><\/a> AI Lab newsletter<\/strong><\/a>. Read previous newsletters<\/em> here.<\/strong><\/em><\/a><\/p>\n","protected":false},"excerpt":{"rendered":" Save StorySave this storySave StorySave this story The video game Valorant, a fast-paced team-based shooter, has recently become a testing ground for a promising new direction in artificial intelligence research. The game\u2019s developers at Riot Games (a Tencent subsidiary) are using 3D-native AI models to prototype new characters, scenes, and storylines, according to a researcher […]<\/p>\n","protected":false},"author":1,"featured_media":40036,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[36],"tags":[],"class_list":{"0":"post-40035","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-business"},"_links":{"self":[{"href":"https:\/\/agooka.com\/news\/wp-json\/wp\/v2\/posts\/40035","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/agooka.com\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/agooka.com\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/agooka.com\/news\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/agooka.com\/news\/wp-json\/wp\/v2\/comments?post=40035"}],"version-history":[{"count":0,"href":"https:\/\/agooka.com\/news\/wp-json\/wp\/v2\/posts\/40035\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/agooka.com\/news\/wp-json\/wp\/v2\/media\/40036"}],"wp:attachment":[{"href":"https:\/\/agooka.com\/news\/wp-json\/wp\/v2\/media?parent=40035"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/agooka.com\/news\/wp-json\/wp\/v2\/categories?post=40035"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/agooka.com\/news\/wp-json\/wp\/v2\/tags?post=40035"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}