Microsoft will soon let Copilot Labs testers try out its new gaming AI technology.
Days ago, Microsoft made waves by announcing its first generative AI toolset for video games. It’s called Muse, and it can generate actual gameplay sequences from user input (albeit at very low frame rates, around 10FPS or thereabouts). Theoretically, you can just hook up a controller and start pressing buttons and moving the joysticks, and Muse will generate, on-the-fly, video sequence footage based on your commands.
Soon the tech will be available for experimental runs on Copilot Labs, which is Microsoft’s digital testing bed for new AI-oriented software and features. There’s not an exact timeline on when you’ll be able to try out Muse for yourself, and the games are meant to be short and smaller-scale slivers of experiences, potentially akin to mini-games, maybe like something you’d find in Fusion Frenzy.
Game developers–those that haven’t been laid off in the extended bloodbath that was 2023 and 2024–appear to have mixed feelings about AI and Muse, and Microsoft allows developers to choose whether or not to use gen AI in their projects.
Here’s what Microsoft said about Muse’s integration into Copilot Labs:
A new series of AI experiences where Copilot becomes the game. These brief, interactive adventures allow you to engage with immersive worlds using your Xbox controller or keyboard, while Copilot generates the game pixels in real-time as you play.
Gaming is coming to Microsoft Copilot! Microsoft Research and Xbox have partnered to develop Muse, a groundbreaking generative AI model and the first-of-its-kind WHAM (World and Human Action Model). Muse deeply understands 3D game worlds, game physics, and player interactions. This innovative artificial intelligence technology marks a significant leap in gaming AI and machine learning applications within the gaming industry.
Coming soon to Copilot Labs, Copilot will use Muse to power new immersive AI gaming experiences. You’ll be able to use your Xbox controller or keyboard to explore short, interactive adventures, with Copilot generating the game environment around you as you play. This fusion of AI innovation and gaming technology promises a next-gen gaming experience like no other.
We’re in the early stages of experimenting with Copilot and Muse for gaming, so join us on Discord to be among the first to know about the latest AI innovations from Copilot Labs and Xbox. Be part of our growing AI community and stay updated on this exciting journey in game development and AI-powered gaming.
VIEW GALLERY – 2 IMAGES
