A newly discovered Microsoft patent describes a cloud-based system that would allow an AI or another player to take over your session and complete difficult parts of a game for you. While Microsoft has previously explored coaching tools to give tips during gameplay, this latest discovery points to a much more direct form of help that could change how players handle those frustrating “game over” screens.
Getting stuck on a difficult boss or an impossible puzzle has always been a core part of the gaming experience, often forcing players to put down the controller in frustration. In the past, players relied on expensive tip hotlines or printed strategy guides to find their way through, while the present focus has shifted to community forums, massive walkthroughs on sites like GameFAQs, and video guides on YouTube. However, leaving the game to search for a solution can break immersion and slow down the fun, leading developers to look for integrated ways to keep players moving without requiring them to tab out or scrub through long videos.
Microsoft Survey Suggests Xbox Game Pass Could Be Getting AI Features
A new Microsoft survey suggests that Xbox Game Pass could be getting AI features in the future.
A New Way to Get Unstuck
At the center of this development is a newly published patent application titled “State management for video game help sessions.” According to the filing, the system is designed to offer a cloud-based help session right when a player starts to struggle. Instead of just showing a video of someone else playing, the system would take a snapshot of a player’s exact progress—what the patent calls a “help session starting state”—and load it into a cloud instance of the game. From there, a “helper” would step in and actually play through the difficult section, with their controller inputs being sent back to the player’s session in real-time.
The patent provides very specific examples of how this would work in practice. For example, in an adventure game where a player is having trouble finding a rare gem, the system would track their repeated failures and detect when they are getting frustrated. At that point, a large “HELP” button would appear on the screen, asking if the player wants assistance. If they say yes, a helper named “LuckySeven” might be assigned to take over. The helper then finds the gem while chatting with the player to explain how they did it. Once the task is finished, the system detects that the goal has been met and gives control back to the player.
One of the most interesting parts of this pitch is that the “helper” doesn’t necessarily have to be another person. While human help over the cloud is an option, Microsoft is also laying the groundwork for AI-powered helpers. These digital assistants could be trained on thousands of successful playthroughs from other people, allowing them to step in instantly without making the player wait for a human to become available. The patent even mentions using high-level machine learning models, like those seen in ChatGPT or Gemini, to manage these sessions and detect exactly when a player needs a hand.
Technically, the system uses complex machine learning frameworks to decide when to offer help. This includes things like “support vector machines” and “decision trees,” which essentially map out different scenarios to see if a player’s behavior, such as crashing into the same tree in a racing game five times, matches a pattern of frustration. By using these models, the game can tell the difference between someone who is enjoying a challenge and someone who is about to quit the game entirely.
When the help session is over, the player is given a choice: they can either accept the “updated state” where the helper has cleared the obstacle, or they can reject it and try to do it themselves using the knowledge they just gained. This ensures that players still have agency over their save file. The system could even include a rating system that lets players grade their helpers based on how useful they were in specific genres, such as adventure or racing games.
Similar moves have been made by other companies in the industry. Sony has also patented its own version of this tech, often called “Ghost Players.” However, while Sony’s version focuses on showing an AI-generated “ghost” that the player can follow, Microsoft’s approach seems more focused on cloud-based control and giving players the option of a real human helper. It’s a subtle difference, but it shows that the major console makers are all racing to solve the problem of player disengagement.
The patent comes at a time of major leadership changes at Xbox. Last month, Asha Sharma took over as CEO of Microsoft Gaming following the departures of leaders Phil Spencer and Sarah Bond. Sharma has been vocal about her stance on technology, stating that she will not allow the ecosystem to be flooded with “soulless AI slop.” While some might worry that AI playing games for users falls into that category, the patent was actually filed in 2024, well before Sharma took the lead. For now, it appears to be a concept that helps with accessibility rather than a replacement for human creativity.
As with all corporate filings, it is important to remember that a patent doesn’t guarantee a feature will ever be released. It is simply a way for a company to protect an idea. However, given the push for more accessible gaming and the rise of cloud technology, a feature that lets a “LuckySeven” AI take the wheel for a difficult boss fight might not be that far away.
