PlayStation Files Patent For AI Assist Feature That Can be Used When Players Get Stuck in Games

A new patent filed by Sony indicates that the company is exploring the concept of making use of AI technology to provide assistance for players that might get stuck in a game. The patent, which you can check out here, has been described in the filing as an AI Generated Ghost Player. The filing itself is full of diagrams that explain how this concept would work.

The patent describes “methods, systems, and devices for providing ghost assistance to a player during gameplay,” which will involve the creation of a “ghost character”. The AI powering this would be trained from quite a bit of training footage, and is described as being capable of identifying game scenarios and the various interactions players can have in these scenarios to then provide help for players. This “ghost character”, when triggered by the player, is able to show the player what they can do to get through the part of the game they are stuck in.

The level to which this ghost character can provide assistance is expected to be customisable, with there being options for limited assistance to more comprehensive walkthroughs. Examples provided range from the AI simply telling the player what they should do, to showcasing complex controller inputs required in some parts of gameplay, and even guiding the player on specific gameplay styles. Players are also expected to be able to ask for assistance from the ghost character through natural language.

“Some solutions have included the use of a character that a user can follow,” wrote Sony in the patent application. “However, the character is usually a graphic image or outlined image of a prior player that played the game and the user must follow the character watching the moves that occurred (including moves and interaction that is not relevant to the user’s current gameplay scenarios).”

“This is not, however, very useful for real-time assistance to a player that is encountering some difficulty with a specific scenario of gameplay or along the player’s specific gameplay path. This is because the character does not know specifically what the player is playing or the context of the user’s gameplay.”

While the idea of this AI-based guide sounds interesting on the surface, how it would be implemented in current-gen hardware would be another question altogether. The base PS5, for instance, doesn’t really have any internal hardware that would be necessary for processing things like this, like an NPU, unlike the PS5 Pro which has some AI capabilities to handle things like PSSR.

It is also likely that this patent might simply be giving us a picture of things to come. Sony will likely include some form of neural processing hardware in its next-gen systems, and an AI-based feature that helps players stuck in difficult parts of games could certainly end up being one of the bigger features that the company can advertise. However, this patent could also simply be Sony exploring an idea without concrete plans on using it just yet, as we see with patent applications quite often.