Sony’s New AI Controller Patent Could Help Players With Physical Limitations

A Sony patent describes an AI-assisted controller system that could help players with disabilities or physical movement limitations complete difficult controller inputs.

Sony has explored unusual controller ideas before, including a PlayStation controller patent that could let users tap a phone or card to make payments. Its latest accessibility-focused concept could have a much more practical use.

The recently published Sony patent describes AI that can compensate when players struggle to press buttons, move joysticks, pull triggers, or operate other controller inputs.

AI could predict what a player intended to do

The system could analyze input timing, button press duration, movement patterns, accessibility information, and the current game context.

Using that information, the AI could determine what action the player likely intended and complete or adjust the input accordingly.

Sony also describes different levels of assistance based on the user, controller, and specific game. The system could learn from previous inputs and gameplay history, allowing it to adapt as it better understands a player’s habits and physical limitations.

That would make the approach different from traditional controller remapping, which generally replaces one fixed input with another instead of adapting dynamically during gameplay.

Sony could run the AI locally or in the cloud

The patent says the AI model could run locally on a player’s device or rely on cloud-based processing.

Sony also considers multiplayer situations. Games could automatically or manually disable AI assistance, while other players could potentially see an indicator showing when someone has the feature enabled.

Interestingly, Sony describes the technology as controller-agnostic. That means the system could theoretically generate suitable outputs for different controller hardware rather than working exclusively with PlayStation devices.

As always, a patent does not guarantee Sony will turn the idea into a commercial product.

Sony is not the only gaming company exploring unusual patented systems. A recent Microsoft patent could bring ad breaks directly into gameplay, while Sony is working on a patent that will use AI to fix the console.

Via Insider Gaming