Sony is escalating its emotion-aware gaming agenda with newly surfaced patent documents that detail plans for games that can genuinely understand and respond to your feelings in real time.
Building on its existing work in emotion-recognition technology, Sony's latest patent, titled "Player Selection System and Method", describes even more advanced systems that monitor player biometrics and behaviors to enable personalized, emotion-adaptive gameplay experiences.
For example, the PlayStation VR2 headset could leverage its advanced inside-out eye tracking, directly observing pupil dilation and eye movements. This emotional data can reveal reactions like anger, joy or surprise as players experience games.
The PS5 DualSense controller also enables emotion detection through its haptic sensors that analyze grip pressure and playstyle inputs. Signs of frustration may be inferred from aggressive button mashing behaviors, meanwhile mis-timed actions might indicate lapses in player focus and attention, or possibly boredom.
Sony also suggests that additional emotions may be inferred from certain gameplay actions. Recklessly destroying in-game environments could betray stress (or stress relief!), just as repeated quick saving or inability to progress forward might reflect anxiety and hesitation. Even dialogue choices and how players treat non-player characters can offer insight into their mindsets.