Leaked Video Reveals Sony Is Working On AI-Powered Versions Of PlayStation Characters, Starting With Aloy
Reported by The Verge, a video narrated by Sony Interactive Entertainment’s director of software engineering working on video game technology, AI, computer vision and face technology, Sharwin Raghoebardajal, reveals that Sony is working on AI-powered versions of its PlayStation characters, beginning with Horizon’s Aloy.
The video has now been removed from YouTube, but PSU and plenty of others across the internet were able to watch it before it could be taken down.
In the video, Raghoebardajal explains that the audio and face animation is powered by Sony’s internal Mockingbird technology, while also using OpenAI’s whisper tech along with GPT-4 and Llama 3 for continuing conversations.
The demo itself is running on a PC, but Raghoebardajal does say that Sony is experimenting with running it on consumer hardware such as the PS5.
It’s not exactly clear yet as to what Sony intends to do with this technology, as even Raghoebardajal says there are questions regarding whether or not players would even want a function like this in a game. But it does clearly show how Sony is continuing to experiment with AI and specifically generative AI aspects.
Source – [The Verge]
