Sony is experimenting with AI-driven versions of PlayStation characters, starting with a prototype of Aloy, the main character from Horizon Forbidden West.
According to The Verge, an internal video shared by an anonymous tipster showcases Aloy responding to voice prompts in real time with AI-generated speech and facial animations.
Sony Interactive Entertainment developed the prototype in partnership with Guerrilla Games, and Sharwin Raghoebardajal, Director of Software Engineering, demonstrated it. He explained that the demo uses OpenAI’s Whisper for speech-to-text, GPT-4 and Llama 3 for dialogue and decision-making, and Sony’s in-house tools like Emotional Voice Synthesis (EVS) for voice generation and Mockingbird for audio-to-face animation.
While the demo ran on PC, Raghoebardajal revealed Sony has also tested the technology on PlayStation 5 hardware with minimal performance impact. The company first developed a basic version a year ago and presented a more advanced build at its internal Sony Technology Exchange Fair (STEF) in Tokyo last November.
Sony has not announced any public plans to release AI-powered characters, and this Aloy demo was intended as an internal proof-of-concept. However, the project raises questions about AI’s role in gaming—particularly since players control Aloy in the actual game. The use of AI could blur the line between character and player and raise concerns over the future of voice acting, storytelling, and game design jobs.
This development follows similar efforts by Nvidia and Microsoft, both of which are building AI tools for NPCs and game prototyping. With GDC 2025 approaching, Sony’s quiet move into AI-powered game characters is likely to intensify the ongoing conversation about AI’s place in the future of game development.
