This GTA 5 Mod Adds Real-Time Voice Communication With Every NPC

GTA 5 modders have spent more than a decade turning Los Santos into increasingly strange versions of itself, but NPCTalk is one of the most interesting experiments. The project lets you walk up to any NPC, speak through your microphone, and get a voiced response back in real time.

The system comes from Universal Modder’s NPCTalk project, which was built first around GTA 5 but is designed as a toolkit that could eventually be adapted to other games too.

It’s not just poorly voiced dialogue either. You say something to an NPC, speech recognition transcribes it, an AI model generates a reply based on that character’s voice and the current situation, then a cloned voice speaks the response back. The NPCs can also act on what you say, so they can act and comment on the things you say and do.

In the developer’s GTA 5 example, Lamar can roast your clothes, police officers can respond to complaints, and Michael can defend his questionable fashion choices. Every line is generated live rather than pulled from any sort of fixed dialogue tree. The modder posted a showcase on X where they show the mod in action. Personally, I was fairly surprised at how far the technology has come and the quality seems a lot better than you might initially expect.

The underlying setup uses NVIDIA Nemotron for speech recognition, Qwen for dialogue generation, and Fish Audio for cloned voices. The developers claim responses can begin in around a second under ideal conditions, although the project documentation puts typical end-to-end latency closer to roughly 1.2 to 2.2 seconds.

We recently covered how The Finals is adding Dynamic Commentary, allowing its announcer Scotty to react to live match events and actually call players by their usernames. NPCTalk takes that same basic dream of more reactive game characters and pushes it much further, letting players initiate unscripted conversations for complete immersion.

There is one potential problem here, though.

Take-Two has previously taken action against a very similar GTA 5 project. In 2023, the creator of Sentient Streets said the publisher issued a DMCA takedown against the mod, which also allowed players to hold open-ended voice conversations with AI-powered NPCs. The old Nexus Mods showcase page still documents what that project was doing before its removal.

For now, NPCTalk itself is open source under an MIT license, while Universal Modder says a free playable GTA 5 implementation is coming separately.

Whether Take-Two leaves this one alone remains to be seen. But as a glimpse at what NPC interaction could eventually look like, being able to insult a random Los Santos pedestrian, hearing them insult you back and the exchange devolving into a street fight sounds pretty fun.

While you’re here, also check out the incredible Red Dead Redemption 2 mod that adds the Nemesis system and gang wars to the game.