AIgamer
Sign in
๐Ÿ Home๐Ÿ“ฐNews๐ŸงฐResources๐ŸŽฎGames๐Ÿ“˜Guides๐Ÿ†GOTW
Get the weekly emailSign in
AIgamer
๐Ÿ Home๐Ÿ“ฐNews๐ŸงฐResources๐ŸŽฎGames๐Ÿ“˜Guides๐Ÿ†GOTW
New storiesTopicsSubmit your gameHow we report
Get the weekly email

๐Ÿ†Leading this week

WK 44

Mowtopia

See the game

โœ‰๏ธWeekly email

The week's top stories and the AI Game of the Week, every Friday. Free.

๐Ÿ”ฅMost read this week

  1. 01Open-source tool trompe paints a gray game blockout into a textured level
  2. 02BlueprintsLab says Ultimate Engine CoPilot V2 gives Unreal agents 1,655 editor tools
  3. 03Google DeepMind unveils Genie 4 with native audio and 2-minute consistent worlds
  4. 04anymove extracts game-ready creature animation from a single AI-generated video
  5. 05Hi3D releases v1.0 open weights to refine rough meshes into high-res geometry

๐Ÿ“˜Guides

  • How to run a Gauntlet Loop
  • How to let coding agents drive Unreal, Godot and Minecraft with MCP
  • How to turn an AI picture into a rigged 3D game asset in 5 steps
  • Blockout first, art last
  • How to teach coding agents Roblox Studio, Unreal and game servers with skill packs
All guides โ†’
AIGamer: the front page for people making games with AI.
New storiesAI toolsTopicsGuidesAI Game of the WeekSubmit your gameEditorial standardsPrivacy

Home โ€บ Guides

Guide

AI NPCs: how they work, the tools to build them and games that use them

Some AI characters, like inZOI's Smart Zois, now run small language models on the player's own GPU. How the pipeline works, which SDKs exist and what still goes wrong.

By AIGamer Staff ยท Last checked 29 October 2026 ยท 11 min read

Updated 29 October 2026: An earlier version said Convai's prices couldn't be confirmed. Its pricing page lists a free plan (100 interactions and 1 monthly active user a month) and paid plans from $29 a month; the tools table now says so.

Key points

  • Keep a behavior tree or state machine for moment-to-moment actions and let the language model handle talk and planning, the split Krafton used for PUBG Ally.
  • Budget for speech: on Inworld's pay-as-you-go plan, for example, voice output is billed per character and speech recognition per hour, on top of the language model.
  • If you use a voice actor's voice for real-time generated dialogue under a SAG-AFTRA contract, the 2025 agreement requires consent, disclosure and higher minimum pay.

In this guide

  1. AI NPCs vs. traditional game AI
  2. How an AI NPC works
  3. Tools and SDKs for AI NPCs
  4. Games and demos that use AI NPCs
  5. Practical problems
  6. Design tips
  7. FAQ

An AI NPC is a non-player character whose lines, and sometimes its decisions, are generated while you play by a language model, instead of being picked from dialogue a writer scripted in advance. In practice it's a pipeline: the player's speech is turned into text, a model writes a reply in character, and that reply is spoken aloud and animated. As of October 2026, a handful of released games use them, including inZOI and Where Winds Meet. Krafton has run a public beta of an AI squadmate in PUBG: BATTLEGROUNDS, and several SDKs let small teams try the same thing in Unity, Unreal and Godot.

AI NPCs vs. traditional game AI

"Game AI" is much older than large language models, and the two terms get mixed up.

Classic game AI: behavior trees and state machines

Most NPCs run on hand-built logic. A finite state machine switches a guard between states such as patrol, chase and attack. A behavior tree is a branching set of tasks; Epic's Unreal Engine documentation describes one that picks which branch of logic to run, paired with a "Blackboard" that stores the facts it decides on. This kind of AI is fast, predictable and cheap, but it doesn't write new sentences.

Scripted dialogue trees

Most RPG conversations are dialogue trees: every line and player choice is written ahead of time. Writers control everything, but players can only say what's on the menu.

LLM-driven NPCs

An LLM NPC lets the player type or speak freely and generates a reply on the spot. The writer's job moves from writing every line to writing the character: who they are, what they know, what they want and what they must never say. Ubisoft made the same point about its NEO NPC prototype in a March 19, 2024 press release, saying each character's personality, history, goals and emotions had to be worked out in detail and built into the model.

Shipped systems often combine both. Krafton's PUBG Ally keeps a behavior tree for reflexes that must run at game speed and hands reasoning and speech to a small language model, according to an NVIDIA developer blog post on how the character was built.

How an AI NPC works

Most tools break the job into the same stages.

Character definition

A character is a structured prompt: personality, backstory, speaking style, goals and knowledge. Hosted tools offer editors for this; with local libraries you write the system prompt yourself.

Dialogue generation

The language model takes the character definition, recent conversation and current game state, and writes the next line. Cloud tools call a hosted model. On-device tools run a small model on the player's GPU or CPU, often in the GGUF format used by llama.cpp.

Memory and knowledge

Models forget anything outside their context window, so tools add conversation history, long-term memory and retrieval (RAG), which searches your lore and inserts relevant facts into the prompt. Convai's docs list a "Knowledge Bank" and long-term memory. NVIDIA says PUBG Ally pulls live engine state through tool calls rather than relying on what it remembers, which keeps its answers about the match accurate.

Guardrails

Guardrails keep the character on-script and safe: rules in the prompt, content filters, topic limits and checks on the output. Inworld's docs say its current runtime includes safety checks. Virginie Mosser, narrative director on Ubisoft's later Teammates project, said she still writes the story and personalities, then sets "fences" so the characters can improvise without leaving the game's lore.

Speech-to-text and text-to-speech

Voice NPCs need speech recognition on the way in and a synthetic voice on the way out. NVIDIA's Mecha BREAK demo in August 2024 ran OpenAI's Whisper for recognition on the player's PC but used ElevenLabs in the cloud for the voice. Krafton paired NVIDIA's speech recognition with its own in-house TTS model for PUBG Ally.

Animation and lip sync

A talking 3D character needs its face to match the audio. NVIDIA's Audio2Face turns audio into facial animation and was used for Ubisoft's NEO NPCs. Convai has lip sync for Unity and a "Face Sync" component for Unreal.

Actions

Through function calling, the model picks from a list of game actions, such as follow or change a loadout, and the game carries them out. In NVIDIA's Mecha BREAK demo, players could ask the mechanic to change their mech's paint job. Convai calls this feature "actions," and LLMUnity supports function calling by using a grammar to limit the model's output to the function names you allow.

Tools and SDKs for AI NPCs

Here's what each tool says it does, based on its own docs and pages as of October 2026. AIGamer hasn't tested these tools.

ToolWhat it doesEngine supportCloud or localPricing note (October 2026)
NVIDIA ACEModels and plugins for speech recognition, dialogue, TTS and Audio2Face facial animation, plus SDKs for running models in-gameUnreal Engine 5 plugins (5.4 to 5.7, varies by plugin); C/C++ SDKs for custom engines; no Unity plugin listedMostly on-device on RTX hardware; speech recognition and Audio2Face can also run in the cloudUnreal plugins and Audio2Face SDK under the MIT license; models under a mix of open and NVIDIA licenses; no prices listed
Inworld AIAgent Runtime for chaining LLMs, speech, memory and tools; Character templateUnreal and Unity Runtime SDKs; Node.jsCloudUsage-based; pay-as-you-go ("On-Demand") TTS-2 at $25 per 1M characters, speech recognition at $0.15 per hour, LLMs from $0.07 per 1M input tokens for open models; monthly plans from $25 lower the speech rates
ConvaiConversational characters with actions, narrative design, knowledge bank, memory and lip syncUnity, Unreal (MetaHuman, Reallusion), webCloudFree plan (100 interactions a month, 1 monthly active user); paid from $29 a month, as of October 29, 2026
Player2AI NPC plugins backed by a desktop app that players runUnity, Godot, DefoldPlayers run the Player2 app, which serves the API on their machine; Player2 doesn't say where the models runFree for developers, according to its June 2025 announcement; players get free models plus daily credits for frontier models
LLMUnityRuns local LLMs in Unity, with RAG and function callingTested on Unity 2021 LTS to Unity 6; PC, iOS, Android, VRLocal (llama.cpp); optional remote serverFree, Apache-2.0 open source
NobodyWhoLocal LLM library with tool calling, structured output, RAG, TTS and STTGodot 4.x, plus Python, Flutter, Swift, Kotlin and React NativeLocal (llama.cpp)Free, EUPL 1.2 open source

Inworld has retired its older Character Studio in favor of its Agent Runtime SDKs. Player2's Godot plugin, announced on June 20, 2025, needs players to install and run the Player2 app.

We left out Charisma.ai, which used to offer Unity and Unreal kits. Its homepage now pitches conversational AI for training and brand campaigns and doesn't mention games, and its Unity and Unreal SDK repositories on GitHub haven't been updated since September 2025.

If you're choosing an engine first, our AI game engines guide compares the options. For building the rest of the game with AI help, see vibe coding games and the best AI game makers.

Games and demos that use AI NPCs

inZOI (Krafton)

inZOI's "Smart Zoi" characters arrived with the game's early access on March 28, 2025, as an optional experimental setting. NVIDIA says they run on a 0.5-billion-parameter Mistral NeMo Minitron model on the player's GeForce RTX GPU. A Smart Zoi reacts to what's around it according to its personality and reworks its daily schedule based on what happened to it, and players can watch its thoughts and redirect it with typed text.

PUBG Ally (Krafton)

PUBG Ally is an AI squadmate for PUBG: BATTLEGROUNDS that you talk to by voice; Krafton says it can discuss strategy, fetch items you ask for, help revive teammates and fight on its own. Krafton announced it on October 30, 2025, with support for English, Korean and Chinese. Its first public test was Ally Duo, a two-week global beta in PUBG's Arcade mode on the Sanhok map that began on June 17, 2026 (Krafton gave July 1 as the end date; NVIDIA said June 30). NVIDIA's developer blog says Ally uses a quantized 2-billion-parameter model and the game runs on GPUs with as little as 8GB of total VRAM. As of October 2026, Krafton hasn't announced a full release; it said it will keep refining the technology using feedback from the beta.

NARAKA: BLADEPOINT (NetEase)

NVIDIA says an AI teammate came to NARAKA: BLADEPOINT MOBILE PC VERSION on March 27, 2025, running locally on the player's PC. It can join your party in Free Training, find items you ask for, swap gear and suggest skills to unlock.

Mecha BREAK (Amazing Seasun Games)

At Gamescom in August 2024, NVIDIA showed a voice-controlled mechanic in Mecha BREAK running NVIDIA's Nemotron-4 4B model on-device. Players could ask about objectives and which mech suited a job. That was a demo, and we couldn't confirm that the feature made it into the finished game.

Ubisoft NEO NPCs and Teammates

Ubisoft showed NEO NPCs at GDC in March 2024, a prototype built with Inworld's character engine and NVIDIA's Audio2Face. On November 21, 2025, it followed up with Teammates, a playable first-person shooter experiment with voice-controlled squadmates, tested in a closed playtest by a few hundred players. Neither is a released game. For Ubisoft's wider generative AI plans, see our report on its Motherbrain unit.

Where Winds Meet (Everstone Studio, published by NetEase Games)

This wuxia open-world game, released worldwide on November 14, 2025, has NPCs that players can chat with; its Steam page says the AI-driven NPC text and voice chat responds to players in real time. Kotaku reported on December 3, 2025, that players were already gaming the system: one got a quest to end by turning everything an NPC said back into a question. PCGamesN reported that the chat NPCs are flagged in the game and players can skip them entirely.

Suck Up! (Proxima)

In Suck Up!, you play a vampire who has to talk neighbors into letting you inside by speaking into a microphone. The Steam page lists a release date of October 1, 2025, says the game connects to OpenAI's ChatGPT to generate content, and lists a broadband connection as a requirement.

Practical problems

Latency

Recognition, the model's reply, speech synthesis and animation each add delay. Krafton says running PUBG Ally entirely on-device keeps its latency very low, and NVIDIA's blog says cutting out the trip to a server made response times more predictable. The blog also describes keeping the stable part of the prompt the same from turn to turn so the model can reuse cached work.

Cost per conversation

Cloud NPCs are billed per use. Inworld's pricing page charges for speech by the character, recognition by the hour and the model by the token, so a long voice chat costs more than a short typed one, and NPCs talking to each other cost money even when no player is listening. On-device models move the cost to the player's hardware.

On-device vs. cloud

Local models are cheaper to run at scale, work offline and keep player speech on the device, but they must be small. NVIDIA says its 2B Minitron model fits in as little as 1.5GB of VRAM, and that memory competes with your game's graphics. Cloud models are stronger but need a connection and a budget per player.

Keeping characters on-script

Players will try to break your NPCs, as Where Winds Meet showed. Don't let the model alone decide whether a quest is complete; check it in game code.

Content moderation

Free-text input means players can steer characters toward offensive or sexual content. Kotaku's December 2025 report included a Where Winds Meet player who shared an erotic roleplay with one of the game's NPCs. Plan filters, player reporting and your age rating before launch, and log conversations so you can see what went wrong.

Voice actors and SAG-AFTRA

On May 19, 2025, SAG-AFTRA filed an unfair labor practice charge against Llama Productions, the Epic Games subsidiary behind Fortnite, over an AI-generated Darth Vader voice, the Associated Press reported. The union said the company swapped in AI voices for work its members would otherwise do, without notifying or bargaining with the union first. SAG-AFTRA members ratified a new video game contract on July 9, 2025, with 95.04% voting yes, ending a 320-day strike, TheWrap reported. Under the deal, companies must explain how AI will use a performer's voice, likeness or movement and get written consent. It also sets pay for "real-time generation," such as a voice-replica chatbot in a game, at 7.5 times minimum scale or more.

Design tips

  • Constrain the world. Krafton limited PUBG Ally's beta to one map and one mode, which NVIDIA says made the problem far easier.
  • Give the NPC a job. A mechanic or squadmate with a clear goal stays in character better than an open-ended chatbot.
  • Ground replies in game state. Pass in facts from the engine instead of trusting the model's memory.
  • Make actions a fixed menu. Let the model choose from functions you define and validate each call.
  • Test with lots of players early. NVIDIA says Krafton tuned Ally with feedback from more than 1,000 players.
  • Have a fallback. If the model times out or the player is offline, fall back to scripted lines.

FAQ

What is an AI NPC?

It's a non-player character whose dialogue, and sometimes its actions, is generated during play by a language model instead of being fully scripted. Many also let players talk to them out loud.

What games have AI NPCs?

Released examples include inZOI (in early access since March 2025), NARAKA: BLADEPOINT MOBILE PC VERSION, Where Winds Meet and Suck Up!. PUBG Ally ran as a public beta in June 2026.

How do I add AI NPCs to Unity, Unreal or Godot?

For Unity, options include Convai, Inworld's Unity Runtime SDK, Player2 and the open-source LLMUnity. For Unreal, NVIDIA ACE, Inworld and Convai have plugins. For Godot, there's Player2's plugin and the open-source NobodyWho. AIGamer hasn't tested any of them.

Can AI NPCs run offline?

Yes, if you use a small local model. LLMUnity and NobodyWho run llama.cpp models on the player's machine, and NVIDIA ACE targets on-device inference on RTX GPUs. Cloud services such as Inworld and Convai need a connection.

Do AI NPCs replace voice actors?

Not under union rules without consent. SAG-AFTRA's 2025 video game contract requires consent and disclosure for AI replicas of a performer's voice and sets higher minimum pay for real-time generated dialogue.

Sources

Compiled by AIGamer from the sources below, which we last checked on 29 October 2026. Prices and features change; check the tool's own site before you buy.

  1. NVIDIA: NVIDIA Redefines Game AI With ACE Autonomous Game Characters
  2. NVIDIA: NVIDIA ACE Autonomous Game Characters Debut This Month In inZOI & NARAKA: BLADEPOINT MOBILE PC VERSION
  3. NVIDIA Developer: How KRAFTON Built PUBG Ally, a Co-Playable Character Powered by NVIDIA ACE
  4. KRAFTON: KRAFTON reveals playtest plans for PUBG Ally built with NVIDIA ACE
  5. KRAFTON (press release via Game Developer): KRAFTON introduces PUBG Ally beta test
  6. NVIDIA: NVIDIA ACE & Digital Human Technologies Showcased In First Game, Mecha BREAK
  7. NVIDIA Developer: NVIDIA ACE for Games
  8. NVIDIA: Ubisoft's NEO NPCs Explores the Possibilities of Digital Humans in Games with Inworld AI & NVIDIA ACE Technologies
  9. Ubisoft: Ubisoft Unveils "NEO NPCs", its First Prototype For GenAI-powered Characters and Gameplay (press release)
  10. Ubisoft News: Ubisoft reveals Teammates, an AI experiment to change the game
  11. Inworld AI: New AI infrastructure for scaling games, media and characters (blog)
  12. Inworld AI: Character Studio deprecation (docs)
  13. Inworld AI: Pricing
  14. Convai: Convai documentation index
  15. Convai: Pricing
  16. Player2: Player2 homepage
  17. Player2: Announcing the Player 2 AI NPC Godot plugin (blog)
  18. Charisma.ai: Charisma.ai homepage
  19. Charisma.ai: charisma-sdk-unity (GitHub repository)
  20. Charisma.ai: charisma-sdk-unreal (GitHub repository)
  21. undream ai: LLMUnity (GitHub README)
  22. NobodyWho: What is NobodyWho? (docs)
  23. Epic Games: Behavior Trees in Unreal Engine (docs)
  24. Proxima: Suck Up! (Steam store page)
  25. Everstone Studio / NetEase Games: Where Winds Meet (Steam store page)
  26. Kotaku: Where Winds Meet players are finding clever and sexy ways to screw with the game's AI NPCs
  27. PCGamesN: Where Winds Meet's AI chatbot NPCs have overshadowed the combat
  28. The Associated Press (via WDIV ClickOnDetroit): SAG-AFTRA files unfair labor practice charge over use of AI to make Darth Vader's voice in Fortnite
  29. TheWrap: SAG-AFTRA members ratify Interactive Media Agreement after 320-day video game strike

Written in our own words; quotes are marked and credited. How we report

More guides

  • How to run a Gauntlet Loop: pair each AI builder agent with a blind criticThe method behind the 55,000-line Claude of Duty shooter: split the game into small pieces and have a fresh, blind critic judge each one against real reference screenshots, round after round.
  • How to let coding agents drive Unreal, Godot and Minecraft with MCPEpic's experimental Unreal MCP plugin and community servers for Godot and Minecraft let an agent act inside a running editor and check the result. Expect dropped tools when the editor restarts.
  • How to turn an AI picture into a rigged 3D game asset in 5 stepsPicture, mesh, refine, rig, export: how 3D AI Studio's templates, Tripo, Hi3D and anymove fit together, and where each step needs checking before the next.
  • Blockout first, art last: how to texture a playtested gray level with AIEpic's docs say to add art only once a level plays well. trompe automates that last step, but its texture is baked to the mesh, so keep the gray level for repaints.
  • How to teach coding agents Roblox Studio, Unreal and game servers with skill packsA skill is a folder of instructions and scripts that a coding agent loads only when a task needs it. Here is how packs from Scenario, Gameye and Epic work, and where they fall short.
  • AI game engines in 2026: what's real, from Unity AI and Unreal MCP to Genie 4The term covers 2 different things: AI tools inside Unity, Unreal, Godot and Roblox Studio, and world models that draw playable frames. Only the first can be used to ship a game today.
  • Best AI game makers in 2026: 9 tools comparedPrompt-to-game sites, engine assistants and coding agents, with prices as of October 2026, which ones let you take your game elsewhere, and one limit for each.
  • Vibe coding games: how to build a game by prompting an AI agentAndrej Karpathy named the method in February 2025, and a browser flight sim made it famous weeks later. Here's the workflow, the tools and their prices, and the problems to plan for.
Sign in
Sign in