Skip to content
Splash Brain AI

Brain AI

LLM-driven NPC · Unreal Engine · voice to action

{ Unreal Engine Developer}

logo of Unreal Engine

Unreal Engine

logo of C++

C++

logo of OpenAI

OpenAI

Built an AI-powered interactive agent in Unreal Engine integrated with the OpenAI API. Users control the agent through voice commands, triggering real-time actions like navigation and movement, with a swappable response voice via ElevenLabs.

OpenAIIntegrated language model
VoiceSpoken command control
UEReal-time 3D agent
ElevenLabsSwappable synthesized voice

Problem

Exploring how a language model can control an agent inside a game engine naturally, without menus or fixed scripts.

Solution

I integrated the OpenAI API into Unreal Engine in a modular way: the user's voice commands trigger agent actions (move, jump, and more) in real time, with a swappable response voice via ElevenLabs.

Result

An interactive Unreal Engine agent that executes real-time actions from voice commands processed by OpenAI, with a swappable response voice via ElevenLabs.

Project reel

Brain AI

Angel Iram
{ Unreal Engine Developer}

Modular OpenAI Integration

Built a modular system to integrate the OpenAI service inside Unreal Engine, isolating the AI logic from the rest of the project so it can be reused or swapped without touching the agent.

Angel Iram
{ Unreal Engine Developer}

Intent-to-Action Mapping

Translated the voice commands interpreted by the model into concrete agent actions —moving, jumping, and more— inside the engine, closing the real-time voice-to-action loop.

Angel Iram
{ Unreal Engine Developer}

Swappable Voice Layer

Built the swappable voice-synthesis layer via ElevenLabs, so the agent's spoken response can be changed without touching the interaction logic.

The code for this project belongs to the client and cannot be published. What I can show is on this page: the problem, the solution I built, my specific role and screenshots of the product. If what you want is to read my code, that's exactly why I built Ghostline: a complete, playable game with both the C# client repo and the TypeScript API repo open —the same technical judgment I applied here, this time auditable commit by commit.

Gallery

Voice-to-Action Pipeline

Flow diagram: the voice command goes through OpenAI, the agent performs the action in Unreal Engine, and replies with an ElevenLabs voice.

MexVR Tour
Next projectMexVR TourVirtual Reality · Meta Quest