AIgamer
Sign in
๐Ÿ Home๐Ÿ“ฐNews๐ŸงฐResources๐ŸŽฎGames๐Ÿ“˜Guides๐Ÿ†GOTW
๐Ÿ“ฐNews๐ŸงฐResources๐ŸŽฎGames๐Ÿ“˜Guides๐Ÿ†GOTW
Get the weekly emailSign in
AIgamer
๐Ÿ Home๐Ÿ“ฐNews๐ŸงฐResources๐ŸŽฎGames๐Ÿ“˜Guides๐Ÿ†GOTW
New storiesWeekly roundupsTopicsSubmit your gameHow we report
Get the weekly email

๐Ÿ†AI Game of the Week

WK 45

Sumiro

Play it

Made a game with AI? Submit it for next week

โœ‰๏ธWeekly email

The week's top stories and the AI Game of the Week, every Monday. Free.

๐Ÿ”ฅMost read this week

  1. 01Report: Unreal Engine 6 drops Blueprints and Actors, moving gameplay code to Verse
  2. 02Sumiro
  3. 03Pieter Levels ports the Battlefield 1942 demo to the browser with Claude Code
  4. 04Einsia benchmark tests 11 coding agent setups on Blender and Unreal Engine 5
  5. 05Holdout's GameDecider is a small local model that judges what players say
AIGamer: the front page for people making games with AI.
Weekly roundupsSubmit your gameHow we reportContactX (@aigamergg)PrivacySubmission terms

Home โ€บ News

๐Ÿ“ฐ NewsResearch

Einsia benchmark tests 11 coding agent setups on Blender and Unreal Engine 5

Frontier3DBench's 145 tasks require editable .blend and .uproject files, not renders. GPT-6.1 Sol in Codex leads at 66.02 out of 100, but every setup struggles with multi-step activities in its Unreal worlds.

By Hitesh K ยท 7 November 2026

Key points

  • Frontier3DBench has 145 tasks: 65 Blender objects, 65 Blender scenes and 15 interactive Unreal Engine 5 worlds.
  • GPT-6.1 Sol in Codex scored 66.02, GPT-6 Astra in Codex 63.85 and Claude Opus 5.5 in Claude Code 62.29.
  • The benchmark code is on GitHub under Apache-2.0, with task assets under their own licenses, so teams can run the tests themselves.
Einsia benchmark tests 11 coding agent setups on Blender and Unreal Engine 5
Image: Einsia

Researchers from Einsia.AI's Navers Lab and Tsinghua University released Frontier3DBench on November 6, 2026: a set of 145 tasks that asks coding agents to build 3D objects, scenes and interactive worlds as working Blender and Unreal Engine 5 projects. The results come from the team's own preprint paper and project page, which Einsia (@EinsiaAI) announced in a post on X.

There are three levels: 65 object tasks and 65 scene tasks in Blender, plus 15 open-world tasks in Unreal Engine 5. Agents start from text briefs, reference images, real photos or an existing scene, and must deliver editable .blend or .uproject files rather than pictures. Each submission is rendered, inspected and run, then scored on appearance, structure and behavior. The overall score weights the levels 30%, 30% and 40%.

Eleven model and harness pairings were tested, all at their highest reasoning effort. OpenAI's GPT-6.1 Sol running in Codex scored highest at 66.02 out of 100, ahead of GPT-6 Astra in Codex at 63.85 and Claude Opus 5.5 in Claude Code at 62.29. Astra had the best Unreal Engine score, 61.28, and Opus 5.5 had the top text-to-object score, 84.05. Doubao Seed Evolving came last at 42.94.

According to the paper, every setup scored lower when matching a reference than when generating from a text brief, for both objects and scenes. Across all 165 Unreal submissions, individual mechanisms averaged 83.08, but motion clearance averaged 20.82 and stateful multi-step workflows 30.26.

Why it matters: Developers already use Claude Code and Codex to block out props and levels. This benchmark checks whether the result is an engine project someone can open and keep editing, not just a good-looking frame. Its numbers suggest agents can wire up single interactions but still struggle to match concept art or finish a full gameplay sequence.

Caveat: The tasks, scoring and results are Einsia's own and haven't been independently reproduced. Scores depend on the harness and effort setting, and the Unreal level rests on just 15 tasks. We haven't run the benchmark.

The task inputs, generation and evaluation code are on GitHub; the software is Apache-2.0 licensed, while task assets keep their own licenses, and model outputs aren't included. The paper is a preprint and hasn't been peer reviewed.

Read the original on Einsia โ†’
Topics:Coding agentsUnreal EngineAI 3D and art assets

Sources

Based on a research paper. Results are the authors' own.

  1. Einsia: Frontier3DBench project page and leaderboard
  2. Lin et al., Navers Lab, Einsia.AI and Tsinghua University: Frontier3DBench: Benchmarking Coding Agents for 3D Creation across Objects, Scenes, and Interactive Open Worlds (preprint PDF)
  3. Einsia on GitHub: Einsia/Frontier3D repository and README
  4. Einsia (@EinsiaAI) on X: Announcement post for Frontier3DBench

Image: Einsia

Written in our own words; quotes are marked and credited. How we report

Get the week in AI game making, every Monday

The top stories, new guides and the AI Game of the Week in one short email. Free.

More in News

  1. Announcement

    Epic says Unreal Engine 5.9 Preview brings improved AI workflows and web builds

    The Preview was due the week of November 9 but hadn't shipped early that day. Epic hasn't detailed the AI changes; 5.8 added an experimental MCP plugin.

    Via Unreal Engine (@UnrealEngine) on X5h ago

  2. Report: 72% of Next Fest AI disclosures mention art, only 117 name a tool

    The founder of Steam marketing tool NextWishlist read 2,443 disclosures from October's Steam Next Fest: translation is second at 29%, and 315 run to 10 words or fewer.

    Via DreamEp (@dreamep.bsky.social) on Bluesky4h ago

    Report: 72% of Next Fest AI disclosures mention art, only 117 name a tool
  3. Report: Unreal Engine 6 drops Blueprints and Actors, moving gameplay code to Verse

    Tim Sweeney told Unreal Fest Tokyo the change applies from UE6 Early Access in late 2027, with AI-assisted tools promised to convert existing Blueprint and C++ gameplay code.

    Via Game Makers5d ago

    Report: Unreal Engine 6 drops Blueprints and Actors, moving gameplay code to Verse
  4. Announcement

    Base44 and Nitro launch $65K contest for AI-built browser games

    New free browser games built on Base44 can enter until December 3. The official terms give Overwolf a perpetual license to every entry, and upvotes alone don't pick the community winners.

    Via Nitro by Overwolf2d ago

    Base44 and Nitro launch $65K contest for AI-built browser games

๐Ÿ“˜Guides

  • Best AI 3D model generators for games in 2026
  • How to use AI in Blender
  • How to use AI in Unity
  • How to use AI in Roblox
  • How to use AI with Godot
All guides โ†’
Sign in
Sign in