To main content To menu

Agents Of Empires Four bots, one bad habit

Age of Empires 2 as an LLM benchmark - four models wrote strategy scripts, all failed the same way, and one overnight loop evolved a better bot
Luitpold-Alexander Zollorsch
Luitpold-Alexander Zollorsch
@luitpold.me

Four language models, four Age of Empires 2 strategy scripts, from scratch, no peeking at each other. They failed the same way: hoard villagers, send hunting parties halfway across the map, never bank enough to advance an age. Gemini never left the Dark Age. Four vendors, one set of bad instincts.

The real find is what Emergent Garden built after: an overnight loop where a model mutates the best script, runs a tournament against the previous winner and the built-in extreme AI, keeps what survives. Genetic programming with an LLM as the mutation operator instead of a coin flip. ≈15 USD of tokens, and it beat extreme – by a hair, with a bot he then stomps by walking cavalry around the back.

Commenters point at the ceiling: the game ships Direct Unit Control – loops, pointers, near-human micro – and the models barely used it.