World Model Arena
Fork on GitHub

World Model Arena

Train a world model. Dream a policy. Race it for real.

Part of the World Models Bootcamp by Vizuara

This is a hands-on competition where you build a world model of a driving simulator using IRIS or DIAMOND, train a reinforcement learning policy entirely inside your model's imagination, and then deploy it on the real MetaDrive simulator to see how well your dreams match reality. The goal: learn how world models work by actually building one.

Dream-trained policy racing on MetaDrive
Baseline DIAMOND world model
IRIS model with extended context
1

Train World Model

Learn simulator physics from data

2

Dream a Policy

RL inside your model's imagination

3

Race for Real

Deploy on MetaDrive and compete

Getting Started

Four steps from zero to the leaderboard.

1

Fork & Clone

Fork the repo, clone it locally, and cd student_starter

2

Install

Create a conda env and install dependencies

pip install -r ../requirements.txt
3

Collect + Train + Dream

Run the 5-step pipeline: collect data, train WM, dream-train a policy, evaluate

4

Submit

One command evaluates and uploads to the leaderboard

python submit.py --tag my-v1

Top Submissions

Watch the best dream-trained policies race on MetaDrive

Live updates
Loading submissions...

Head-to-Head Racing

Top submissions racing side by side

Live updates
Loading matchups...

Race Leaderboard

Ranked by ELO — computed from head-to-head route completion across all 5 maps.

Loading leaderboard...

World Model Quality

How well does each world model predict the real simulator?

Loading WM metrics...

How It Works

The dream-real gap measures whether your world model actually learned physics.

Collect Data200 episodes
Train WMIRIS / DIAMOND
Dream TrainRL in imagination
Real Eval5 maps × 4 eps
Dream-Real Gap = |dream_score − real_return| / max(|real_return|, 1)
A policy that scores huge in its own dream but crashes in reality means your WM is hallucinating. A small gap (<15%) means your WM actually learned physics. That's the number to watch.

The MetaDrive Environment

MetaDrive is a lightweight driving simulator built on Panda3D. Here's what your world model needs to learn.

Observation Space

259-dimensional vector

Vehicle State
Position, velocity, heading, steering angle
Navigation
Waypoints, checkpoints, distance & heading to goal
LiDAR
240 rays detecting road edges, obstacles, and other vehicles

Action Space

2D continuous

Steering
-1 (left)
+1 (right)
Throttle / Brake
-1 (brake)
+1 (full gas)

Your policy outputs these two values at each timestep. The world model must predict how the environment changes in response.

Reward Structure

Dense + sparse signals

+
Driving Reward speed × cos(heading_error)
+
Route Completion bonus for each checkpoint reached
Crash Penalty collision with obstacle or vehicle
Out-of-Road penalty for leaving the drivable area

Your world model must learn to predict these rewards accurately. A model that gives free rewards creates policies that exploit hallucinations.

MetaDrive Observation Space — 259-dim vector with vehicle state, navigation, and LiDAR
MetaDrive Action Space — 2D continuous steering and throttle
MetaDrive Reward Structure — dense driving + sparse bonuses and penalties

5 Evaluation Maps

Every submission is tested on all 5 maps × 4 episodes. Route completion is averaged across all 20 runs.

🛣
Curve AGentle left curve
🔀
ChicaneQuick left-right-left
↔️
Long StraightSpeed + lane keeping
Tight SSharp S-curves
🟢
OvalContinuous loop

3D Renders

Cinematic 3D captures from MetaDrive — chase-cam footage of policies navigating different track layouts.

Curve A — Diamond-tuned policy
Chicane — IRIS extended context
Tight S — Baseline DIAMOND
Oval — 500-episode DIAMOND
Straight — Baseline IRIS
Circuit — Scripted baseline