03Broadcast video and game state

SoccerNet Game State Reconstruction

Broadcast clips where every player and referee is placed on the pitch with a role, a team and a jersey number. The benchmark for turning television pictures into tracking data.

  • Broadcast video
  • Pitch localisation
  • Team and jersey
Game state is a chain. Each link has to hold before a position on the pitch means anything.
Modality
Broadcast clips with detections, pitch coordinates, roles, team and jersey labels
Task
Video in, minimap out: who is where, and who they are
Possession labels
None
Calibration
Image-to-pitch localisation is part of the target
Licence
SoccerNet research terms. Video under NDA
Access
Annotations on Hugging Face (SN-GSR-2025)

What it is

Game State Reconstruction asks for the full chain in one task: detect the people on screen, track them, calibrate the camera, place each person on the pitch, then say which team they play for, what their role is and what number they wear. The dataset supplies broadcast clips annotated with exactly that.

What it teaches

Signal What you get
Possession Nothing direct. No continuous ball ownership
Tracking Pitch-plane positions with team, role and jersey number
Events Nothing
Calibration Learned jointly: localisation only scores if the camera model is right

Where it wins

  • End to end. One metric punishes a failure anywhere in the chain. Good detection with bad calibration scores badly, as it should.
  • Team assignment in the wild. Kits, lighting and broadcast compression as they really are.
  • Identity that means something. A jersey number is an identity that survives a camera cut. A track ID is not.

What it costs

  • Part of the pitch. The main camera shows the play, not the back line. Off-screen players do not exist in the labels.
  • Clips, not matches. Continuity across a half is not tested.
  • Thin on the ball. The task is about people. Ball ownership is not annotated.

How it plugs into possession

Team possession needs three things from upstream: player positions in metres, a team for each player, and the ball. Game state reconstruction delivers the first two, and its error modes become possession errors directly. A defender assigned to the wrong team is a false turnover. A calibration that drifts by two metres moves the nearest player to someone else.

Read the benchmark as a specification of the input quality a possession decoder should expect from broadcast, and design the decoder to survive it.

The baseline pipeline built for this task, and the metric that scores it, are covered under Game State Reconstruction baseline.

Our read

The dataset that defines the upstream problem. Everything a possession model consumes, positions, teams, identities, is what this benchmark asks a vision system to produce.

Sources

  1. Task descriptionsoccer-net.org
  2. Baseline repository (sn-gamestate)github.com
  3. SN-GSR-2025 datasethuggingface.co
  4. SoccerNet data access rulessoccer-net.org