04Vision and calibration
TVCalib
Calibration as direct optimisation: segment the pitch markings, then fit the camera whose projection of the pitch model lands on them.
- Video
- Calibration
- Open weights
- MIT
- Modality
- A single video frame
- Output
- Camera parameters and pitch projection
- Evidence
- WACV 2023
- Code and weights
- Inference notebook; pretrained segmentation checkpoint
- Licence
- MIT
TVCalib skips the homography. Most pipelines detect correspondences, estimate a homography and then decompose it into a camera. TVCalib parameterises the camera directly and optimises those parameters by gradient descent.
The evidence is semantic. A segmentation network labels pixels by the marking they belong to: this touchline, that penalty-area edge, the centre circle. The loss is the distance between those pixels and the projection of the matching segment of a pitch model. Because every marking is labelled, no point correspondences are needed, and curved segments such as the circle contribute as much as straight ones.
Where it wins
- Valid cameras by construction. A homography can be any 3 by 3 matrix. This is always a real camera.
- It uses every visible marking pixel, circles and arcs included.
- The residual of the optimisation is a per-frame quality score.
- MIT code with a released segmentation checkpoint.
What it costs
- Iterative optimisation per frame is slower than a feed-forward estimate, and it can settle in a local minimum from a poor start.
- It rests on the segmentation. A mislabelled line, near penalty area for far, produces a confident wrong camera.
- Like all marking-based methods, it starves when few lines are in view.
- There is no temporal model. Video needs smoothing added.
How it plugs into possession
The same role as any calibrator: the bridge from pixels to metres. TVCalib’s advantage for possession work is its residual. Frames with a poor fit can be down-weighted or dropped before their positions become evidence.
It is also the most licence-friendly calibrator in this family, which matters for anything that ships. PnLCalib is the points-and-lines alternative.
Our read
Calibration done as optimisation, with a quality score for free. Slower than keypoint methods, and the one with the cleanest licence.