Vision Timing Augmentation System

Overview

The Vision Timing Augmentation System (VTAS) is a computer vision-based system designed to augment existing RFID timing infrastructure at cycling events. The primary objective is to reduce missed tag reads, particularly in lapped races where a single missed read places a participant one lap behind.

The proposed solution leverages existing CCTV infrastructure (Hikvision DS-7600 series NVR) to provide a secondary detection mechanism. By correlating video-based bicycle detections with RFID triggers, the system identifies gaps in timing data and assists operators in resolving discrepancies.

Design Philosophy

The system operates on the principle of adaptive resource allocation: when RFID timing is working reliably (>98% correlation), the vision system runs in passive mode — detecting and archiving but not creating operator tasks or consuming resources on re-identification. When discrepancies occur, the system escalates through processing modes (NORMAL → ALERT → CRITICAL), increasing operator involvement proportionally.

When RFID is working well, the vision system should be nearly invisible. When discrepancies occur, it becomes the operator’s most valuable tool.

Scale

  • Up to 300 participants per race

  • Up to 2000 participants per event day

  • Peak crossing rate: 10 cyclists in 5 seconds (sprint finishes)

  • 4+ cameras per finish line

Key Capabilities

  • Real-time bicycle detection using deep learning models (YOLO-based)

  • Multi-camera fusion with calibration and automatic drift detection

  • Adaptive processing modes based on correlation success rate

  • Integration with race administration for scheduling context

  • Integration with custom tag-server via MQTT/WebSocket

  • Operator workflow for discrepancy resolution with task prioritisation

  • Post-race batch review for archived detections

Documentation

Technical Specification

Full requirements specification covering functional requirements (9 modules), non-functional requirements, data model, integration architecture, technology stack, deployment, testing strategy, and implementation phases.

[vtas:design-context]

Design context document capturing the inputs, constraints, and rationale behind key design decisions. See the design journal for the original design discussion.