This is a dating app for vehicles. We take street camera footage, detct and track the vehicles in it and give each one profile built from it how it behaves. Compatibility is computed on the video not just narrated by a LLM. We score things on what the footage shows: speed and driving lanes, times of day etc. The LLM explains the score instead of inventing it so every claim traces back to a clip
Ingest: Street footage is loaded and indexed so it can be searched and streamed by timestamp
Track: YOLO detects and tracks vehicles frame to frame, producing a track history for each one (path, speed, dwell time, proximity to others).
Understand: Cosmos describes each vehicle’s behavior and its interactions with other vehicles (“yields to cyclists,” “idles at the curb”).
Profile: An LLM turns the track data and Cosmos descriptions into a bio, a nickname, and personality traits