The Street Talks Back

This is a dating app for vehicles. We take street camera footage, detct and track the vehicles in it and give each one profile built from it how it behaves. Compatibility is computed on the video not just narrated by a LLM. We score things on what the footage shows: speed and driving lanes, times of day etc. The LLM explains the score instead of inventing it so every claim traces back to a clip Ingest: Street footage is loaded and indexed so it can be searched and streamed by timestamp Track: YOLO detects and tracks vehicles frame to frame, producing a track history for each one (path, speed, dwell time, proximity to others). Understand: Cosmos describes each vehicle’s behavior and its interactions with other vehicles (“yields to cyclists,” “idles at the curb”). Profile: An LLM turns the track data and Cosmos descriptions into a bio, a nickname, and personality traits Match: A scoring function compares track features for each pair of vehicles. Pairs that shared a clip or camera are candidates Explain and chat: An LLM writes the compatibility breakdown and a “first date,” and vehicle personas chat with their matches and accept or reject based on their profiles VAST  We read indexed data, stream the clips and persists complaints and tickets Nvidia - Cosmos reasons captions aree the evidence. YOLO waks the judge cosmos embed runs search and interview Cursor The whole project was built using it Weight Biases gpt-oss-20b judges the clip. Llama writes it.