tokens&
For enterprises
tokens&

Find tools, check provider offers, save a build plan, and share your work when you’re ready.

For buildersFor enterprises

For builders

  • Startup credits and perks
  • Agent Skills
  • Publish a project

For enterprises

  • Start free company workspace
  • Submit a tool, product, or perk

Community

  • Community
  • Newsletter
  • Events
Xin

© 2026 tokensand, LLC. All rights reserved.

  • Terms
  • Privacy
  • Security
  • Data Processing
  • Status
  1. Hackathon
  2. Project gallery
  3. Sentiment Engine
Emily Yuanabout 1 hour agoContributorJudging locked: Event build

Sentiment Engine

A real-time video agent that pairs on-screen game events with players' facial reactions and makes hours of gameplay searchable in plain language.

Review the project

Start with the source code, then open the demo or video if available.

View GitHub repository
Watch demo video
Demo video
Watch demo video
Project description
Sentiment Engine turns gaming reaction videos into searchable, time-indexed intelligence by pairing what happens on screen with how the player reacts. For any gameplay video, SE finds the moments that matter — the in-game event (the stimulus) and the player's facial expression at that instant (the response) — then lets you search hours of footage in plain language and auto-writes a studio insight brief when something lands. How it works: Ingest — yt-dlp pulls the video stream; ffmpeg samples frames. Game understanding — NVIDIA model captions the on-screen event per window. Reaction lane — SE locates the creator's webcam corner, crops the player's face at each event, and the VLM reads the facial expression + intensity. Fusion — events × reaction intensity × cross-video synchrony rank the "notable moments." Action — NVIDIA model writes a 2-sentence design/marketing brief for the top moment. Search — plain-language queries return the moment + reaction.
Tools used
  • VAST Data logoVAST Data
  • CoreWeave (Weights & Biases) logoCoreWeave (Weights & Biases)
  • NVIDIA logoNVIDIA
Project gallery
Project links
  • GitHub repository
  • Demo video
Tools used
  • VAST Data logoVAST Data
  • CoreWeave (Weights & Biases) logoCoreWeave (Weights & Biases)
  • NVIDIA logoNVIDIA