Give your legacy app a second life—with a video-guided agent.
Invoice Video Agent automates workflows in existing business software through its user interface. Our prototype creates invoices in IDURAR ERP without using application APIs, DOM selectors, or test IDs during invoice execution.
Workflow recordings are processed by VAST’s video pipeline, using NVIDIA Cosmos for video descriptions. Retrieved clips provide evidence for reviewed, pinned execution plans. A conversational assistant collects invoice details, a typed Task API validates them, and a deterministic policy gateway requires approval for
totals above $500.
W&B-hosted zai-org/GLM-5.3-Flash reads fresh screenshots and locates controls. The execution engine uses Playwright mouse and keyboard actions, checking the visible state before advancing. The model supplies observations; the engine controls permitted actions.
When an unexpected screen appears, execution pauses. Operator controls take over the same live browser session, resolve the interruption, and release it. The engine re-verifies the screen before resuming. Submission tracking prevents automatic repeat saves when the outcome is uncertain.
Our demo creates a $634.70 draft invoice, demonstrates approval and an injected interruption, resumes after operator takeover, and verifies the saved record—with one Save action recorded.
