https://videodb.io/blog Papers, benchmark results, engineering notes, essays and apps from the VideoDB lab. en-us Tue, 06 Oct 2026 00:00:00 GMT https://videodb.io/blog/a-faster-path-to-the-next-policy https://videodb.io/blog/a-faster-path-to-the-next-policy Tue, 06 Oct 2026 00:00:00 GMT Benchmarks Sankalp Nagaonkar, Samuel Alexander A head-to-head retrieval benchmark, and what it means for robotics teams choosing what their next policy should learn from. https://videodb.io/blog/why-a-search-tool-is-not-enough-for-an-llm-working-with-video https://videodb.io/blog/why-a-search-tool-is-not-enough-for-an-llm-working-with-video Mon, 05 Oct 2026 00:00:00 GMT Agents Aditi Priya A search tool lets an LLM find a moment in video. But when the LLM is asked how many, or only the ones that failed, it counts whatever the search returned. We show why that happens and what the LLM needs instead. https://videodb.io/blog/robot-runs https://videodb.io/blog/robot-runs Fri, 18 Sep 2026 00:00:00 GMT Essay Ashutosh Trivedi We built a query engine that sits over a lab's robot video, keeps every episode whole, and answers questions in plain English: find the failures, export them as a training manifest, and search the next model's runs the moment they land. https://videodb.io/blog/wgo-bench-action-annotations https://videodb.io/blog/wgo-bench-action-annotations Tue, 08 Sep 2026 00:00:00 GMT Benchmarks Samuel Alexander, Sankalp Nagaonkar We re-annotated all 100 videos of WGO-Bench, human and robot, then measured how well a VLM pipeline segments and labels the actions in them. VideoDB reaches 28.93% semantic F1 at IoU 0.5, ahead of the public baseline at 19.92%, and the remaining errors show where the work goes next. https://videodb.io/blog/claude-edited-our-launch-video https://videodb.io/blog/claude-edited-our-launch-video Sun, 09 Aug 2026 00:00:00 GMT Agents Ashutosh Trivedi A case study in understanding-driven editing: the agent indexed the raw takes, picked the best take per narrative beat, composed and rendered the timeline, then re-indexed its own cut to audit it. https://videodb.io/blog/ai-agent-watch-youtube https://videodb.io/blog/ai-agent-watch-youtube Sun, 09 Aug 2026 00:00:00 GMT Agents Ashutosh Trivedi Give your agent YouTube videos as searchable, timestamped context. Speech and visuals indexed, evidence clips compiled, in about 20 lines of Python. https://videodb.io/blog/twelve-labs-alternatives https://videodb.io/blog/twelve-labs-alternatives Sun, 09 Aug 2026 00:00:00 GMT Engineering Ashutosh Trivedi Comparing Twelve Labs alternatives for video AI in 2026: VideoDB, Mixpeek, Google, AWS, Azure, NVIDIA: organized by what you are actually building. https://videodb.io/blog/video-rag https://videodb.io/blog/video-rag Sun, 09 Aug 2026 00:00:00 GMT Engineering Ashutosh Trivedi What video RAG is, why it breaks text-RAG assumptions, the four architectures that work, and how to build one, including RAG over live streams. https://videodb.io/blog/agentic-streams https://videodb.io/blog/agentic-streams Sat, 08 Aug 2026 00:00:00 GMT Agents Ashutosh Trivedi Open-source agents that research a topic on the live web, gather real clips, screenshots and charts, write a narration, assemble the video with VideoDB and hand back a stream you can play. Three agents included, with example outputs. https://videodb.io/blog/search-over-the-visual-world https://videodb.io/blog/search-over-the-visual-world Sat, 08 Aug 2026 00:00:00 GMT Papers Nagaonkar, Garg, Raj, Choithani, Trivedi VideoDB technical report (arXiv 2608.08075). Analyzer-defined scenes, persistent visual memory, capability-declared indexes, source-grounded evidence, and a 9,834-query retrieval evaluation against a commercial video-native engine. https://videodb.io/blog/give-your-ai-agents-eyes https://videodb.io/blog/give-your-ai-agents-eyes Fri, 07 Aug 2026 00:00:00 GMT Agents Ashutosh Trivedi How AI agents get vision: ingest YouTube videos, live RTSP cameras, and screens; index continuously; search semantically; act on plain-language events. https://videodb.io/blog/rtsp-ai-analysis https://videodb.io/blog/rtsp-ai-analysis Fri, 07 Aug 2026 00:00:00 GMT Agents Ashutosh Trivedi Turn any RTSP camera stream into AI-readable events: continuous understanding, plain-language alerts, and searchable history. No CV pipeline to build. https://videodb.io/blog/video-benchmark-ground-truth-ambiguity https://videodb.io/blog/video-benchmark-ground-truth-ambiguity Fri, 24 Jul 2026 00:00:00 GMT Benchmarks Samuel Alexander Manual review of MSRVTT, MSVD, VATEX, DiDeMo, and QVHighlights shows cases where the benchmark ground truth is too narrow, shifted, or ambiguous, so valid retrieved clips are scored as misses. https://videodb.io/blog/deepseek-visual-primitives-reference-gap https://videodb.io/blog/deepseek-visual-primitives-reference-gap Mon, 13 Jul 2026 00:00:00 GMT Essay Sankalp Nagaonkar, Ashutosh Trivedi The Reference Gap explains why seeing an object is insufficient when a multimodal model cannot preserve its identity, location, or path through a long reasoning trace. https://videodb.io/blog/jepa-from-language-models-to-world-models https://videodb.io/blog/jepa-from-language-models-to-world-models Tue, 07 Jul 2026 00:00:00 GMT Essay Sankalp Nagaonkar, Ashutosh Trivedi Why JEPA’s latent-prediction objective may shift AI systems from token prediction toward predictive world models for VLMs, VLAs, and embodied agents. https://videodb.io/blog/tinyfish https://videodb.io/blog/tinyfish Mon, 29 Jun 2026 00:00:00 GMT Agents Ashutosh Trivedi TinyFish opens the web for agents. VideoDB lets them see inside video. Together they cover both access and comprehension. https://videodb.io/blog/episodic-memory-for-agents https://videodb.io/blog/episodic-memory-for-agents Thu, 11 Jun 2026 00:00:00 GMT Essay Ashutosh Trivedi Humans remember experiences, not just facts. Your agent should too, with verifiable, playable evidence. https://videodb.io/blog/playback-vs-perception https://videodb.io/blog/playback-vs-perception Tue, 09 Jun 2026 00:00:00 GMT Essay Ashutosh Trivedi 70 years of video infrastructure for human eyes, and why AI needs perception-first architecture. https://videodb.io/blog/mp4-is-wrong-primitive https://videodb.io/blog/mp4-is-wrong-primitive Sun, 07 Jun 2026 00:00:00 GMT Essay Ashutosh Trivedi Video files were designed for playback. AI agents need indexes, not opaque blobs. https://videodb.io/blog/perception-is-the-missing-layer https://videodb.io/blog/perception-is-the-missing-layer Fri, 05 Jun 2026 00:00:00 GMT Essay Ashutosh Trivedi LLMs have reasoning. RAG has retrieval. What's missing? The ability to perceive the world as it happens. https://videodb.io/blog/bloom https://videodb.io/blog/bloom Thu, 04 Jun 2026 00:00:00 GMT Agents Lalit Gupta How I built a local-first screen recorder on top of the VideoDB SDK. It automatically indexes your audio and screen, making everything searchable by the time you paste the share link. https://videodb.io/blog/focusd https://videodb.io/blog/focusd Thu, 04 Jun 2026 00:00:00 GMT Engineering Sankalp Nagaonkar How we built Focusd as a local-first desktop app that records work sessions, indexes screen activity with VideoDB, and turns raw events into useful productivity coaching. https://videodb.io/blog/openclaw-agent-camera https://videodb.io/blog/openclaw-agent-camera Thu, 04 Jun 2026 00:00:00 GMT Agents Ashutosh Trivedi How we built a VideoDB-powered OpenClaw skill that records, indexes, searches, summarizes, and clips an agent's remote desktop without changing the agent itself. https://videodb.io/blog/infrastructure-that-sees-and-edits https://videodb.io/blog/infrastructure-that-sees-and-edits Wed, 03 Jun 2026 00:00:00 GMT Essay Ashutosh Trivedi Explore VideoDB's multimodal infrastructure that combines vision and editing for intelligent video processing. https://videodb.io/blog/why-agents-are-blind https://videodb.io/blog/why-agents-are-blind Mon, 01 Jun 2026 00:00:00 GMT Essay Ashutosh Trivedi The gap between human perception and agent perception, and why it matters for the future of AI. https://videodb.io/blog/claude-chessboard-spatial-reasoning https://videodb.io/blog/claude-chessboard-spatial-reasoning Tue, 19 May 2026 00:00:00 GMT Benchmarks Sankalp Nagaonkar We tested GPT-5.4 and Claude Opus 4.7 on reading 72 chess positions into FEN. Claude Opus 4.7 understood the boards and still lost to square-level errors, and the reason only showed up in the reasoning traces. https://videodb.io/blog/deepsearch https://videodb.io/blog/deepsearch Tue, 19 May 2026 00:00:00 GMT Agents Sankalp Nagaonkar How we built Deep Search as a retrieval loop for finding exact moments in video using planning, indexing, validation, recovery, and follow-up state. https://videodb.io/blog/pair-programmer-live-context https://videodb.io/blog/pair-programmer-live-context Tue, 19 May 2026 00:00:00 GMT Agents Rohit Garg A skill that gives Claude Code, Cursor and Codex live screen, mic and system-audio context, and how it is built on VideoDB Capture, RTStreams, local events and agent-side retrieval. https://videodb.io/blog/how-to-evaluate-multimodal-vlms-for-your-video-use-case https://videodb.io/blog/how-to-evaluate-multimodal-vlms-for-your-video-use-case Fri, 15 May 2026 00:00:00 GMT Benchmarks Sankalp Nagaonkar A practical workflow for evaluating video VLM setups with VideoDB and Langfuse, from task definition and dataset design to tracing, scoring, and deployment decisions. https://videodb.io/blog/dispatch-001 https://videodb.io/blog/dispatch-001 Fri, 08 May 2026 00:00:00 GMT Engineering Ashutosh Trivedi The first issue of the VideoDB Dispatch: why agent runs need playable evidence, how much a video model should think, and builder updates from VideoDB. https://videodb.io/blog/how-i-built-call-intelligence-with-videodb https://videodb.io/blog/how-i-built-call-intelligence-with-videodb Fri, 08 May 2026 00:00:00 GMT Agents Om A practical build story for a local-first call intelligence app that records calls, transcribes speakers, generates live nudges, and exports structured Markdown. https://videodb.io/blog/python-http-connection-pooling https://videodb.io/blog/python-http-connection-pooling Mon, 20 Apr 2026 00:00:00 GMT Engineering Rohit Garg A short field note on replacing repeated bare requests calls with a shared session so Python services can reuse HTTP connections. https://videodb.io/blog/cors-preflight-cache https://videodb.io/blog/cors-preflight-cache Fri, 17 Apr 2026 00:00:00 GMT Engineering Om Gate A practical note on preflight caching, custom auth headers, and why OPTIONS requests quietly dominate app latency on slower connections. https://videodb.io/blog/postgres-backup-restore-drill https://videodb.io/blog/postgres-backup-restore-drill Fri, 02 Jan 2026 00:00:00 GMT Engineering Rohit Garg A field note from a simple offline Postgres migration: why pg_dump was enough, where read-only mode fits, and why the restore drill matters more than the dump command. https://videodb.io/blog/lambda-compression-trap https://videodb.io/blog/lambda-compression-trap Wed, 17 Sep 2025 00:00:00 GMT Engineering Rohit Garg Why API Gateway compression can make large responses look safe in testing, then still fail when Lambda enforces the raw payload limit first. https://videodb.io/blog/conference-slide-extraction https://videodb.io/blog/conference-slide-extraction Mon, 25 Aug 2025 00:00:00 GMT Engineering Ashutosh Trivedi Pull slide content out of any conference talk by combining spoken-word search with visual scene indexing. Full Python pipeline with working code. https://videodb.io/blog/nfl-game-analysis-vlm-hallucinations https://videodb.io/blog/nfl-game-analysis-vlm-hallucinations Mon, 25 Aug 2025 00:00:00 GMT Benchmarks Sankalp Nagaonkar Three approaches to event-dense NFL footage, measured. Play-by-play segmentation cut VLM hallucinations from 68.1% to 11.4% at up to 70% lower cost. https://videodb.io/blog/python-ml-container-size https://videodb.io/blog/python-ml-container-size Mon, 25 Aug 2025 00:00:00 GMT Engineering Lalit Gupta Slim bases, same-layer cleanup, CPU-only PyTorch, pinned wheels, and the unglamorous work of keeping deploys fast. https://videodb.io/blog/twelvelabs https://videodb.io/blog/twelvelabs Wed, 13 Aug 2025 00:00:00 GMT Engineering Ashutosh Trivedi TwelveLabs multimodal understanding plugs into VideoDB so any agent can find the exact moment it needs, not just the right file. https://videodb.io/blog/llama-index https://videodb.io/blog/llama-index Wed, 11 Jun 2025 00:00:00 GMT Engineering Ashutosh Trivedi The official VideoDB connector for LlamaIndex lets you treat video as a first-class source in any retrieval-augmented pipeline.