VideoDB is in Claude. Ask it about any video.Add to Claude

Build agents with visual intelligence

Your agent can watch video. Upload or stream it, then ask for the moment you need.

Add to Claude Talk to us

ClaudeVideoDB connected

Make our brand film searchable.
upload_media"hero-loop.mp4"37.8 s
understand_videovlm scene, every 2 s19 scenes
create_index"scene"ready
Done. All 19 scenes are searchable now.
Where is the robot watching the sunset?
search_video"robot watching the sunset over the mountains"5 shots0:00–0:060:34–0:37.8
Twice: in the first six seconds, and from 0:34 to the end.

Ask about this video

An agent in Claude works on the 38-second loop above, with the results VideoDB returned for it. It uploads and indexes the video, 19 scenes of two seconds each. Asked where the robot watches the sunset, it finds 0:00 to 0:06 and 0:34 to the end. Asked to put both in one clip, it returns a 9.8-second clip. Asked when the picture is made of black-and-white dots, it finds 0:28 to 0:34.

1,000+ developers and agents use VideoDB every week. 300+ TB of video processed.

Any MCP clienthttps://mcp.videodb.io/mcp

Teams that have built on VideoDB

Add VideoDB to the agent you already use

Claude

Web, desktop and mobile.

Add to Claude

Claude Code

Two commands in the terminal.

In Claude Code

/plugin marketplace add video-db/skills
/plugin install videodb@videodb-skills

Cursor, Codex or any MCP client

Add one URL as a remote server.

Server URL

https://mcp.videodb.io/mcp

All install steps

What agents do with VideoDB

Kinds of agents built on VideoDB, a typical request to each, and what comes back
Agent	Asked	What comes back
Archive agents	Cut three Shorts from this podcast.	search_video 3 momentsreframe_video vertical clips, `9:16`
Computer-use agents	What did the agent click before the error?	search_video Submit invoice, `14:02:11`
Physical agents	Where did you last see the blue bottle?	search_rtstream kitchen counter, `09:41:07`
Research agents	Two arms picking up objects in a kitchen.	dataset_search episodes from 9 datasetsexport_result_set LeRobot files
Fleet agents	A cyclist cutting across at dusk.	search_collection clips with drive, time and camera

Memory for agents and physical devices

Long-termThe index of everything seen, written as it arrives

0:00a small robot over a misty mountain valley 0:14dense, flowing contour lines 0:28a black-and-white halftone pattern

Live

Short-termThe frames a task needs, pulled from the index

0:33.8–0:35.6back as a stream in 441 ms, the median for a five-second window

0:33.80:34.40:35.00:35.6

The long-term index holds a description of every moment of the loop as it arrives. A task asks for the moment the robot comes back in color; the index points to 0:33.8 to 0:35.6, and those frames come back as a stream in 441 milliseconds, the median for a five-second window.

First on a 100‑hour action retrieval benchmark

VideoDB finds a matching clip for more queries than any other pipeline tested, on an open dataset with 11,369 queries.

Read the benchmark

Queries with a matching clip in the top 10

VideoDB20.5%
AWS Nova10.0%
Twelve Labs Marengo 3.59.6%
SigLIP26.2%
Cosmos-Embed6.1%
Qwen3-VL Embedding5.3%
InternVideo25.0%
PE-AV2.4%

Hit@10 on 2,835 egocentric videos, sorted by the selected rule. tIoU is the time a returned clip shares with the action, divided by the time either one covers. Under the any-overlap rule at top 50, AWS Nova (60.0%) and Twelve Labs (57.4%) find more than VideoDB (53.7%).

From your files to your agent

Files stay where they are
Buckets, cameras and screens, read in place.
Indexed by what happens
Any model describes every scene. Search runs on what it writes.
Frames on request
About half a second from a question to the frames.

Storage

hero-loop.mp4
run_0412.mp4
cam_02
drive_0977
screen_1402

Index

0:000:37.8

robotsunsetvillage

Agent

Where is the robot watching the sunset?

hero-loop.mp4 at 0:34

Runs onAWSGoogle CloudAzureor your own cloud

SOC 2 Type II GDPR

Open-source agents to start from

The most-starred VideoDB repositories, with GitHub stars as of 29 Oct 2026
Repository	What it does	Stars
call.md	Meetings as live agent loops: recording, transcription and analysis while the call runs.	1,975
Director	A framework for AI video agents: reason over a video, then act on it.	1,566
StreamRAG	A video search agent for ChatGPT.	503
Bloom	An open-source, agentic screen recorder. Recordings become inputs for AI.	235

What builders say

For a long time, I have been thinking what you are building needs to exist! Glad you are building it!

Oliver CameronFounder of Odyssey, ex-Voyage and Cruise