Open Source Agentic Video Editors
An open-source agentic video editor is a project you can clone and run in which an AI agent performs the edit itself — it indexes footage, plans a sequence of operations, executes them against a timeline or an edit decision list, and renders a result. The field is roughly eighteen months old and moving fast enough that a survey is stale in weeks. This one lists ten projects, each verified against the GitHub REST API on 4 August 2026, with the licence, the last push date, what it needs to run, and who it is honestly for.
This page is published by Valmera, which is a hosted, closed-source agentic editor. It appears once, at the end, labelled as such. Everything before that is about other people's work, and the section on self-hosting is written to let self-hosting win where it genuinely wins.
How These Were Verified
Every star count, fork count, licence and last-push date below was read from api.github.com/repos/{owner}/{name} on 4 August 2026, and every project's README was read before it was described. Nothing is listed that was not opened.
Three things follow from that, and they are worth stating because most listicles in this niche state none of them. Star counts move. Treat the numbers as a snapshot with a date attached, not a ranking — re-run the call yourself if the difference matters. Stars are not maturity. One project here has 467 stars and was last pushed on the day it was created; another has 99 stars and ships tagged releases to PyPI. And licence is a fact, not a vibe — GitHub's licence field was not trusted on its own here. Every repository that showed blank was opened and its LICENSE path, README and packaging metadata read by hand, which turned one blank into a declared ISC licence with a missing file. The reverse was checked too: one repository shows a licence GitHub names cleanly and is still not open source. Both cases are named further down.
Ordering is by star count descending, because that is how the search results order them and pretending otherwise would be a different kind of dishonesty. It is not a quality ranking.
Four Shapes, Not One Category
"Open source agentic video editor" covers four structurally different things, and picking the wrong shape wastes an afternoon before you find out. The question to ask first is where does the agent live, and what does it drive?
Shape 1 is the most popular right now for a simple reason: the hardest part of an agentic editor is the agent, and if the user already has Claude Code open, the project only has to supply skills and scripts. Shape 4 is the one to read the README about — the code being on GitHub does not mean the editing is happening on your machine or that it is free. We keep a longer comparison of video editing MCP servers for shapes 3 and 4 specifically.
The Roster
Ten verified projects, ordered by stars on 4 August 2026. Full write-ups follow.
| Project | Stars | Licence | Last push | Shape |
|---|---|---|---|---|
| OpenMontage | 45,109 | AGPL-3.0 | 2026-08-03 | Skill pack for a coding agent |
| video-use | 19,291 | MIT | 2026-07-01 | Skill pack for a coding agent |
| FireRed-OpenStoryline | 3,184 | Apache-2.0 | 2026-07-31 | Standalone service, also driveable as an agent skill |
| VideoAgent (HKUDS) | 1,645 | MIT | 2026-07-22 | Research framework |
| CutClaw | 942 | none detected | 2026-04-17 | Research framework, runnable (CLI + Streamlit UI) |
| agentic-video-editor (ave) | 467 | MIT | 2026-04-14 | Standalone CLI |
| Video Jungle MCP (video-editing-mcp) | 284 | none detected | 2025-10-09 | MCP server that fronts a hosted service |
| Diffusion Studio agent | 275 | MIT | 2025-02-10 | Standalone agent driving a browser compositing library |
| kinocut (formerly mcp-video) | 99 | Apache-2.0 | 2026-07-29 | Local-first MCP server + CLI + Python client |
| video-audio-mcp | 83 | MIT | 2025-05-24 | Thin MCP wrapper over ffmpeg |
The Projects
1. OpenMontage
calesthio/OpenMontage · 45,109★ · 5,553 forks · Python · AGPL-3.0 · last push · checked
A production system rather than an editor: you describe a video and your coding assistant runs research, scripting, asset generation, narration and composition through 12 pipelines and a large library of agent skill files, rendering the result with Remotion. It can also start from a reference video — paste a YouTube Short and it analyses transcript, pacing and structure into a production plan before it spends anything.
Needs: Your own coding agent (Claude Code, Cursor, Copilot, Codex) + ffmpeg + Node/Remotion + at least one generation API key
Who it is for: People who want a finished video made mostly of generated or stock material, and who already live inside a coding agent. It is the most complete open-source thing in this list, and the least like a cutting tool.
Worth knowing: This is generation-first. If your problem is a two-hour recording of yourself that needs the dead air taken out, OpenMontage is not aimed at you. AGPL-3.0 also means that if you run a modified copy as a network service, you owe your users the source of your modifications.
2. video-use
browser-use/video-use · 19,291★ · 2,404 forks · Python · MIT · last push · checked
Drop raw takes in a folder, tell your coding agent to edit them, get final.mp4 back. It cuts filler words and dead space, colour-grades each segment, puts a 30ms audio fade on every cut so you never hear a pop, burns subtitles, and can spawn parallel sub-agents to build animation overlays. The design idea is stated plainly in the README: the model never watches the video, it reads it — one ElevenLabs Scribe pass produces word-level timestamps with speaker diarization, all takes pack into roughly 12KB of text, and a composite filmstrip-plus-waveform image is rendered only at decision points.
Needs: Claude Code (or another agent with shell access) + ffmpeg + an ElevenLabs API key; yt-dlp optional
Who it is for: Anyone editing their own talking-head or montage footage who already pays for a coding agent. Of everything here, this is the closest in shape to a hosted agentic editor, and it is genuinely free.
Worth knowing: It is a skill, not a product: no timeline, no preview player, no accounts. It also self-evaluates by re-running its own composite view on the rendered output at each cut boundary, capped at three fix-and-re-render attempts — a real verification loop, and one of the few in this list.
3. FireRed-OpenStoryline
FireRedTeam/FireRed-OpenStoryline · 3,184★ · 374 forks · Python · Apache-2.0 · last push · checked
A conversational editing agent from FireRed: it searches and downloads matching media, segments and understands the clips, writes a storyline and narration, recommends music, voiceover and fonts, and lets you cut, swap and resequence entirely through natural language. Workflows can be archived as reusable Style Skills so the same treatment can be re-applied to new media. It ships Claude Code and OpenClaw skills for install and use, and has a public HuggingFace demo.
Needs: Python service you run yourself, LLM API keys, plus third-party generation services for the optional AI-transition feature
Who it is for: Short-form social production in volume, especially where a house style has to be reproduced across many videos. The Style Skill archiving is a genuinely good idea nobody else here has.
Worth knowing: The README is candid about two things: AI transitions are expensive and unpredictable, and the default open-source font and music assets are deliberately basic for licensing reasons, so the demo quality you see is not the quality you get out of the box.
4. VideoAgent (HKUDS)
HKUDS/VideoAgent · 1,645★ · 225 forks · Python · MIT · last push · checked
The reference implementation of an academic paper covering video understanding, editing and remaking in one framework: intent analysis that decomposes an instruction into sub-intents, graph-based workflow generation with feedback loops, and a storyboard agent for multimodal retrieval. It bundles local speech models — Whisper for recognition, CosyVoice and Fish Speech for synthesis, Seed-VC for voice conversion, ImageBind for embeddings — alongside hosted LLM calls.
Needs: A GPU (8GB VRAM stated minimum), conda, ffmpeg, Git LFS, and keys for several model providers
Who it is for: Researchers and anyone who wants to read a complete, cited architecture for a video agent rather than infer one from a product. The breadth is the point: Q&A, summarisation, beat-synced movie edits, commentary tracks and cross-lingual remakes are all in scope.
Worth knowing: It is the heaviest install here — local model weights over Git LFS, a conda environment, a GPU, and keys for four different providers at once. That is normal for a paper repo and painful for a Tuesday afternoon.
5. CutClaw
GVCLab/CutClaw · 942★ · 114 forks · Python · NO LICENCE DETECTED · last push · checked
Aimed squarely at the hardest case in the category: hours of raw footage plus a music track, out the other end a cinematic montage cut to the beat. It captions the footage into structured text, then runs a screenwriter/editor/reviewer agent loop — shot plan, shot point selection, quality validation — with music structure parsing and content-aware auto-cropping. Published as arXiv 2603.29664.
Needs: LLM API keys via LiteLLM (a vision model, an audio model and an agent model); CUDA GPU optional but recommended for decode/encode
Who it is for: Travel, event, wedding and sports footage, where the edit is driven by music rather than speech. Nothing else in this survey treats beat synchronisation as the organising principle.
Worth knowing: GitHub detects no licence file. Absent one, the default is all rights reserved — you can read it, but you have no granted right to use, modify or redistribute it. Ask the authors before building anything on it.
6. agentic-video-editor (ave)
poseljacob/agentic-video-editor · 467★ · 60 forks · Python · MIT · last push · checked
A CLI that turns a folder of clips plus a JSON creative brief into a finished ad. Four agents in a YAML-defined pipeline: a Director that searches a cached footage index and writes an EditPlan, a Trim Refiner that tightens the cut points, an Editor that renders through ffmpeg/MoviePy, and a Reviewer that scores the output on five dimensions and loops back to the Director when the score is under threshold. Each retry is saved as its own versioned file so you can compare passes.
Needs: Python 3.11+, ffmpeg on PATH, a Google AI API key
Who it is for: Direct-to-consumer and UGC ad production, where the brief is structured and the output is 30 seconds. The bundled style template encodes a hook/problem/solution/proof/CTA structure.
Worth knowing: Read the dates. It was created and last pushed on the same day, 14 April 2026, and has not been touched since. The included web UI is marked work-in-progress by its own README. The architecture is worth reading; treat the code as a snapshot.
7. Video Jungle MCP (video-editing-mcp)
burningion/video-editing-mcp · 284★ · 40 forks · Python · NO LICENCE DETECTED · last push · checked
One of the first video MCP servers, and still one of the most interesting in scope. It exposes add-video, search-videos, generate-edit-from-videos, generate-edit-from-single-video and update-video-edit, with a custom vj:// URI scheme for projects and assets. Search is multimodal, so 'find every time the video says fly trap' returns timestamps you can immediately cut against. It can also emit an OpenTimelineIO project and hand it to a running DaVinci Resolve Studio instance.
Needs: A Video Jungle account and API key; the pip package video-editor-mcp
Who it is for: People who want a searchable video library their assistant can query, and anyone who needs the finished decisions to land in a real NLE rather than a rendered file.
Worth knowing: Two things to be clear about. The code is open; the service behind it is not, and nothing works without a Video Jungle account. And GitHub detects no licence on the repository. Last push was October 2025.
8. Diffusion Studio agent
diffusionstudio/agent · 275★ · 31 forks · Python · MIT · last push · checked
A Python agent that composes video by writing against Diffusion Studio's browser-based compositing library, with a semantic-search tool over that library's documentation so the model can look up the API it is calling instead of hallucinating it. The documentation-as-a-retrieval-tool idea was ahead of its time and is worth a read on its own.
Needs: uv, an OpenAI key, and a browser for the compositing runtime
Who it is for: Reference reading, and anyone building a code-generating agent against a JavaScript video library.
Worth knowing: Effectively dormant: last push 10 February 2025, roughly eighteen months before this survey. Its own to-do list still has 'add MCP integration' unchecked, which dates it precisely. Do not start a project on it.
9. kinocut (formerly mcp-video)
KyaniteLabs/kinocut · 99★ · 23 forks · Python · Apache-2.0 · last push · checked
MCP and CLI tools that turn a local interview or podcast into captioned vertical clips, with what it calls Video Receipts: a manifest of the edit that a human can review and that can be re-run to reproduce the same output. Quality gates sit between the agent and the render. Published on PyPI, version 1.11.1 dated 24 July 2026.
Needs: pip install kinocut and ffmpeg. No account, no API key for the editing tools themselves
Who it is for: Repurposing one recording into Shorts, Reels and TikTok packages on your own machine, and running agent-driven media steps inside CI where a reproducible receipt matters more than a pretty UI.
Worth knowing: Smallest star count in this list and correspondingly small surface — it is a focused repurposing toolkit, not a general editor. The README is unusually honest that the repository tip runs ahead of the last published release.
10. video-audio-mcp
misbahsy/video-audio-mcp · 83★ · 15 forks · Python · MIT · last push · checked
An ffmpeg-powered MCP server for basic video and audio operations — trims, format conversion, audio extraction and similar primitives — exposed as tools any MCP client can call.
Needs: ffmpeg. Nothing else
Who it is for: The smallest possible starting point. If you want to see how a video MCP server is put together before writing your own, this is about two hundred lines of reading.
Worth knowing: Created and last pushed on the same day, 24 May 2025. It has no index, no transcript, no planning loop and no verification — it is a tool surface, and the agent driving it has to supply all the judgement.
Also in the Field
These came out of the same GitHub search pass on 4 August 2026 and their numbers are from the same source, but they are listed rather than reviewed — this page only describes what its author actually read. Several are moving quickly enough to deserve a look.
| Repository | Stars | Licence | Last push | What it is |
|---|---|---|---|---|
| luoluoluo22/jianying-editor-skill | 2,655 | MIT | 2026-06-12 | Agent skill that automates JianYing (CapCut CN) itself |
| 0xsline/OpenChatCut | 792 | AGPL-3.0 | 2026-08-04 | Local-first conversational editor with a multi-track timeline |
| ronak-create/FableCut | 575 | MIT | 2026-07-28 | Browser editor agents drive over a JSON timeline; MCP + REST |
| VelornLabs/velorn | 361 | GPL-3.0 | 2026-08-04 | AI-native editor built around real timelines and local agents |
| RyanChenYN/JAVEdit | 271 | MIT | 2026-06-07 | Joint audio-visual instruction-guided editing; research |
| open-ribbi/velocut | 247 | MIT | 2026-07-30 | Rust/WASM browser engine, local-first |
| htekdev/vidpipe | 207 | ISC declared, no LICENSE file | 2026-08-03 | CLI: transcribe, cut silence, caption, make shorts |
| idwts/Crayotter | 187 | PolyForm NC 1.0 — not open source | 2026-08-04 | Multimodal agent for editing, composing and production |
| Cassette-Editor/oh-my-cassette | 139 | MIT | 2026-08-04 | Montage co-editor plugin and MCP server |
| pifferologo/ai-agent-video-editor | 138 | MIT | 2026-07-06 | Phrase-level transcripts reasoned over as an EDL |
| mrbuslov/capcut-ai-editor | 90 | MIT | 2026-07-01 | MCP server for automated talking-head processing |
The rate of arrival is itself the finding. Seven of those eleven were pushed within a week of this survey, and a category where a third of the notable repositories are under six months old is a category where the right answer changes between the time you read a comparison and the time you commit to one.
Read the Licence Before the README
Two of the repositories in this survey carry no licence statement anywhere — CutClaw (942 stars) and video-editing-mcp (284). No LICENSE file, and nothing in the README or the packaging metadata either; both were checked by hand on 4 August 2026, not merely read off GitHub's badge. A public repository with no licence is not open source. Copyright attaches automatically, the default is all rights reserved, and pushing code to a public host grants the world the right to view and fork within the platform's terms — not to use, modify or redistribute it. That is a fixable oversight and usually is one; the fix is an email to the author, not an assumption.
A third case is worth separating from those two, because lumping them together would be unfair to the author. vidpipe (207 stars) declares "license": "ISC" in its package.json and carries an ISC badge in the README — but the badge links to a ./LICENSE file that is not in the repository, so GitHub detects nothing. The intent is stated and npm consumers will read it; the grant itself has no text to point at. That is a missing file rather than a withheld permission, and it is a two-minute fix for whoever notices.
The trap in the other direction is a repository that has a licence, states it plainly, and still is not open source. Crayotter (187 stars) ships PolyForm Noncommercial 1.0.0 — a real, deliberate, well-drafted licence that permits use only for noncommercial purposes. It fails the Open Source Definition on field-of-use restriction, so it is source-available rather than open source, and if you are editing videos for a client or a company you have no grant. There is a LICENSE file, GitHub names it in the sidebar, and the whole thing is above board — which is exactly why it slips past a reader who has learned to treat a filled-in licence field as the all-clear. Read the name, not just the presence.
Among the ones that do carry a licence, the practical split is between permissive and copyleft. MIT and Apache-2.0 — video-use, VideoAgent, ave, video-audio-mcp, diffusionstudio/agent, kinocut, FireRed-OpenStoryline — let you build a commercial product on top and keep your changes to yourself; Apache-2.0 additionally grants patent rights, which is why it is the more conservative choice for a company. AGPL-3.0 — OpenMontage, OpenChatCut — is network copyleft: if you run a modified version as a service that users interact with over a network, you owe those users the source of your modifications. For personal use that is irrelevant. For a startup planning to host it, it is the whole decision.
There is a second layer worth checking that no licence covers: the assets and the model terms. FireRed-OpenStoryline says outright that its bundled fonts and music are deliberately basic because of licensing restrictions, and that the demo quality comes from a commercial asset library you have to supply. Any project generating images, voices or music is also passing your usage through a provider whose own terms decide what you may do commercially with the output. The repository licence covers the code. It does not cover the fonts, the tracks, or the model.
The Real Cost of Self-Hosting
The claim "open source is free" is true about the licence and false about the pipeline. Editing a video with an agent costs money at five distinct stages, and cloning a repository removes exactly one of them: the vendor's margin. Everything else moves onto your bill or onto your calendar.
Take those stages one at a time. Agent turns are usually the largest line and they do not change at all. The same tokens cost the same whether your script sends them or a vendor's does, and an agent that plans, calls tools, reads results and revises sends a great many of them. Anyone who has watched a long agent session burn through a rate limit knows this is not a rounding error.
Indexing — speech recognition, and in some architectures a vision pass over frames — scales with minutes of source, and this is the one place a GPU genuinely earns its keep. It is also where the idle problem bites: rented on-demand A100 capacity was tracked across providers in mid-2026 at roughly $1 to $5 per GPU-hour depending on who you rent from, and an instance you leave running bills at that rate whether it is transcribing or sitting still. If you own the card already and your electricity is somebody else's problem, this line goes to nearly zero and self-hosting starts winning early.
Rendering is H.264 encoding: linear in output minutes and resolution, mostly CPU, and boring. It is the most predictable cost in the pipeline and the one least worth optimising. Storage and egress are per gigabyte and video is large — a three-hour ProRes capture is not a text file, and the difference between keeping originals and keeping proxies is most of your bill. And maintenance is the item that sinks self-hosting projects that penciled out fine on the spreadsheet: ffmpeg filter graphs break on variable frame rates, rotation metadata, unusual pixel formats and audio streams with no timestamps, and every one of those is a real afternoon.
None of which makes self-hosting the wrong answer. It makes it a specific answer. Here is the honest split.
| Your situation | Better answer | Why |
|---|---|---|
| Footage cannot leave your machine | Self-host | Not a cost argument at all. An NDA, an unreleased product, patient or legal material — no pricing page beats a file that never moves. |
| High, steady volume | Self-host | A GPU you keep busy amortises. A GPU idle 95% of the week is the single most expensive thing in this table. |
| You need to change the editing logic | Self-host | A hosted tool's refusal is final. A repository's refusal is a diff. If your workflow needs a codec, a LUT pipeline or a cut rule nobody sells, this is decisive. |
| Reproducing a paper | Self-host | Research results need the research code. No hosted service will pin its model for you. |
| One video a week | Hosted | Irregular volume is where per-use pricing wins outright, because idle infrastructure still bills. |
| You want to finish a video today | Hosted | Most repositories here are an afternoon of dependency work before the first frame renders. Some are a weekend. |
| Nobody on your team owns ffmpeg | Hosted | Filter graphs break on codec edge cases, variable frame rates and rotation metadata. Somebody has to be on call for that, and it is a real job. |
| The best model keeps changing | Hosted | Model churn is continuous. Self-hosting means you re-tune prompts and re-benchmark every time; a hosted vendor absorbs it — and also decides for you. |
If you fall into the top four rows, stop reading vendor pages — including this one — and clone something. Privacy and control are not preferences that a lower price can outweigh, and a repository you can read is worth more than a feature you have to request. The rest of the table is where a hosted agent earns its margin, and it earns it on time and idle capacity rather than on capability.
What the Open-Source Field Is Still Weak At
Reading ten of these back to back, the gaps are consistent, and they are not the gaps you would guess.
- Most of them edit blind. Rendering a file and reporting success is not the same as looking at what came out. Only three — video-use, ave and CutClaw — have an explicit review step that inspects the rendered output and can send the plan back for another pass. Everywhere else, the first eyes on the result are yours.
- Nobody publishes a ceiling. Not one README in this survey states a maximum input length or file size. That is honest in a sense — a local tool's limit is your disk — but it means you find out where the pipeline falls over by feeding it a three-hour recording and watching.
- Long-form is barely addressed. CutClaw is the only project here explicitly built for hours of footage, and it approaches it through music rather than speech. Most of the rest assume clips or a short take, which is a different problem from a podcast.
- The agent gets shell access. Every shape-1 project works by letting a model run commands against your filesystem. That is the source of the power and it deserves a moment's thought about which directory you run it in.
- Setup is the real barrier, not capability. Between conda environments, Git LFS weights, Node runtimes for Remotion, four provider keys and a GPU driver, the distance from
git cloneto first rendered frame is usually measured in hours. The projects that solve this — apip installand an ffmpeg binary — punch far above their star count. - Abandonment is common and invisible. Two of the ten here were last touched over a year ago, and two were last touched on the day they were created. Stars accumulate; commits do not. Check the push date before the badge count.
The counterweight is that the good ones are genuinely good. video-use's decision to have the model read a packed transcript instead of frame-dumping — its README does the arithmetic at 30,000 frames against roughly 12KB of text — is a better piece of engineering than most of what is shipping commercially, and it is sitting there under an MIT licence.
Where Valmera Fits, and Where It Does Not
Valmera is hosted and closed-source. It does not belong on the list above and is not offered as one of the ten. It is here because it publishes this page and because it is the shape people usually land on after bouncing off a self-hosting attempt, and pretending otherwise would waste your time.
What it is: an agentic video editor in the browser. Upload real footage — up to 14 GB or 3 hours, MP4, MOV, MKV or WebM — describe the edit in plain English, and an agent indexes it (word-level transcript with speaker labels, silence detection, shot detection, and labeled frame tiles it actually looks at), edits an EDL, renders a preview from a fast proxy, looks at the frames it produced, and exports the final file from your original at source quality. Every reply is verified server-side against the edit decisions actually recorded, so it cannot claim an edit it did not make. The free plan is 50 one-time credits with no card.
The part that is relevant to this page: the interface is public. The same registry of 108 tools the in-house agent uses — 97 editing, 11 session — is published as a remote MCP server over streamable HTTP with OAuth 2.1, dynamic client registration and PKCE, and the tools are not re-declared for it, so there is no second list to drift. That makes it inspectable and swappable at the protocol boundary — you can point Claude at it exactly as you would point it at kinocut. It is not a substitute for a licence to read the code, and it would be dishonest to present it as one.
It is also not a text-to-video generator, which is what separates it from OpenMontage and from a good half of what is trending in this category. And it has real gaps: no multi-cam sync, no SRT or VTT (captions are burned in), no true crossfade, no audio denoise, no team seats, no direct publishing, and one deliverable per request rather than a batch. If any of those are the job, one of the projects above — or a traditional NLE — is the better answer.
Frequently Asked Questions
If You'd Rather Not Maintain a Pipeline
50 free credits, no card. Upload real footage, describe the edit, export from the original file. Or connect the same 108-tool registry to Claude over MCP.
Try it free →