How to edit video with Claude Code: five ways, compared

Claude Code does not watch your footage. It edits by running tools, and the five common setups differ in what you can see, fix and pay for afterward.

Om Patel

Written by , Founder, Rushilo

Updated · 15 min read

A MacBook Pro screen filled with lines of code in an editor
Photo by Caspar Camille Rubin on Unsplash

“Claude Code video editing” tutorials have pulled millions of views this year, and they rarely mean the same thing. One renders animated titles with Remotion. Another pipes your footage through ffmpeg. A third drives DaVinci Resolve. This guide sorts the five setups people actually use, says what each one cannot do, and shows how to keep an edit you can still fix by hand. Everything here was checked on October 12, 2026.

Can Claude Code edit video?

Short answer

Yes, through tools. Claude Code, Anthropic’s coding agent, does not watch video on its own. It edits by running programs such as ffmpeg, by reading a word-level transcript of your footage, and by driving a video editor over MCP (Model Context Protocol, the standard way agents call outside tools). It sees frames only when a tool hands them over as images.

That one fact explains most results you see online. Cuts made from a transcript are good at removing words and pauses. Decisions that need eyes, like whether a shot is in focus, depend on the tool showing Claude Code the right frames. And whether you can fix the result yourself depends entirely on what the tool produces: a finished file, or a project you can open.

Claude plans that include Claude Code
Pro+
common ways to edit video with it
5
GitHub stars on video-use
28,795
manual cleanup in one tested AI cut
2:33

What do you need before you start?

  • A paid Claude plan or API credits. Claude’s pricing page lists Claude Code for Pro, Max, Team and Enterprise, and not for Free. A YouTube video promising Claude Code on the free plan has over a million views; the pricing page says otherwise.
  • Awareness of your limits. Anthropic’s help article says Pro and Max have a five-hour session limit and a weekly limit, shared between Claude and Claude Code.
  • No stray API key. The same article warns that if an ANTHROPIC_API_KEY environment variable is set, Claude Code uses it and bills API usage instead of your plan.
  • The tool for your route: ffmpeg for scripts, Node for Remotion, Python and paid transcription keys for some agent pipelines, or a video editor that exposes an MCP server.

What are the five ways to edit video with Claude Code?

Each way below is a real, popular setup. They are sorted roughly from most hands-on to most automated, and the columns are the questions that decide which one fits.

1. ffmpeg scripts

What Claude Code does
Writes and runs ffmpeg commands
Footage stays local?
Yes
Can you fix it by hand?
Only by asking for a new render

2. Code-generated video

What Claude Code does
Writes Remotion or HyperFrames scenes
Footage stays local?
Yes
Can you fix it by hand?
Only by editing the code

3. Agent pipelines

What Claude Code does
Runs a skill such as video-use
Footage stays local?
Audio goes to a cloud transcriber
Can you fix it by hand?
Only by a new run

4. An editor you already own

What Claude Code does
Drives DaVinci Resolve, CapCut or Premiere
Footage stays local?
Depends on the editor
Can you fix it by hand?
Yes, in that editor

5. An editor built for agents

What Claude Code does
Edits a live timeline over MCP
Footage stays local?
Yes
Can you fix it by hand?
Yes, and Claude continues from your change
What each route gives you. Checked October 12, 2026.

How do you edit video with Claude Code and ffmpeg?

Short answer

Put your footage in a folder, open Claude Code there, and describe the result you want. Claude Code writes and runs ffmpeg commands, often after making a transcript with a speech-to-text tool so it knows where words are. It is free beyond your plan, fast for batch jobs, and gives you a new file each time.

Prompts that work well on this route:

  • “Cut every file in this folder to 1080x1920 for Shorts, centred, and keep the audio.”
  • “Normalise the loudness of all clips to -14 LUFS and export copies.”
  • “Join intro.mp4, main.mp4 and outro.mp4 in that order with a half-second crossfade.”
  • “Transcribe talk.mp4, then cut every pause longer than one second. Show me the cut list first.”

The limits of this route are about review. There is no timeline to scrub, so you check results by playing files, and fixing one bad cut means asking for another render. Your ffmpeg build matters too: one tester found their build lacked text filters, so Claude drew captions as images instead.

Is Remotion or HyperFrames video editing?

Short answer

Not in the usual sense. Remotion and HyperFrames generate new video from code, such as animated titles, charts and explainer scenes. They do not cut your recorded footage. They are excellent at what they do, and many viral tutorials pair them with a separate editor, which is why they look like editing.

Both are popular: Remotion has 63,587 GitHub stars and HyperFrames, from HeyGen, has 61,768. Claude Code writes a scene as React (Remotion) or HTML (HyperFrames) and renders it to MP4. Use this route for motion graphics you will place over your footage. Two cautions, one from the comments under a 177,000-view tutorial: rapid-fire transitions read as gimmicky (“Very rapid transitions for no reason”, 215 likes), and Remotion has its own licence with terms based on company size, so check it before commercial use.

What are agent pipelines like video-use, and what do they cost?

An agent pipeline is a packaged skill that runs the whole job: transcribe, decide the cuts, render, then check its own output. The best known is video-use from browser-use, with 28,795 GitHub stars. Its design is smart about cost: its README compares a naive approach of sending every frame (“30,000 frames x 1,500 tokens = 45M tokens”) with its own of about 12 KB of transcript text and a few images.

What to know before you install one:

  • video-use transcribes with ElevenLabs, so your audio goes to that service and you need its API key.
  • The result is a finished final.mp4. To change one cut, you run it again.
  • It suits “drop footage in, get a video out” jobs better than careful edits.

Can Claude Code drive DaVinci Resolve, CapCut or Premiere?

Yes, through community MCP servers or plugins, with caveats per editor. It is a common answer in r/ClaudeCode (“Most people I know hook it up to davinci”), because you keep your own editor, project and look.

  • DaVinci Resolve. The most-starred Resolve MCP server has 3,497 GitHub stars. The author of another Resolve MCP says it needs DaVinci Resolve Studio, because the free version does not expose the scripting API.
  • CapCut. There is no official CapCut connector for Claude; community servers write CapCut draft files instead. We covered every option in how to connect Claude to CapCut.
  • Any editor that imports timelines. A tip from r/ClaudeCode: ask Claude to write an FCPXML or EDL timeline file instead of a finished video, then import it into Resolve, Premiere or Final Cut and keep editing by hand.

How do you edit video with Claude Code and keep a timeline you can fix?

The most common complaint about every route above is the same: the AI produces a finished file, and the last 10% of the edit is stuck there. A builder in r/ClaudeCode described the real test well:

“The part I’d test is whether you can make a manual change and then have Claude continue from that updated project.”
r/ClaudeCode

An editor built for agents solves that by exposing its own timeline to Claude Code over MCP. Rushilo, which we make, works this way, so weigh this section accordingly. Here is the workflow:

  1. 1In Rushilo, choose Connect agent and copy the Claude Code command. Run it once in a terminal; it adds Rushilo as an MCP server named rushilo.
  2. 2Import your footage and keep Rushilo open. Start Claude Code and ask for the edit.
  3. 3Claude Code reads a word-level transcript (made on your computer with Whisper, or with your own OpenAI, Groq or Gemini key) and cuts by words. Each cut closes the gap on every track and is one undo step.
  4. 4It looks at frames around its cuts to check them, and you watch the same timeline it is editing. Change anything by hand and Claude Code works from your version.
  5. 5Add captions in one of five styles, then export an MP4.
The shape of the command Rushilo gives you (copy the real one from the app)
claude mcp add rushilo --scope user --env ... -- "<path filled in by the app>"

The honest limits: Rushilo has to stay open while Claude Code works, it exports MP4 (H.264) only, and on-device captions are slower than the fastest native Whisper tools. It costs $99 once and uses the Claude plan you already have. The setup guide covers Claude Code, Codex and other agents, and there is a separate guide to editing video with Codex.

How much does it cost to edit video with Claude Code?

Claude Code

Who charges
Anthropic
Notes
Pro, Max, Team or Enterprise plan, or API credits; usage limits apply

ffmpeg, Remotion, HyperFrames

Who charges
Nobody, usually
Notes
Free to run; Remotion's licence depends on company size

Cloud transcription

Who charges
ElevenLabs, AssemblyAI and others
Notes
Pay per use on your own key, when a pipeline needs it

Hosted video MCP services

Who charges
The service
Notes
Usually a subscription, and your footage is uploaded

Your editor

Who charges
Its maker
Notes
Resolve Studio is paid; Rushilo is $99 once with no per-edit cost

The hidden cost is images. Sending Claude Code frames to look at is what burns usage, which is why the better tools work from transcripts and only send frames at decision points.

How accurate are the cuts, and what goes wrong?

Transcript-based cuts are good at the mechanical part and weak at judgement. XDA’s hands-on test is the clearest measurement we found: a nine minute single take became a 1 minute 22 second video, and still needed 2 minutes 33 seconds of manual cleanup. The writer said the cutting stage “ate up a chunk of my afternoon”.

The failure modes to watch for:

  • Copy-cuts that start on a keyframe instead of the frame you asked for (the ffmpeg note above).
  • Repeated takes left in, because the transcript of two takes reads almost the same.
  • Cuts that clip the start or end of a word when the pause limit is too tight.
  • A preview that does not match the final render, a headache even tool builders report.

Working editors put the division of labour bluntly. From a 361-comment thread in r/VideoEditing:

“The important value you are providing is knowing what to edit, not controlling the software.”
r/VideoEditing, 511 upvotes

Which way should you pick?

Batch-resize, trim or normalise many files

Pick
1. ffmpeg
Why
Fast, free and scriptable

Make animated titles, charts or explainers

Pick
2. Remotion or HyperFrames
Why
They generate motion graphics

Drop in footage and get a video out

Pick
3. An agent pipeline
Why
Most automated, least control

Keep working in Resolve, Premiere or CapCut

Pick
4. MCP into your editor
Why
Your project and look stay yours

Let Claude cut while you review and fix

Pick
5. An editor built for agents
Why
A live timeline with shared undo

Whichever you choose, start small: one clip, one kind of edit, and a look at the result before you hand over a whole video.

Frequently asked questions

Can Claude Code edit video?

Yes, through tools. Claude Code runs ffmpeg, reads transcripts and drives video editors over MCP, but it does not watch video by itself. It works from transcripts and from frames a tool shows it, so the tool you connect decides how good the edit is.

Do I need a paid Claude plan to edit video with Claude Code?

Yes. Claude's pricing page lists Claude Code as included in Pro, Max, Team and Enterprise, and not in the Free plan. If an ANTHROPIC_API_KEY variable is set on your computer, Claude Code bills API usage instead of your plan.

Is ffmpeg enough, or do I need an editor?

ffmpeg is enough for defined batch jobs: trimming, joining, resizing, burning in captions and loudness. When you want to watch the edit, fix one cut by hand or undo a step, you need an editor that Claude Code drives over MCP.

Is Remotion the same as editing my video?

No. Remotion and HyperFrames generate new video from code: titles, animations and explainer scenes. They do not cut your recorded footage. Many popular tutorials combine both, which is why they look like editing.

Does editing video with Claude Code upload my footage?

Claude Code sends text and any frames you show it to Anthropic. Hosted video services and cloud transcription upload your files or audio. ffmpeg and a local editor with on-device captions keep the footage itself on your computer.

Will Claude Code replace a video editor?

Not for creative work. It saves real time on first assemblies, silence and retake removal, captions and resizing, but pacing and taste still need a person. One tester's nine minute take still needed 2 minutes 33 seconds of manual cleanup after the AI cut.

Sources

  1. Claude pricing (plans that include Claude Code)Claude Code is listed for Pro, Max, Team and Enterprise, not Free. Read 2026-10-12.
  2. Use Claude Code with your Pro or Max plan (Claude Help Center)Shared usage limits and the ANTHROPIC_API_KEY billing note. Read 2026-10-12.
  3. ffmpeg documentation: the -ss optionSeeking lands on the closest seek point before the time; stream copy keeps the extra segment. Read 2026-10-12.
  4. browser-use/video-use on GitHub28,795 stars, MIT; the 45 million token comparison; ElevenLabs transcription. Checked 2026-10-12.
  5. heygen-com/hyperframes on GitHub61,768 stars, Apache-2.0. Checked 2026-10-12.
  6. remotion-dev/remotion on GitHub63,587 stars. Remotion has its own licence; check its terms for your company size.
  7. XDA: I turned my terminal into a video editor using Claude CodeNine minute take cut to 1:22, with 2:33 of manual cleanup. Published 2026-07-15.
  8. samuelgursky/davinci-resolve-mcp on GitHub3,497 stars. Checked 2026-10-12.

Cite this page

Last verified: Oct 12, 2026

Patel, O. (2026, October 12). How to edit video with Claude Code: five ways, compared. Rushilo. https://rushilo.com/blog/how-to-edit-video-with-claude-code
Om Patel

About the author

Founder, Rushilo

Om Patel is the founder of Rushilo, a desktop video editor driven by the user's own AI, and of BigIdeasDB, a research platform that reads real complaints and reviews to help founders validate products. He writes Rushilo's research articles with the same method: primary sources, dated numbers and the words real users write.

Edit video with the AI you already pay for.

Rushilo is a desktop editor for Mac and Windows that Claude Code and Codex drive on a timeline you can see. Your files stay on your computer.