Skip to main content
Agent skill

Video Editing

AI-assisted video editing workflows for cutting, structuring, and augmenting real footage. Covers the full pipeline from raw capture through FFmpeg, Remotion, ElevenLabs, fal.ai, and final polish in Descript or CapCut. Use when the user wants to edit video, cut footage, create vlogs, or build video content.

Get started

Get the complete skill folder, including its scripts and reference files.

·

When to use this skill

Use Video Editing when an AI agent needs a reusable SKILL.md workflow for this job: AI-assisted video editing workflows for cutting, structuring, and augmenting real footage. Covers the full pipeline from raw capture through FFmpeg, Remotion, ElevenLabs, fal.ai, and final polish in Descript or CapCut. Use when the user wants to edit video, cut footage, create vlogs, or build video content.

When not to use it

Skip Video Editing when the task is outside the creativity category, or when a more specific skill in this directory already covers the same workflow with clearer triggers.

How to install

Where will you use it?

Install scope
Claude Code folder setup
mkdir -p ~/.claude/skills/video-editing
# Save SKILL.md to ~/.claude/skills/video-editing/SKILL.md
  1. Claude Code personal install: place the skill and its bundled files at ~/.claude/skills/video-editing/SKILL.md. For a shared project, commit the folder at .claude/skills/video-editing/ instead.
  2. Current Claude Code detects SKILL.md changes in watched directories during the session. If you just created a top-level skills directory, run /reload-skills. Check that the skill is listed before testing its trigger.
  3. For Claude chat or Cowork in the Desktop app, manage uploaded skills in Customize > Skills; copying files into a local Claude Code folder is not a Desktop install. Other agents may use different install locations.

Full install guide for Claude, Cursor, and Codex →

Try a starter prompt

After installing the skill, paste this starter prompt into your agent to verify it triggers on a small task.

Starter prompt
Use the Video Editing skill for this task: Overlays: text, images, branding, lower thirds. Confirm any required inputs or files before making changes.

What supports this recommendation?

83/100 provisional content score. This measures documentation, practical detail and source signals. It is not a measured task success rate or a security certification.

Documentation
92/100
Practical detail
92/100
Source evidence
63/100
Source signals
72/100
Model compatibility evidence
  • claudeinferred

    The skill text mentions Claude or a closely associated term. This is keyword-derived compatibility; no hands-on model test is recorded.

  • chatgptuntested

    No model-specific signal or recorded compatibility test was found.

  • geminiuntested

    No model-specific signal or recorded compatibility test was found.

  • copilotuntested

    No model-specific signal or recorded compatibility test was found.

  • llamauntested

    No model-specific signal or recorded compatibility test was found.

  • perplexityuntested

    No model-specific signal or recorded compatibility test was found.

  • mistraluntested

    No model-specific signal or recorded compatibility test was found.

  • grokuntested

    No model-specific signal or recorded compatibility test was found.

Inferred compatibility is based on content signals. Check the app, its available tools and setup requirements before running a skill.

What this skill does

# Video Editing

AI-assisted editing for real footage. Not generation from prompts. Editing existing video fast.

## When to Activate

- User wants to edit, cut, or structure video footage - Turning long recordings into short-form content - Building vlogs, tutorials, or demo videos from raw capture - Adding overlays, subtitles, music, or voiceover to existing video - Reframing video for different platforms (YouTube, TikTok, Instagram) - User says "edit video", "cut this footage", "make a vlog", or "video workflow"

## Core Thesis

AI video editing is useful when you stop asking it to create the whole video and start using it to compress, structure, and augment real footage. The value is not generation. The value is compression.

## The Pipeline

For measured reference-driven work, chain `taste-distillation` into `taste-application`, then return here for the editor and final-output review. The standalone taste skills can use existing footage; generation is optional.

Before live editor or DAW changes, save a versioned project checkpoint and verify the file exists. Save and verify another checkpoint after the changes. An API readback proves the current in-memory state, not that it was saved. Keep rendered media, editable projects, and creative approval as separate states in the handoff.

For MIDI-driven audio, check pitches against the receiving rack's note mapping and audition the result; successful clip creation can still produce silence. For reconstructed projects, validate through native load and save, sort events in timeline order, verify sample links and mute states, then check and audition the exact exported audio for unintended silence. XML parsing alone does not prove that the DAW accepted every clip or produced audible output. Check a bridge's capability handshake before invoking newer commands. Do not enable upload or training-data telemetry as a side effect of a creative task; use a supported local control path when consent or capability is absent.

``` Screen Studio / raw footage → Claude / Codex → FFmpeg → Remotion → ElevenLabs / fal.ai → Descript or CapCut ```

Each layer has a specific job. Do not skip layers. Do not try to make one tool do everything.

## Layer 1: Capture (Screen Studio / Raw Footage)

Collect the source material: - **Screen Studio**: polished screen recordings for app demos, coding sessions, browser workflows - **Raw camera footage**: vlog footage, interviews, event recordings - **Desktop capture via VideoDB**: session recording with real-time context (see `videodb` skill)

Output: raw files ready for organization.

## Layer 2: Organization (Claude / Codex)

Use Claude Code or Codex to: - **Transcribe and label**: generate transcript, identify topics and themes - **Plan structure**: decide what stays, what gets cut, what order works - **Identify dead sections**: find pauses, tangents, repeated takes - **Generate edit decision list**: timestamps for cuts, segments to keep - **Scaffold FFmpeg and Remotion code**: generate the commands and compositions

``` Example prompt: "Here's the transcript of a 4-hour recording. Identify the 8 strongest segments for a 24-minute vlog. Give me FFmpeg cut commands for each segment." ```

This layer is about structure, not final creative taste.

## Layer 3: Deterministic Cuts (FFmpeg)

FFmpeg handles the boring but critical work: splitting, trimming, concatenating, and preprocessing.

### Extract segment by timestamp

```bash ffmpeg -i raw.mp4 -ss 00:12:30 -to 00:15:45 -c copy segment_01.mp4 ```

### Batch cut from edit decision list

```bash #!/bin/bash # cuts.txt: start,end,label while IFS=, read -r start end label; do ffmpeg -i raw.mp4 -ss "$start" -to "$end" -c copy "segments/${label}.mp4" done < cuts.txt ```

### Concatenate segments

```bash # Create file list for f in segments/*.mp4; do echo "file '$f'"; done > concat.txt ffmpeg -f concat -safe 0 -i concat.txt -c copy assembled.mp4 ```

### Create proxy for faster editing

```bash ffmpeg -i raw.mp4 -vf "scale=960:-2" -c:v libx264 -preset ultrafast -crf 28 proxy.mp4 ```

### Extract audio for transcription

```bash ffmpeg -i raw.mp4 -vn -acodec pcm_s16le -ar 16000 audio.wav ```

### Normalize audio levels

```bash ffmpeg -i segment.mp4 -af loudnorm=I=-16:TP=-1.5:LRA=11 -c:v copy normalized.mp4 ```

## Layer 4: Programmable Composition (Remotion)

Remotion turns editing problems into composable code. Use it for things that traditional editors make painful:

### When to use Remotion

- Overlays: text, images, branding, lower thirds - Data visualizations: charts, stats, animated numbers - Motion graphics: transitions, explainer animations - Composable scenes: reusable templates across videos - Product demos: annotated screenshots, UI highlights

### Basic Remotion composition

```tsx import { AbsoluteFill, Sequence, Video, useCurrentFrame } from "remotion";

export const VlogComposition: React.FC = () => { const frame = useCurrentFrame();

return ( <AbsoluteFill> {/* Main footage */} <Sequence from={0} durationInFrames={300}> <Video src="/segments/intro.mp4" /> </Sequence>

{/* Title overlay */} <Sequence from={30} durationInFrames={90}> <AbsoluteFill style={{ justifyContent: "center", alignItems: "center", }}> <h1 style={{ fontSize: 72, color: "white", textShadow: "2px 2px 8px rgba(0,0,0,0.8)", }}> The AI Editing Stack </h1> </AbsoluteFill> </Sequence>

{/* Next segment */} <Sequence from={300} durationInFrames={450}> <Video src="/segments/demo.mp4" /> </Sequence> </AbsoluteFill> ); }; ```

### Render output

```bash npx remotion render src/index.ts VlogComposition output.mp4 ```

See the [Remotion docs](https://www.remotion.dev/docs) for detailed patterns and API reference.

## Layer 5: Generated Assets (ElevenLabs / fal.ai)

Generate only what you need. Do not generate the whole video.

### Voiceover with ElevenLabs

```python import os import requests

resp = requests.post( f"https://api.elevenlabs.io/v1/text-to-speech/{voice_id}", headers={ "xi-api-key": os.environ["ELEVENLABS_API_KEY"], "Content-Type": "application/json" }, json={ "text": "Your narration text here", "model_id": "eleven_turbo_v2_5", "voice_settings": {"stability": 0.5, "similarity_boost": 0.75} } ) with open("voiceover.mp3", "wb") as f: f.write(resp.content) ```

### Music and SFX with fal.ai

Use the `fal-ai-media` skill for: - Background music generation - Sound effects (ThinkSound model for video-to-audio) - Transition sounds

### Generated visuals with fal.ai

Use for insert shots, thumbnails, or b-roll that doesn't exist: ``` generate(app_id: "fal-ai/nano-banana-pro", input_data: { "prompt": "professional thumbnail for tech vlog, dark background, code on screen", "image_size": "landscape_16_9" }) ```

### VideoDB generative audio

If VideoDB is configured: ```python voiceover = coll.generate_voice(text="Narration here", voice="alloy") music = coll.generate_music(prompt="lo-fi background for coding vlog", duration=120) sfx = coll.generate_sound_effect(prompt="subtle whoosh transition") ```

## Layer 6: Final Polish (Descript / CapCut)

The last layer is human. Use a traditional editor for: - **Pacing**: adjust cuts that feel too fast or slow - **Captions**: auto-generated, then manually cleaned - **Color grading**: basic correction and mood - **Final audio mix**: balance voice, music, and SFX levels - **Export**: platform-specific formats and quality settings

This is where taste lives. AI clears the repetitive work. You make the final calls.

## Social Media Reframing

Different platforms need different aspect ratios:

| Platform | Aspect Ratio | Resolution | |----------|-------------|------------| | YouTube | 16:9 | 1920x1080 | | TikTok / Reels | 9:16 | 1080x1920 | | Instagram Feed | 1:1 | 1080x1080 | | X / Twitter | 16:9 or 1:1 | 1280x720 or 720x720 |

### Reframe with FFmpeg

```bash # 16:9 to 9:16 (center crop) ffmpeg -i input.mp4 -vf "crop=ih*9/16:ih,scale=1080:1920" vertical.mp4

# 16:9 to 1:1 (center crop) ffmpeg -i input.mp4 -vf "crop=ih:ih,scale=1080:1080" square.mp4 ```

### Reframe with VideoDB

```python from videodb import ReframeMode

# Smart reframe (AI-guided subject tracking) reframed = video.reframe(start=0, end=60, target="vertical", mode=ReframeMode.smart) ```

## Scene Detection and Auto-Cut

### FFmpeg scene detection

```bash # Detect scene changes (threshold 0.3 = moderate sensitivity) ffmpeg -i input.mp4 -vf "select='gt(scene,0.3)',showinfo" -vsync vfr -f null - 2>&1 | grep showinfo ```

### Silence detection for auto-cut

```bash # Find silent segments (useful for cutting dead air) ffmpeg -i input.mp4 -af silencedetect=noise=-30dB:d=2 -f null - 2>&1 | grep silence ```

### Highlight extraction

Use Claude to analyze transcript + scene timestamps: ``` "Given this transcript with timestamps and these scene change points, identify the 5 most engaging 30-second clips for social media." ```

## What Each Tool Does Best

| Tool | Strength | Weakness | |------|----------|----------| | Claude / Codex | Organization, planning, code generation | Not the creative taste layer | | FFmpeg | Deterministic cuts, batch processing, format conversion | No visual editing UI | | Remotion | Programmable overlays, composable scenes, reusable templates | Learning curve for non-devs | | Screen Studio | Polished screen recordings immediately | Only screen capture | | ElevenLabs | Voice, narration, music, SFX | Not the center of the workflow | | Descript / CapCut | Final pacing, captions, polish | Manual, not automatable |

## Key Principles

1. **Edit, don't generate.** This workflow is for cutting real footage, not creating from prompts. 2. **Structure before style.** Get the story right in Layer 2 before touching anything visual. 3. **FFmpeg is the backbone.** Boring but critical. Where long footage becomes manageable. 4. **Remotion for repeatability.** If you'll do it more than once, make it a Remotion component. 5. **Generate selectively.** Only use AI generation for assets that don't exist, not for everything. 6. **Taste is the last layer.** AI clears repetitive work. You make the final creative calls.

## Native Fusion Presets

[ITO Production v1](assets/fusion/ito-production-v1/README.md) provides restrained highlight bloom, opposing RGB spatial offsets and a luminance/edge halo. The exact files passed prior native import, save/reopen and short motion-render checks after two-source visual review. These are starting values requiring shot-specific review; the halo does not detect or track subjects.

[ITO V28](assets/fusion/ito-v28/README.md) contains preserved, native-verified Fusion graph snippets and an idempotent Lua installer. These are technical compatibility examples, **not recommended production defaults**: their documented visual limitations require tuning and taste review before use. See the bundle provenance for the scope of prior import and render checks.

## Related Skills

- `fal-ai-media` — AI image, video, and audio generation - `videodb` — Server-side video processing, indexing, and streaming - `content-engine` — Platform-native content distribution

Intended uses

  • Overlays: text, images, branding, lower thirds
  • Data visualizations: charts, stats, animated numbers
  • Motion graphics: transitions, explainer animations
  • Composable scenes: reusable templates across videos
  • Product demos: annotated screenshots, UI highlights

Implementation notes

  • Review the source instructions and adapt inputs before running the workflow.

Try it, then tell us how it went

A copied prompt does not tell us whether the task worked. Report your result after checking the output. We collect your tool and outcome, never your files or prompt.