OpenTake

Table of Contents

• About
• Why OpenTake
• Competitive Edge
• Features
• Platforms
• Rust Workspace
• Architecture
• Docs
• Quick Start
• Version History
• Community
• License

---

📖 About

OpenTake is a cross-platform video production engine built on Rust + Tauri 2, running on macOS / Windows / Linux, designed to deeply integrate AI Agents into professional video editing workflows.

🌟 Core Innovation: Instead of making the Agent parse lengthy skill documents, OpenTake actively pushes editing guidance (Context Signal) to the Agent — telling it exactly what each track does, how each clip should be cut, and what rules apply at every stage.

Positioning

OpenTake is not a replacement for CapCut / DaVinci Resolve / Final Cut Pro — it's a video engine designed for AI Agent workflows. Traditional editors are built for humans; OpenTake is built for humans and Agents, with its timeline, preview, and keyframe systems natively controllable via the MCP protocol.

---

🎯 Why OpenTake

Pain Point	Traditional Approach	OpenTake Approach
Agent doesn't know how to edit	Agent reads skill docs on its own	Software pushes Context Signal — "this track is A-roll, cut with talking-head rhythm"
Cross-platform needs 3 codebases	macOS: Swift/AVFoundation, Windows: C++/DirectShow	Single Rust codebase, FFmpeg + wgpu, identical experience on all 3 platforms
I want to use my own AI keys	Locked into vendor cloud services	BYOK — direct to fal.ai / Replicate / OpenAI, zero backend, zero ops cost
Agent can chat but can't act	CLI agent reads text output	MCP Server with 31 tools — Agent directly runs add_clips / split_clip / set_keyframes
Rewriting prompts for every video type	"You are editing a product review..." every time	Workflow Plugin System: review/tutorial/gaming/wedding, each pre-packaged with methodology
Steep learning curve for new tools	Complex UI, long onboarding	Agent operates for you — just say "edit this interview into a 3-minute highlight"

---

⚡ Competitive Edge

Dimension	CapCut	DaVinci Resolve	Final Cut Pro	OpenTake
Agent-Native Integration	❌	❌	❌	✅ MCP 31 tools + Context Signal
Cross-Platform	✅ macOS / Win	✅ macOS / Win / Linux	❌ macOS only	✅ macOS / Win / Linux
BYOK AI Generation	Paid templates	❌	❌	✅ Direct fal.ai / Replicate / OpenAI
Local Transcription	❌ Cloud-only	❌ Plugins needed	❌ Plugins needed	✅ whisper-rs on-device
Local Semantic Search	❌	❌	❌	✅ SigLIP2 + Ort on-device
Workflow Plugins	❌ Fixed templates	❌	❌	✅ JSON+MD community plugins
Open Source	❌	❌	❌	✅ GPL-3.0
Agent-Controllable Keyframes	❌	❌	❌	✅ All 6 kf tracks via MCP

---

✨ Features

🧠 Agent Context Signal System

The software pushes editing guidance to the Agent, instead of making the Agent parse documentation.

Every MCP tool response carries a context_signal:

• Auto Genre Detection: talking-head / vlog / montage / interview / short-drama / long-form
• Track Role Annotation: A-roll / B-roll / voiceover / BGM / SFX / text
• Real-time Rule Checking: breathing-point rules, B-roll five cautions, clock theory, peak-detection pacing

Knowledge source: ClipSkills — 12-volume professional editing knowledge base (MIT-licensed).

📖 Context Signal Design

🔌 MCP Server — 31 Tools

Full MCP server at 127.0.0.1:19789. Agents control the timeline directly:

Group	Count	Key Tools
Read / Introspect	7	get_timeline, get_media, inspect_media, search_media
Timeline Edit	11	add_clips, split_clip, set_clip_properties, set_keyframes, ripple_delete_ranges
Generate / Import	5	generate_video, generate_image, generate_audio, import_media
Library	7	create_folder, move_to_folder, rename_media
Resources	2	models/video, models/image

Built-in Agent chat panel shares tool definitions and system prompt with MCP.

🎬 Cross-Platform Media Engine

Capability	Technology
Codec	FFmpeg (ffmpeg-next) — battle-tested Rust bindings
Compositor	wgpu custom compositor — multi-track layering + per-frame property sampling + affine/crop/blend
Audio Playback	cpal
Transcription	whisper-rs (word/segment timestamps)
Semantic Search	candle / ort + SigLIP2 dual-encoder

Playback routing is capability-based. Ordinary media uses WebKit playback; timelines that require supported compositing use the Rust compositor; and timelines with unsupported authored combinations fail closed instead of being shown with missing effects. Rust frames are published through a session-scoped exact /frame endpoint guarded by PublicationGate, then handed off through a two-slot retained-frame buffer. Media poster, preview, waveform, and filmstrip prewarm/cache work is project- and source-identity scoped. See the dated playback/cache QA record for the reviewed 2026-07-10/11 evidence and its artifact boundaries.

🌐 BYOK AI Generation

Bring Your Own Key: Direct connection to fal.ai / Replicate / OpenAI. Zero backend, zero operational cost. Optional self-hosted proxy.

📋 Workflow Plugin System

Community-authored JSON + Markdown plugins per video genre — review / tutorial / gaming / wedding / talking-head — each encapsulating professional editing methodology. Agent activates, methodology loads.

📖 Workflow Plugin System Design

---

🖥️ Platforms

Platform	Status	Notes
macOS (Apple Silicon + Intel)	✅ Primary dev platform	Native ARM64 + x86_64; GPU via Metal (wgpu)
Windows (10/11 x86_64)	✅ Supported	Vulkan / DX12 backend (wgpu); full Tauri 2 support
Linux (x86_64)	✅ Supported	Vulkan backend; AppImage / deb packaging
Backend / Headless	✅ Supported	Pure Rust core runs without GUI for CI / server rendering / Agent batch processing

📋 macOS ≥12.0 (Monterey), Windows ≥10 (1809+), Linux glibc ≥2.31

---

🦀 Rust Workspace

crates/
├── opentake-domain     # Timeline / Track / Clip / Keyframe — pure value semantics
├── opentake-ops        # OverwriteEngine / RippleEngine / SnapEngine — edit algorithm layer
├── opentake-project    # Project persistence / bundle / archive / export
├── opentake-media      # FFmpeg codec / thumbnails / waveform / transcription / semantic search
├── opentake-render     # wgpu compositor + text rasterizer
├── opentake-motion     # Native motion fallback: RGBA frame cache / alpha source scaffold
├── opentake-agent      # MCP Server + Agent chat + context signal system
├── opentake-gen        # Generative AI clients (fal.ai / Replicate / OpenAI)
├── opentake-core       # Session management / DI / event bus
└── src-tauri           # Tauri 2 desktop shell

Planned external plugin:

plugins/
└── motion-canvas-studio # Motion Canvas (MIT) fork/plugin for AI animation video output

> cargo build --workspace   # Build all crates
> cargo test --workspace    # Test all crates (≥80% coverage target)

---

🏗️ Architecture

┌──────────────────────────────────────────────────────┐
│ React + TypeScript Frontend                          │
│ TimelineView · Preview · Inspector · MediaPanel      │
│ Zustand: read-only Timeline mirror + UI-only state   │
└────────────────────┬─────────────────────────────────┘
                     │ Tauri invoke + event
┌────────────────────▼─────────────────────────────────┐
│ 🦀 Rust Core — Source of Truth                       │
│                                                      │
│  opentake-domain    Timeline / Track / Clip / KF     │
│  opentake-ops       EditCommand apply / Undo         │
│  opentake-project   Bundle / Archive / Export         │
│  opentake-render    wgpu Compositor + Text Raster    │
│  opentake-media     FFmpeg / Waveform / Transcribe   │
│  opentake-agent     MCP Server + Chat + Signals      │
│  opentake-gen       fal.ai / Replicate / OpenAI      │
│  opentake-core      Session / DI / Events             │
│                                                      │
│         ▲                          │                 │
│   MCP Server (:19789)      invokes ▼                 │
│   In-app Agent Chat   FFmpeg + wgpu + cpal + whisper │
└──────────────────────────────────────────────────────┘

📖 Architecture Docs

---

📚 Docs

Document	Content
ARCHITECTURE.md	Target architecture, layering, crate layout, command layer, render pipeline
ROADMAP.md	Phase 0–10 roadmap with verification criteria and risk register
MODULE-PORT-MAP.md	20 upstream module port specs with core algorithms
AGENT-CONTEXT-SIGNAL.md	Agent Context Signal system design
WORKFLOW-PLUGIN-SYSTEM.md	Workflow Plugin System (JSON + Markdown)
ADVANCED-FEATURES.md	Advanced features vs CapCut
CAPCUT-GAP.md	33-item gap analysis vs CapCut
DECISIONS.md	Tech stack / license / branding ADRs
PORT-1TO1-GAP.md	1:1 port gap analysis

---

---

🔗 Upstream Reference

When porting editing logic, compare against the original Palmier Pro Swift source:

# Clone upstream alongside OpenTake (sibling directory)
cd ..
git clone https://github.com/palmier-io/palmier-pro.git palmier-pro-upstream
cd OpenTake

Expected layout:

PRIMARY-CN/
├── OpenTake/                  # This repo
└── palmier-pro-upstream/      # Upstream Swift source (GPL-3.0)

Key files for comparison:

Module	Upstream (Swift)	OpenTake (Rust/TS)
Timeline models	Sources/PalmierPro/Models/Timeline.swift	crates/opentake-domain/src/timeline.rs
Clip model	`Sources/PalmierPro/Models/Timeline.swi