Disclosure: this post is about a tool I sell (29 EUR one-time). Everything below works without buying it.
Earlier I wrote about building the pipeline step by step and auto-captioning clips locally. This post shows the finished version.
What it does
python clip.py episode.mp4 produces about six 9:16 clips with burned-in word captions, silence trimmed, a hook title, and optional zooms.
The parts that were harder than expected
- Cut points. Cutting on Whisper word timestamps instead of on segments stopped clips from starting mid-word. Silences longer than ~0.28 s inside a clip are dropped, with a small pad (60 ms before a word, 100 ms after) so cuts don't sound clipped.
- Choosing clips. A plain "loudest part" heuristic kills jokes because the punchline gets cut. Scoring on 7 checks (hook, standalone, one idea, payoff, energy, comment-bait, length) worked better. The optional path sends only the transcript to an LLM, roughly 5-8k tokens for 20 minutes.
-
Framing. A tight face crop looks great until two people talk. So the default is the full 16:9 frame on a blurred 9:16 canvas, and
--cropwith YuNet face-follow plus smoothing is opt-in. -
German captions. The default Whisper model is
smallfor speed. If the German captions come out wrong,--model medium --lang deforces German and is more accurate, but slower on CPU.
Limits
Windows is tested and macOS/Linux are untested. It's CLI-only, so preview everything. Free open-source alternatives (e.g. OpenShorts, Docker-based) exist, and mine is a packaged no-Docker Windows version with a German guide.
Links
- Tool (29 EUR, source included, LAUNCH40 = 40% off for the first 10 buyers until 16 Nov 23:59 CET): https://whop.com/kelvaro-creator-kits/auto-clipping-system?utm_source=devto
- Free: 7-point checklist + copy-paste FFmpeg commands: https://whop.com/kelvaro-creator-kits/gratis-clip-checkliste?utm_source=devto
Top comments (0)