filmcraft/docs
Manuel Camacho beebdbcd39 M7.12: natural Text to Speech voices (Kokoro-82M in pure Rust)
- filmcraft-tts (feature kokoro): Kokoro-82M on candle, implemented from
  the StyleTTS 2 / iSTFTNet / ALBERT papers, config.json and the
  checkpoint's tensor shapes; official .pth read with candle's restricted
  pickle reader; voice packs from their zip. Neural Voice: tts-text
  phonemize -> Kokoro per chunk -> pauses -> pitch via audio-dsp.
- catalog: 9 US English voices (model card grade C+ or better) + CMUdict,
  every file pinned to a revision and SHA-256 (336 MB).
- speech: generic download_files (same verified downloader).
- engine: tts.render (background synthesis into Session::tts_cache),
  tts.downloadVoices (background job, cancellable), voices list with
  package state; feature neural-voices (default on in the desktop app).
- ui: natural/basic voice groups, consent box (size, sources, licences),
  download progress + Cancel, synthesis never blocks the window;
  ui.set {tts:{...}} for agents.

Measured: Whisper-base WER on 50 original sentences 2.1-3.6 % for all 9
voices (built-in robotic voice 96.6 %); 2.2-2.3x real time on CPU.
Gates: fmt, clippy, layers, assets, wasm pass; tests pass except
shortcuts_tests::assign_reassigns_conflicts_and_undoes (fails on main)
and the frame pool test (flaky under load, passes alone).

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-08 06:52:30 -07:00
..
adr M-HW: NVENC on top of the shared hardware-encoding setting (#183); never-crash fixes 2026-10-07 18:16:12 -04:00
brand Licensing: standard LICENSE files, NOTICE, ArtCraft brand terms 2026-10-04 10:05:12 -04:00
images README: new hero — Apollo 11 documentary edit (public domain) 2026-10-01 11:17:08 -04:00
agents.md export: show the estimated time left of a render next to its percentage 2026-10-07 13:48:52 -06:00
architecture.md M7.12: natural Text to Speech voices (Kokoro-82M in pure Rust) 2026-10-08 06:52:30 -07:00
captions.md NEST10: the captions doc says nested captions are part of the nest's picture 2026-10-06 20:53:53 -04:00
contributing.md Fonts: the Japanese interface uses craft-fonts first; absolute CRAFT_FONTS_DIR 2026-10-06 14:26:14 -04:00
contributors.md About: contributor and model credits compiled in (grab bag + table, self-submitted names) (#215) 2026-10-07 21:16:52 -04:00
control-protocol.md Merge pull request #131 from punkhop/fix/audio-plays-ahead 2026-10-07 07:08:29 -04:00
graphics.md Graphics: only selected layers have a box, and a hidden layer has none 2026-10-07 13:24:43 -04:00
keyboard.md M12.7: Project panel and Media Browser parity 2026-10-03 02:14:31 -04:00
monitors.md M4.7: View menu and monitor view options: Paused Resolution, 1/16, High Quality Playback, Display Mode (alpha/RGB channels, comparison, multi-camera, source audio waveform, video+waveform split), Magnification with panning, rulers, guides (drag from rulers, lock, clear, Add Guide, templates in preferences), Snap in Program Monitor 2026-10-01 23:23:27 -04:00
performance.md M-HW: NVENC on top of the shared hardware-encoding setting (#183); never-crash fixes 2026-10-07 18:16:12 -04:00
project-files.md NEST14: a project reopens with its sequence tabs and their views 2026-10-06 20:23:19 -04:00
releasing.md Release: FreeBSD, Flatpak (x86_64 + aarch64) and AppImage zsync; README Downloads (#267) 2026-10-08 09:41:42 -04:00
testing.md M7.12: natural Text to Speech voices (Kokoro-82M in pure Rust) 2026-10-08 06:52:30 -07:00
transcripts.md transcripts: disabled, not failing, in builds without speech-to-text (#89, #97, #98) 2026-10-07 09:14:05 -05:00
web.md Crash and blank-screen fixes (desktop + web) 2026-10-04 00:26:19 -04:00