gramps/LlamaCasty
0
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

docs(media): correct the audio claim — a video file's sound is silent, not loopback-carried

Browse Source
This commit is contained in:
gramps
2026-11-05 07:22:15 -08:00
parent db563c8644
commit 776f84fb88
5 changed files with 23 additions and 11 deletions
Download Patch File Download Diff File Expand all files Collapse all files
TASKS/task-21-media-source.md
+13 -5
View File
@@ -7,7 +7,8 @@
### Status: ✅ Complete 2026-11-05 — a video file added in the (+) menu decodes, composites into the
preview and the stream, loops on the creator's toggle, and stops when the layer or its last scene
reference goes away. Audio is the desktop loopback (TRAX-style); a per-file volume route is not built.
reference goes away. **Picture only: the file's own audio is not played anywhere** (the decode pipe
passes `-an`), so a video with a soundtrack is silent on stream — the audio route is open, item 10.
1. ✅ `MediaSourceType` enum: `Video`, `Audio` (audio-only files via media source)
2. ✅ `SourceType.MediaSource` addition to the enum
@@ -24,9 +25,13 @@ reference goes away. Audio is the desktop loopback (TRAX-style); a per-file volu
when `Looping` (fresh process per pass). `MediaIsLooping` reaches the session through the manager's
per-path `loopProvider` at start and `SetLooping` on a live toggle. Rule (recorded): the path's
session loops if **any** live media reference has it on, because one decoder is shared per path.
10. ⏸ Volume control — deliberately not wired: media audio is captured by the desktop loopback like
TRAX, so a per-file slider would be a control with no audible effect. Revisit only with a local
audio route for the file's own stream.
10. ⏸ File audio + volume — **the file's soundtrack is silent everywhere today**: the decode pipe
passes `-an`, so nothing plays it and the desktop loopback has nothing to carry. Two established
routes when this is taken: **alert-style** (a second `f32le` pipe into the mixer —
`AlertClipDecoder.RunAudioAsync` is the working model, independent of desktop capture) or
**TRAX-style** (`MusicPlayer` plays it to the default device, so the loopback, the desktop fader
and ducking all apply — at the cost of a second clock to hold in sync with the video). Product
call; not started, and no volume slider until one of them exists.
11. ✅ UI: `AddMediaCommand` (+ menu → "Video File", video-filtered `OpenFileDialog`), `ChangeMediaFileCommand`
("Change…" in the properties panel), loop toggle, video name display.
12. ✅ Schema migration for media source settings (file path, loop, volume) — shipped with item 3.
@@ -36,7 +41,10 @@ reference goes away. Audio is the desktop loopback (TRAX-style); a per-file volu
### Design decisions
- **FFmpeg handles all formats** — no codec-specific code. FFmpeg already in the project.
- **Audio plays through the desktop channel** — media source audio is captured by the WASAPI loopback (like TRAX/game audio). No separate audio routing needed.
- **Audio is NOT wired, and it is not hiding behind the loopback** — `MediaVideoSource` decodes with
`-an`, so a video file's soundtrack is silent on stream today (the loopback only carries what the
machine actually plays). Item 10 records the two established routes; do not describe media as
audible until one is built.
- **This pairs with TRAX** — TRAX is background music, media source is background video. Together they make non-Live scenes (Starting/BRB/Ending) feel polished.
- **Not a full NLE** — no trimming, no multi-track, no effects. Just "play this video in the scene."
- **Layers are defined in Live first** (creator 2026-11-05): this unit adds the layer and the picker in