gramps 3a56807ee3 fix(media): pace clip audio to a deadline too, and prove the keyed layer in the OUTPUT ...

Two follow-ups from the creator's lip-sync observation.

1. Audio still slept a fixed 50 ms per chunk — the same "sleep on top of the work" fault fixed for
   video an hour ago, left in place. Every chunk's read cost was added, so a clip's audio fell
   progressively behind its picture: small per chunk, unbounded over a long clip. It now uses the
   same deadline pacer, so audio and video advance on the same wall clock.

2. The preview pane is NOT the compositor. "Preview looks great" proves the decode and the preview
   bitmap; the recording and stream are blitted by SceneCompositor. `MediaCompositeOutputTests`
   renders a keyed video layer over a background through the real compositor and asserts the two
   things that matter: keyed (alpha 0) pixels let the background through, and the subject half
   covers it. So "green screen removed" is now proven in the output path, not just the pane.

Also: a round-clipped video layer had no preview trigger (only webcam+Round existed), so it would
render in the output and be invisible in the pane. Same unit-circle path now covers it.

Tests: 16 scoped (pacer, real-clip rate + keying, composite output, decode pacing, alert pacing)
green. FULL SUITE NOT RUN — the machine is in use: two runs under load aborted in the WPF test host
(HWND subclass crash) and one hit the 15-minute cap. Re-run scripts/verify.sh in a quiet window.

2026-11-05 10:40:25 -08:00

..

Audio

feat(media): play the clip's soundtrack and share one decode pipe

2026-11-05 07:54:06 -08:00

BackgroundEffects

feat(blur): a privacy blur layer for the Live scene — boxes and circles over the desktop

2026-11-01 09:55:04 -08:00

Compositor

feat(text): composite shared text rasters in output

2026-11-04 15:01:47 -08:00

Encoder

feat(record): fragment the MP4 so a crash cannot destroy the whole take

2026-11-05 08:58:48 -08:00

Entitlement

feat(entitlement): gate 60 fps output through Steam

2026-11-04 12:14:46 -08:00

AlertClipDecoder.cs

feat(chroma): opt-in auto key, and alert clips key like any other clip

2026-11-05 08:20:33 -08:00

AlertOverlayLayer.cs

feat(ui): color and acknowledge pinned log errors

2026-11-02 18:17:18 -08:00

AlertRenderer.cs

design: the on-stream graphics join the standard (OutputPalette)

2026-10-30 09:30:56 -07:00

CameraDeviceInfo.cs

TASK 3 milestone 1: webcam capture (MediaCapture CPU-first, CameraManager refcount, picker, clip/mirror, schema v2, tests)

2026-08-06 14:35:34 -07:00

CameraManager.cs

feat(ui): color and acknowledge pinned log errors

2026-11-02 18:17:18 -08:00

CaptureInterop.cs

Screen backdrop (schema v5/v6) + five-scene catalog + webcam polish: live desktop/game capture as a permanent non-deletable bottom layer (Source.IsBackdrop), auto full-screen game detection (Win32FullScreenDetector) else primary display, GraphicsCapturePicker re-designation, refcounted shared ScreenCaptureManager, Live-only backdrop by policy (HasBackdrop + v5-v6 backfill + EnforceBackdropPolicy, checkbox gone), SceneCatalog (Starting/Live/BRB/Chat/Ending) with + button re-adding missing scenes, webcam mid-session transparent-container fix (GetPreviewBitmap propagation), Chat half-screen-area cap, 'Add Webcam' always opens the picker (SwapWebcamIdentityAsync, no silent resurrect), WindowsRuntimeMarshal frame-read + 5s-throttled errors, docs updated, tests (65 passing)

2026-08-07 14:15:50 -07:00

ChannelStatsService.cs

feat(ui): color and acknowledge pinned log errors

2026-11-02 18:17:18 -08:00

ChatBoxRenderer.cs

feat(ui): Show Desktop toggle, avatar login, chat preview, backdrop seeding, border animations

2026-08-20 18:02:41 -07:00

ChatOverlayLayer.cs

fix(pump): slice 7 — take the loop off the UI thread (the 'wait 10ms after render 22ms' contradiction resolved)

2026-09-04 12:16:20 -07:00

ChromaKeyDetector.cs

fix(preview): draw video layers, unlink Play from Loop, geometry last

2026-11-05 09:38:18 -08:00

ChromaProbe.cs

feat(chroma): offer to remove a green or blue screen, and key it in the decode

2026-11-05 08:15:32 -08:00

Direct3D11Helper.cs

Screen backdrop (schema v5/v6) + five-scene catalog + webcam polish: live desktop/game capture as a permanent non-deletable bottom layer (Source.IsBackdrop), auto full-screen game detection (Win32FullScreenDetector) else primary display, GraphicsCapturePicker re-designation, refcounted shared ScreenCaptureManager, Live-only backdrop by policy (HasBackdrop + v5-v6 backfill + EnforceBackdropPolicy, checkbox gone), SceneCatalog (Starting/Live/BRB/Chat/Ending) with + button re-adding missing scenes, webcam mid-session transparent-container fix (GetPreviewBitmap propagation), Chat half-screen-area cap, 'Add Webcam' always opens the picker (SwapWebcamIdentityAsync, no silent resurrect), WindowsRuntimeMarshal frame-read + 5s-throttled errors, docs updated, tests (65 passing)

2026-08-07 14:15:50 -07:00

FfmpegDecodeProcess.cs

TASK 21 Increment B: FFmpeg rawvideo video decoder -> VideoFrame

2026-08-31 18:57:29 -07:00

FfmpegFrameRateParser.cs

TASK 21 slice 2a: native-FPS probe seam (ffprobe parse + derive sibling)

2026-08-31 19:45:48 -07:00

FrameRateProbe.cs

TASK 21 slice 2a: native-FPS probe seam (ffprobe parse + derive sibling)

2026-08-31 19:45:48 -07:00

FrameRingBuffer.cs

perf(capture): overlap GPU readbacks with monotonic publish gate (slice 17)

2026-09-14 18:40:20 -07:00

GlobalHotkeys.cs

TASK 20 step 2: hotkey config UI + modifier chord persistence + conflict detection

2026-08-26 06:48:14 -07:00

HotkeyChord.cs

TASK 20 step 2: hotkey config UI + modifier chord persistence + conflict detection

2026-08-26 06:48:14 -07:00

ICameraEnumerator.cs

TASK 3 milestone 1: webcam capture (MediaCapture CPU-first, CameraManager refcount, picker, clip/mirror, schema v2, tests)

2026-08-06 14:35:34 -07:00

ICameraFrameSource.cs

Webcam resource validation + first-frame proof + CameraConflictProbe: MediaCaptureFrameSource validates post-init (VideoDeviceId match, stream properties, reader StartAsync status), subscribes Failed/CameraStreamStateChanged → SourceFailed; CameraManager.AcquireAsync requires first-frame proof (4s timeout) — silent empty box impossible; MainViewModel surfaces WebcamError chip + MessageBox with suspect-app names; fallback ladder VideoPreview → VideoRecord; 19041 SDK projection gaps documented; AGENTS.md + schema.md + HANDOFF.md memory-map rules added; 81 tests passing, 0 warnings

2026-08-12 07:21:15 -07:00

IDecodeProcess.cs

TASK 21 Increment B: FFmpeg rawvideo video decoder -> VideoFrame

2026-08-31 18:57:29 -07:00

IFullScreenDetector.cs

feat(ui): Show Desktop toggle, avatar login, chat preview, backdrop seeding, border animations

2026-08-20 18:02:41 -07:00

IMediaFrameSource.cs

feat(media): play the clip's soundtrack and share one decode pipe

2026-11-05 07:54:06 -08:00

IMicrophoneEnumerator.cs

Mic audio UX: realtime read-only meter + mic picker

2026-08-07 17:44:16 -07:00

index.md

fix(text): show selected formatting and style controls

2026-11-04 17:05:06 -08:00

INotificationService.cs

Toasts: non-blocking notifications replace MessageBoxes + log-only failures (TASK 24)

2026-08-23 12:25:04 -07:00

IScreenCaptureSource.cs

Screen backdrop (schema v5/v6) + five-scene catalog + webcam polish: live desktop/game capture as a permanent non-deletable bottom layer (Source.IsBackdrop), auto full-screen game detection (Win32FullScreenDetector) else primary display, GraphicsCapturePicker re-designation, refcounted shared ScreenCaptureManager, Live-only backdrop by policy (HasBackdrop + v5-v6 backfill + EnforceBackdropPolicy, checkbox gone), SceneCatalog (Starting/Live/BRB/Chat/Ending) with + button re-adding missing scenes, webcam mid-session transparent-container fix (GetPreviewBitmap propagation), Chat half-screen-area cap, 'Add Webcam' always opens the picker (SwapWebcamIdentityAsync, no silent resurrect), WindowsRuntimeMarshal frame-read + 5s-throttled errors, docs updated, tests (65 passing)

2026-08-07 14:15:50 -07:00

IWindowEnumerator.cs

feat(backdrop): Capture Window… in-app window pin (TASK 38, Good Dog ONE test)

2026-09-22 07:00:47 -07:00

LayoutStore.Assets.cs

refactor: split LayoutStore by concern — 500-limit Phase 3, Commit E

2026-08-31 09:10:17 -07:00

LayoutStore.cs

refactor: split LayoutStore by concern — 500-limit Phase 3, Commit E

2026-08-31 09:10:17 -07:00

LayoutStore.Load.cs

feat(chroma): offer to remove a green or blue screen, and key it in the decode

2026-11-05 08:15:32 -08:00

LayoutStore.Migrations.cs

feat(chroma): offer to remove a green or blue screen, and key it in the decode

2026-11-05 08:15:32 -08:00

LayoutStore.Save.cs

feat(chroma): offer to remove a green or blue screen, and key it in the decode

2026-11-05 08:15:32 -08:00

LayoutStore.Settings.cs

feat(chroma): opt-in auto key, and alert clips key like any other clip

2026-11-05 08:20:33 -08:00

LayoutStore.Ypp.cs

feat(ypp): YPP journey tracker slice 1 — the YPP pull-out below Stream Settings (TASK 39, Good Dog ONE test)

2026-09-22 08:07:54 -07:00

LiveBroadcastFormViewModel.cs

Update Broadcast button: diff before push, offline=local only, live=API; Go Live empty-field prompt

2026-08-25 17:25:25 -07:00

MediaCaptureCameraEnumerator.cs

TASK 3 milestone 1: webcam capture (MediaCapture CPU-first, CameraManager refcount, picker, clip/mirror, schema v2, tests)

2026-08-06 14:35:34 -07:00

MediaCaptureFrameSource.cs

UNIT 0: make a dropped webcam frame measurable, not just inferable

2026-10-05 11:10:22 -07:00

MediaVideoSource.cs

feat(chroma): offer to remove a green or blue screen, and key it in the decode

2026-11-05 08:15:32 -08:00

MediaVideoSourceManager.cs

fix(media): a played-out clip can play again; play button beside the Video File label

2026-11-05 09:15:30 -08:00

MicrophoneDeviceInfo.cs

Mic audio UX: realtime read-only meter + mic picker

2026-08-07 17:44:16 -07:00

MonotonicGate.cs

perf(capture): overlap GPU readbacks with monotonic publish gate (slice 17)

2026-09-14 18:40:20 -07:00

NotificationService.cs

design: the last VM-side colours come from tokens (ThemeBrush)

2026-10-30 09:58:52 -07:00

PolarLicenseService.cs

TASK 10: Polar billing + Velopack auto-updates (steps 1-7)

2026-08-21 08:18:52 -07:00

RawVideoFrameReader.cs

fix(media): play at the clip's real rate — the pipe was copying a frame per read

2026-11-05 09:57:07 -08:00

RecordingFile.cs

fix: millisecond segment in the recording filename so two instances can't clobber a take

2026-09-27 15:37:46 -07:00

SceneGraph.cs

Per-element composite timing + scene dump (measurement only)

2026-10-16 18:23:20 -07:00

ScreenCaptureFrameSource.cs

perf(capture): overlap GPU readbacks with monotonic publish gate (slice 17)

2026-09-14 18:40:20 -07:00

ScreenCaptureManager.cs

feat(ui): color and acknowledge pinned log errors

2026-11-02 18:17:18 -08:00

ScreenCaptureSourceFactory.cs

feat(backdrop): Capture Window… in-app window pin (TASK 38, Good Dog ONE test)

2026-09-22 07:00:47 -07:00

SocialValidator.cs

Control Surface UX: pill toggle, background rename, per-scene properties

2026-08-22 18:10:59 -07:00

StreamHealthReporter.cs

TASK 5 items 1-3: reusable stream, health banner, docs refresh

2026-08-16 17:48:37 -07:00

TestSessionViewModel.cs

feat(alerts): TASK 43 — native events & alerts (six unique animations) + chat parity

2026-09-24 08:27:00 -07:00

TextOverlayRenderer.cs

fix(text): show selected formatting and style controls

2026-11-04 17:05:06 -08:00

TransitionService.cs

Transitions: Wipe (left-to-right reveal), added to the App Settings picker

2026-10-27 09:12:59 -07:00

VideoClipPipe.cs

fix(media): pace clip audio to a deadline too, and prove the keyed layer in the OUTPUT

2026-11-05 10:40:25 -08:00

VideoFilterChain.cs

feat(chroma): detect a green or blue screen and build the key filter

2026-11-05 08:05:18 -08:00

VideoFrame.cs

alert ticker: draw it inside the Stream Alerts box, not as a top-edge bar

2026-09-27 09:43:26 -07:00

WebCaptureFrameSource.cs

feat: web sources frame-captured via composition (CoreWebView2CompositionController → Windows.Graphics.Capture); PNG poll + CaptureScheduler deleted

2026-09-14 16:14:00 -07:00

WebView2Manager.cs

dev-only: per-instance state so two LlamaCasty instances can run side by side

2026-09-27 08:56:12 -07:00

Win32FullScreenDetector.cs

feat(ui): Show Desktop toggle, avatar login, chat preview, backdrop seeding, border animations

2026-08-20 18:02:41 -07:00

Win32WindowEnumerator.cs

feat(backdrop): Capture Window… in-app window pin (TASK 38, Good Dog ONE test)

2026-09-22 07:00:47 -07:00

WinRtMicrophoneEnumerator.cs

Mic audio UX: realtime read-only meter + mic picker

2026-08-07 17:44:16 -07:00

YouTubeAuthService.cs

feat(scoreboard): unit 9 — the Analytics scope, requested incrementally

2026-10-30 14:42:40 -07:00

YouTubeChatService.cs

fix(chat): stop painting what YouTube removed, and retire the local word filter

2026-11-05 08:39:46 -08:00

YouTubeStreamService.cs

feat(ui): color and acknowledge pinned log errors

2026-11-02 18:17:18 -08:00

YppTrackerViewModel.cs

fix(ypp): refresh 403'd on every real call — drop the auditDetails part (needs a partner scope)

2026-09-23 16:45:56 -07:00