sandbox-agent/frontend/packages/inspector
Nathan Flurry 944ad1ba55 feat: replace neko with native GStreamer WebRTC for desktop streaming
Replace the neko binary dependency with a native GStreamer pipeline
(ximagesrc -> vp8enc -> webrtcbin) for desktop video streaming. This
removes the external neko process and integrates screen capture directly
via gstreamer-rs crate bindings behind a `desktop-gstreamer` feature flag.

Key changes:
- Add desktop_gstreamer.rs with GStreamer WebRTC pipeline management
- Rewrite signaling protocol (ready/offer/answer/candidate over WS)
- Add leaky queues and videorate for low-latency streaming
- Rewrite ICE candidates to 127.0.0.1 for Docker connectivity
- Constrain UDP port range (30000-30100) via libnice agent
- Update TypeScript SDK desktop-stream.ts for new signaling
- Update inspector DesktopTab with WebRTC Live View
- Update Dockerfiles to install GStreamer dev packages

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-16 17:54:39 -07:00
..
public feat(inspector): improve session UI, skills dropdown, and visual polish (#179) 2026-02-13 05:54:53 +00:00
src feat: replace neko with native GStreamer WebRTC for desktop streaming 2026-03-16 17:54:39 -07:00
Dockerfile chore(release): update version to 0.3.0 2026-03-07 18:54:35 -08:00
index.html Add desktop runtime API and SDK support 2026-03-15 17:54:16 -07:00
package.json Add desktop runtime API and SDK support 2026-03-15 17:54:16 -07:00
tsconfig.json feat: add release pipeline for crates.io and npm publishing 2026-01-25 14:11:39 -08:00
tsconfig.node.json feat: add release pipeline for crates.io and npm publishing 2026-01-25 14:11:39 -08:00
vite.config.ts feat: replace neko with native GStreamer WebRTC for desktop streaming 2026-03-16 17:54:39 -07:00