feat: desktop computer-use APIs with neko-based streaming

Browse source

Add desktop runtime management (Xvfb, openbox, dbus), screen capture,
mouse/keyboard input, and video streaming via neko binary extracted
from the m1k1o/neko container. Includes Docker test rig, TypeScript SDK
desktop support, and inspector Desktop tab.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

...

This commit is contained in:

Nathan Flurry 2026-03-16 17:56:39 -07:00

parent 3895e34bdb

commit 33821d8660

66 changed files with 13190 additions and 1135 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download patch file Download diff file Expand all files Collapse all files

BIN

.context/attachments/CleanShot 2026-03-08 at 18.53.28@2x.png Normal file

View file

Binary file not shown.

Side by side After Width:  |  Height:  |  Size: 110 KiB