mirror of
https://github.com/harivansh-afk/deskctl.git
synced 2026-04-15 04:03:28 +00:00
rename
This commit is contained in:
parent
9adc74f6b7
commit
62a1aab859
4 changed files with 55 additions and 64 deletions
2
Cargo.lock
generated
2
Cargo.lock
generated
|
|
@ -676,7 +676,7 @@ source = "registry+https://github.com/rust-lang/crates.io-index"
|
|||
checksum = "460fbee9c2c2f33933d720630a6a0bac33ba7053db5344fac858d4b8952d77d5"
|
||||
|
||||
[[package]]
|
||||
name = "desktop-ctl"
|
||||
name = "deskctl"
|
||||
version = "0.1.0"
|
||||
dependencies = [
|
||||
"ab_glyph",
|
||||
|
|
|
|||
|
|
@ -1,9 +1,9 @@
|
|||
[package]
|
||||
name = "desktop-ctl"
|
||||
name = "deskctl"
|
||||
version = "0.1.0"
|
||||
edition = "2021"
|
||||
description = "Desktop control CLI for AI agents - screenshot, click, type, window management on Linux X11"
|
||||
license = "MIT OR Apache-2.0"
|
||||
edition = "2026"
|
||||
description = "X11 desktop control CLI for agents"
|
||||
license = "MIT"
|
||||
repository = "https://github.com/user/agent-computer"
|
||||
|
||||
[dependencies]
|
||||
|
|
|
|||
33
README.md
33
README.md
|
|
@ -1,16 +1,14 @@
|
|||
# desktop-ctl
|
||||
# deskctl
|
||||
|
||||
Desktop control CLI for AI agents on Linux X11. A single installable binary that gives agents full desktop access: screenshots with window refs, mouse/keyboard input, and window management.
|
||||
|
||||
Inspired by [agent-browser](https://github.com/vercel-labs/agent-browser) - but for the full desktop.
|
||||
Desktop control CLI for AI agents on Linux X11.
|
||||
|
||||
## Install
|
||||
|
||||
```bash
|
||||
cargo install desktop-ctl
|
||||
cargo install deskctl
|
||||
```
|
||||
|
||||
System dependencies (Debian/Ubuntu):
|
||||
System deps (Debian/Ubuntu):
|
||||
```bash
|
||||
sudo apt install libxcb-dev libxrandr-dev libclang-dev
|
||||
```
|
||||
|
|
@ -19,35 +17,28 @@ sudo apt install libxcb-dev libxrandr-dev libclang-dev
|
|||
|
||||
```bash
|
||||
# See the desktop
|
||||
desktop-ctl snapshot
|
||||
deskctl snapshot
|
||||
|
||||
# Click a window
|
||||
desktop-ctl click @w1
|
||||
deskctl click @w1
|
||||
|
||||
# Type text
|
||||
desktop-ctl type "hello world"
|
||||
deskctl type "hello world"
|
||||
|
||||
# Focus by name
|
||||
desktop-ctl focus "firefox"
|
||||
deskctl focus "firefox"
|
||||
```
|
||||
|
||||
## Architecture
|
||||
|
||||
Client-daemon architecture over Unix sockets (NDJSON wire protocol). The daemon starts automatically on first command and keeps the X11 connection alive for fast repeated calls.
|
||||
|
||||
```
|
||||
Agent -> desktop-ctl CLI (thin client) -> Unix socket -> desktop-ctl daemon -> X11
|
||||
```
|
||||
Client-daemon architecture over Unix sockets (NDJSON wire protocol).
|
||||
The daemon starts automatically on first command and keeps the X11 connection alive for fast repeated calls.
|
||||
|
||||
## Requirements
|
||||
|
||||
- Linux with X11 session
|
||||
- Rust 1.75+ (for building)
|
||||
- Rust 1.75+ (for build)
|
||||
|
||||
## Wayland Support
|
||||
|
||||
Coming in v0.2. The trait-based backend design means adding Hyprland/Wayland support is a single trait implementation with zero refactoring of the core.
|
||||
|
||||
## License
|
||||
|
||||
MIT OR Apache-2.0
|
||||
Coming soon hopefully. The trait-based backend design means adding Hyprland/Wayland support is a single trait implementation with zero refactoring of the core which is good.
|
||||
|
|
|
|||
76
SKILL.md
76
SKILL.md
|
|
@ -1,10 +1,10 @@
|
|||
---
|
||||
name: desktop-ctl
|
||||
description: Desktop control CLI for AI agents - screenshot, click, type, window management on Linux X11
|
||||
allowed-tools: Bash(desktop-ctl:*)
|
||||
name: deskctl
|
||||
description: Desktop control CLI for AI agents
|
||||
allowed-tools: Bash(deskctl:*)
|
||||
---
|
||||
|
||||
# desktop-ctl
|
||||
# deskctl
|
||||
|
||||
Desktop control CLI for AI agents on Linux X11. Provides a unified interface for screenshots, mouse/keyboard input, and window management with compact `@wN` window references.
|
||||
|
||||
|
|
@ -19,59 +19,59 @@ Desktop control CLI for AI agents on Linux X11. Provides a unified interface for
|
|||
### See the Desktop
|
||||
|
||||
```bash
|
||||
desktop-ctl snapshot # Screenshot + window tree with @wN refs
|
||||
desktop-ctl snapshot --annotate # Screenshot with bounding boxes and labels
|
||||
desktop-ctl snapshot --json # Structured JSON output
|
||||
desktop-ctl list-windows # Window tree without screenshot
|
||||
desktop-ctl screenshot /tmp/s.png # Screenshot only (no window tree)
|
||||
deskctl snapshot # Screenshot + window tree with @wN refs
|
||||
deskctl snapshot --annotate # Screenshot with bounding boxes and labels
|
||||
deskctl snapshot --json # Structured JSON output
|
||||
deskctl list-windows # Window tree without screenshot
|
||||
deskctl screenshot /tmp/s.png # Screenshot only (no window tree)
|
||||
```
|
||||
|
||||
### Click and Type
|
||||
|
||||
```bash
|
||||
desktop-ctl click @w1 # Click center of window @w1
|
||||
desktop-ctl click 500,300 # Click absolute coordinates
|
||||
desktop-ctl dblclick @w2 # Double-click window @w2
|
||||
desktop-ctl type "hello world" # Type text into focused window
|
||||
desktop-ctl press enter # Press a key
|
||||
desktop-ctl hotkey ctrl c # Send Ctrl+C
|
||||
desktop-ctl hotkey ctrl shift t # Send Ctrl+Shift+T
|
||||
deskctl click @w1 # Click center of window @w1
|
||||
deskctl click 500,300 # Click absolute coordinates
|
||||
deskctl dblclick @w2 # Double-click window @w2
|
||||
deskctl type "hello world" # Type text into focused window
|
||||
deskctl press enter # Press a key
|
||||
deskctl hotkey ctrl c # Send Ctrl+C
|
||||
deskctl hotkey ctrl shift t # Send Ctrl+Shift+T
|
||||
```
|
||||
|
||||
### Mouse Control
|
||||
|
||||
```bash
|
||||
desktop-ctl mouse move 500 300 # Move cursor to coordinates
|
||||
desktop-ctl mouse scroll 3 # Scroll down 3 units
|
||||
desktop-ctl mouse scroll -3 # Scroll up 3 units
|
||||
desktop-ctl mouse drag 100 100 500 500 # Drag from (100,100) to (500,500)
|
||||
deskctl mouse move 500 300 # Move cursor to coordinates
|
||||
deskctl mouse scroll 3 # Scroll down 3 units
|
||||
deskctl mouse scroll -3 # Scroll up 3 units
|
||||
deskctl mouse drag 100 100 500 500 # Drag from (100,100) to (500,500)
|
||||
```
|
||||
|
||||
### Window Management
|
||||
|
||||
```bash
|
||||
desktop-ctl focus @w2 # Focus window by ref
|
||||
desktop-ctl focus "firefox" # Focus window by name (substring match)
|
||||
desktop-ctl close @w3 # Close window gracefully
|
||||
desktop-ctl move-window @w1 100 200 # Move window to position
|
||||
desktop-ctl resize-window @w1 800 600 # Resize window
|
||||
deskctl focus @w2 # Focus window by ref
|
||||
deskctl focus "firefox" # Focus window by name (substring match)
|
||||
deskctl close @w3 # Close window gracefully
|
||||
deskctl move-window @w1 100 200 # Move window to position
|
||||
deskctl resize-window @w1 800 600 # Resize window
|
||||
```
|
||||
|
||||
### Utilities
|
||||
|
||||
```bash
|
||||
desktop-ctl get-screen-size # Screen resolution
|
||||
desktop-ctl get-mouse-position # Current cursor position
|
||||
desktop-ctl launch firefox # Launch an application
|
||||
desktop-ctl launch code -- --new-window # Launch with arguments
|
||||
deskctl get-screen-size # Screen resolution
|
||||
deskctl get-mouse-position # Current cursor position
|
||||
deskctl launch firefox # Launch an application
|
||||
deskctl launch code -- --new-window # Launch with arguments
|
||||
```
|
||||
|
||||
### Daemon
|
||||
|
||||
```bash
|
||||
desktop-ctl daemon start # Start daemon manually
|
||||
desktop-ctl daemon stop # Stop daemon
|
||||
desktop-ctl daemon status # Check daemon status
|
||||
deskctl daemon start # Start daemon manually
|
||||
deskctl daemon stop # Stop daemon
|
||||
deskctl daemon status # Check daemon status
|
||||
```
|
||||
|
||||
## Global Options
|
||||
|
|
@ -92,18 +92,18 @@ After `snapshot` or `list-windows`, windows are assigned short refs:
|
|||
|
||||
```bash
|
||||
# 1. See what's on screen
|
||||
desktop-ctl snapshot --annotate
|
||||
deskctl snapshot --annotate
|
||||
|
||||
# 2. Focus the browser
|
||||
desktop-ctl focus "firefox"
|
||||
deskctl focus "firefox"
|
||||
|
||||
# 3. Navigate to a URL
|
||||
desktop-ctl hotkey ctrl l
|
||||
desktop-ctl type "https://example.com"
|
||||
desktop-ctl press enter
|
||||
deskctl hotkey ctrl l
|
||||
deskctl type "https://example.com"
|
||||
deskctl press enter
|
||||
|
||||
# 4. Take a new snapshot to see the result
|
||||
desktop-ctl snapshot
|
||||
deskctl snapshot
|
||||
```
|
||||
|
||||
## Key Names for press/hotkey
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue