E2B Desktop Sandbox — Summary

E2B Desktop Sandbox is an open-source secure virtual desktop environment for LLM-based Computer Use, built on top of the E2B Sandbox API. It provides an isolated graphical desktop (Xvfb + VNC) that agents can connect to for screenshots, mouse/keyboard input, application launching, and window streaming. The SDK ships in Python (e2b-desktop) and JavaScript (@e2b/desktop), with each sandbox isolated per session and customizable with arbitrary dependencies. Startup is fast (seconds) via the E2B cloud API; no local Docker or VM setup required from the user.

E2B Desktop is most similar to the e2b framework from the seed comparison (canonical sandboxes batch), but this is the Desktop-specific surface: the base e2b package provides code execution, while e2b-desktop adds graphical environment + Computer Use capabilities on top. It differs from microsandbox and cubesandbox seeds in that it is a managed cloud API (not self-hosted), from daytona in that it is ephemeral/disposable rather than persistent dev environments, and from capsule in scope (desktop/GUI vs. code execution only).

E2B Desktop Sandbox — Overview

Origin

Built by the E2B team as an extension of the E2B Sandbox platform specifically for Computer Use (GUI automation) use cases. Powered by the E2B cloud infrastructure — the same MicroVM-based isolation used for code execution sandboxes, extended with a graphical desktop environment.

Philosophy

From the README:

"E2B Desktop Sandbox is an open source secure virtual desktop ready for Computer Use. Powered by E2B. Each sandbox is isolated from the others and can be customized with any dependencies you want."

The design philosophy is "secure + disposable": each sandbox is fully isolated, can be killed when done, and starts fresh. Desktop access is via streaming (not full RDP) to minimize bandwidth while providing real GUI control for agents.

Key Capabilities

• Screenshots: Capture desktop or specific window state
• Mouse/keyboard input: Click, type, scroll
• Application launch: desktop.launch('google-chrome'), desktop.launch('vscode'), etc.
• Window streaming: Real-time screen stream with auth key
• Process management: Run, list, kill processes
• File system: Read, write files inside sandbox

Open Computer Use

Related project e2b-dev/open-computer-use: Computer Use made with 100% open-source LLMs — uses this Desktop Sandbox.

Surf

Related project e2b-dev/surf: OpenAI Computer Use Agent using E2B's Desktop Sandbox, built as a Next.js app.

E2B Desktop Sandbox — Architecture

Distribution

• Python: pip install e2b-desktop
• JavaScript: npm install @e2b/desktop
• No self-hosting — cloud API only (requires E2B API key)

Directory Structure (Monorepo)

packages/
  python/           # e2b-desktop Python SDK
  javascript/       # @e2b/desktop JavaScript SDK
examples/
  basic-python/
  basic-javascript/
  streaming-apps-python/
  streaming-apps-javascript/
template/           # Base sandbox image definition
readme-assets/

Required Runtime

• E2B API key (E2B_API_KEY env var)
• Python >= 3.8 (for Python SDK) or Node.js (for JS SDK)
• No local Docker, no local VM setup required

Sandbox Architecture

• Base: E2B Sandbox (MicroVM via Firecracker)
• Desktop layer: Xvfb (virtual framebuffer) + VNC server
• Streaming: Authenticated stream URL per window or full desktop
• Isolation: Per-sandbox network and filesystem isolation
• Startup: Seconds (MicroVM cold start)

Install Complexity

One-liner (pip install e2b-desktop or npm install @e2b/desktop). Multi-step for E2B account + API key setup.

Target AI Tools

Any agent framework (Python or JS) — not tied to a specific AI client. Used with OpenAI, Anthropic, open-source LLMs.

Stream Architecture

Sandbox (cloud VM)
  ├── Xvfb (virtual display)
  ├── VNC server
  └── Stream auth key
        → Client-side stream URL
        → Agent screenshot/input

E2B Desktop Sandbox — Components

Python SDK (e2b_desktop)

Sandbox Class

• Sandbox.create() — Create new desktop sandbox (cloud API call)
• desktop.launch(app) — Launch application (google-chrome, vscode, firefox, etc.)
• desktop.wait(ms) — Wait for app to load
• desktop.kill() — Destroy sandbox

Stream API

• desktop.stream.start(window_id, require_auth) — Start screen stream
• desktop.stream.get_auth_key() — Get auth token for stream URL
• desktop.stream.get_url(auth_key) — Get streamable URL
• desktop.stream.stop() — Stop current stream (one stream at a time)
• desktop.get_current_window_id() — Get active window ID

Input API

• desktop.mouse.move(x, y) — Mouse move
• desktop.mouse.click(x, y) — Mouse click
• desktop.keyboard.type(text) — Type text
• desktop.keyboard.press(key) — Press key

Screenshot API

• desktop.screenshot() — Capture full desktop or window

Process API

• desktop.process.start(cmd) — Start process
• desktop.process.list() — List running processes

File API

• desktop.files.read(path) — Read file
• desktop.files.write(path, content) — Write file

JavaScript SDK (@e2b/desktop)

Mirror of Python API with async/await patterns. Same capabilities.

Templates

• template/ — Base sandbox image definition (used to customize pre-installed dependencies)

Examples

• examples/basic-python/ — Minimal create/launch/stream/kill
• examples/basic-javascript/ — Same in JS
• examples/streaming-apps-python/ — Window streaming examples
• examples/streaming-apps-javascript/ — Same in JS

E2B Desktop Sandbox — Uniqueness

Differs From Seeds

E2B Desktop is a secondary surface of the e2b canonical sandbox from Phase B Batch 18/33. The base e2b seed handles code execution; this e2b-desktop package adds a graphical desktop environment with VNC streaming for Computer Use. Compared to microsandbox (self-hosted MicroVM, code-only) and cubesandbox (lightweight container), E2B Desktop is unique in providing a full graphical display (Xvfb + VNC) with window streaming and mouse/keyboard input — the only one in the corpus targeting GUI Computer Use natively. Compared to daytona (persistent dev environments), E2B Desktop is ephemeral/disposable. The agent-infra-sandbox (this batch) offers broader surface (Browser + Shell + VSCode + MCP in one Docker container) but lacks the MicroVM isolation guarantee.

Positioning

The minimal, cloud-managed primitive for LLM Computer Use. "Bring your own agent" philosophy — E2B provides the VM, you provide the intelligence.

Observable Failure Modes

1. API key required: No offline/local mode — every sandbox creation requires E2B cloud API
2. One stream at a time: Only one window stream active per sandbox — limits parallel visual monitoring
3. No sandbox pools for Desktop: Base E2B has pool pre-warming; Desktop variant's pool support is unclear
4. Ephemeral by default: No built-in snapshot for Desktop sandboxes (base sandbox has snapshots)
5. Cost scales with usage: Cloud VM per sandbox; parallel agents get costly fast

What Makes It Interesting

Clean Computer Use primitive — the simplest possible API for giving an LLM access to a real GUI environment without local VM setup. The open-computer-use companion project demonstrates end-to-end with open-source models.