Computer Use MCP Server

Local MCP server for desktop automation: mouse, keyboard, screen, windows, and processes.

Local serverstdioGo

What is the Computer Use MCP server?

Local MCP server for desktop automation: mouse, keyboard, screen, windows, and processes. That is what the computer use mcp server brings to an AI assistant: the same capability, reachable through the Model Context Protocol rather than a separate app or dashboard.

The short version

MCP (Model Context Protocol) server in Go for computer automation. Uses robotgo library for desktop automation.

  • Mouse control — movement, clicks, dragging, scrolling
  • Keyboard control — key presses, text input, hotkeys
  • Screen operations — screenshots, pixel color, display information
  • Window management — move, resize, minimize/maximize
  • Process management — list processes, search, terminate
  • System utilities — system info, dialogs, delays

The tools it exposes

The server publishes 14 tools. What each one is for:

  • mouse_move — Move cursor to absolute coordinates
  • mouse_move_smooth — Smooth cursor movement (human-like)
  • mouse_move_relative — Relative cursor movement
  • mouse_get_position — Get current cursor position
  • mouse_click — Mouse click
  • mouse_click_at — Move and click
  • mouse_toggle — Press/release mouse button
  • mouse_drag — Drag operation
  • mouse_drag_smooth — Smooth drag operation
  • mouse_scroll — Scroll
  • mouse_scroll_direction — Scroll in direction
  • mouse_scroll_smooth — Smooth scroll

What it needs from you

  • Go 1.21+ - GCC compiler - X11 libraries (Linux)

Getting it running

The server ships on npm as The, so your MCP client can launch it on demand — there is no separate build step. Add the server block to your client's configuration, restart it, and the tools register themselves.

How it compares

Among the developer tooling options, the useful question is rarely "what can it do" but "what does it cost you to run" — permissions, credentials, and how much of your context its toolset consumes. Computer Use's toolset — mouse_move, mouse_move_smooth, mouse_move_relative and 11 more — is a fair guide to whether it matches your workflow. It is maintained by hightemp; worth a glance at recent repository activity before you build anything load-bearing on it.

This entry was verified against Computer Use's own documentation before publication; SyncDev keeps the directory reviewed rather than auto-generated.

Things to watch

  • It runs with your machine's permissions. That is convenient and also the reason to think about what you point it at before you approve a tool call.
  • With 14 tools registered it takes up a noticeable share of the context window; turn it off in projects that never touch Computer Use.
  • Keep per-call confirmation enabled while you learn its behaviour; it is the cheapest safeguard you have.

Available tools

ToolWhat it does
mouse_moveMove cursor to absolute coordinates
mouse_move_smoothSmooth cursor movement (human-like)
mouse_move_relativeRelative cursor movement
mouse_get_positionGet current cursor position
mouse_clickMouse click
mouse_click_atMove and click
mouse_togglePress/release mouse button
mouse_dragDrag operation
mouse_drag_smoothSmooth drag operation
mouse_scrollScroll
mouse_scroll_directionScroll in direction
mouse_scroll_smoothSmooth scroll
key_tapKey press (with modifiers)
key_togglePress/release key

How to install the Computer Use MCP server

{
  "mcpServers": {
    "computer-use": {
      "command": "npx",
      "args": ["-y", "go-computer-use-mcp-server", "-t", "stdio"]
    }
  }
}

Configuration as documented by the project. Restart the client after saving.

Configuration

  • Go 1.21+ - GCC compiler - X11 libraries (Linux)

Example prompts to try

  • Use Computer Use to mouse move.
  • Use Computer Use to mouse move smooth.
  • Use Computer Use to mouse move relative.

Frequently asked questions

It connects Computer Use to MCP-compatible AI assistants such as Claude and Cursor, exposing 14 tools (mouse_move, mouse_move_smooth, mouse_move_relative, and more) that the assistant can call on your behalf. Instead of copying data back and forth by hand, the assistant works with Computer Use directly.