Silicon Grounder MCP Server Specification

Silicon Grounder communicates over standard I/O (stdio) using the Model Context Protocol (MCP) JSON-RPC 2.0 schema.

---

1. Exposed Tools

ground_screen_element

Locates a target UI element on screen using natural language and returns exact bounding box coordinates.

{
  "name": "ground_screen_element",
  "description": "Locate an interactive UI component by visual query",
  "parameters": {
    "type": "object",
    "properties": {
      "query": {"type": "string", "description": "e.g. 'Submit button in the lower right'"}
    },
    "required": ["query"]
  }
}

read_screen_region

Performs localized OCR using the Apple Vision framework and returns recognized strings.