macPilot: Seamless Automation & System Control

macPilot CLI: The open-source macOS control hub enabling AI assistants to master mouse, screenshots, text, apps, and system tasks via MCP—empowering seamless automation without limits.

Visit Repository

✨ Os Automation

4.2(165 reviews)

247 saves

115 comments

This tool saved users approximately 12613 hours last month!

About macPilot

What is macPilot: Seamless Automation & System Control?

macPilot CLI is an innovative open-source utility enabling Large Language Models (LLMs) to interact with macOS systems via the MCP protocol. This tool empowers AI assistants to execute a wide array of operations, from basic system control to advanced automation tasks, bridging the gap between human intent and machine execution with precision.

How to use macPilot: Seamless Automation & System Control?

Ensure your Mac runs macOS Sonoma 14.0+ on Apple Silicon hardware.
Download the latest binary from the official releases.
Configure your MCP-enabled app (e.g., Cursor) with the binary path in JSON format.
Grant accessibility and screen recording permissions to your chosen application.
Select a compatible model within your app and initiate commands via natural language or API.

macPilot Features

Key Features of macPilot: Seamless Automation & System Control?

System-Wide Accessibility: Manipulate mouse movements, execute shell commands, and manage applications directly.
Contextual Precision: Retrieve real-time window details, cursor positions, and clipboard interactions for task-driven workflows.
Expandable Capabilities: Leverage a robust set of tools like executeCommand for custom scripting or captureScreen for visual feedback.
Open-Source Flexibility: Modify and extend functionalities to suit specialized automation needs.

Use cases of macPilot: Seamless Automation & System Control?

From streamlining repetitive tasks to enhancing developer workflows, macPilot excels in scenarios such as:

Automating UI testing via scripted mouse clicks and window navigation.
Generating dynamic documentation with screen captures triggered by voice commands.
Deploying server scripts locally through secure shell command execution.
Creating accessibility tools for users requiring enhanced system navigation controls.

macPilot FAQ

FAQ: Common Questions about macPilot

Q: Does macPilot support non-Apple Silicon Macs?

A: Currently, only Apple Silicon-based systems are compatible due to macOS architecture requirements.

Q: Why do I need screen recording permissions?

A: This grants the tool access to visual elements for operations like captureScreen and contextual window analysis.

Q: Can I use macPilot without an LLM?

A: Yes! The CLI interface allows direct command execution for scripted or API-driven automation.

Q: How do I troubleshoot permission errors?

A: Verify your app's permissions in System Preferences > Security & Privacy and ensure the binary path is correctly configured.

Content

MacPilot CLI

MacPilot CLI is an open-source tool that enables Large Language Models (LLMs) to interact with macOS through the MCP (Model Control Protocol) protocol. It provides a collection of system tools that allow AI assistants to perform various operations on macOS systems.

Tool Documentation

Tool Name	Description	Input Parameters
`repeat`	Echo back the input text	`text`: String to repeat
`getCursorPosition`	Returns the current mouse position and screen details	None
`moveCursor`	Moves the mouse cursor to specific coordinates	`x`: X coordinate, `y`: Y coordinate
`clickMouse`	Performs a mouse click at the current cursor position	None
`pasteText`	Copies text to clipboard and pastes it	`text`: Text to paste
`captureScreen`	Takes a screenshot of the entire screen	None
`executeCommand`	Runs a shell command and returns the output	`command`: Command to execute, `args`: Optional arguments array
`launchApp`	Launches an application	`bundleId & Application identifier` or `appName & Application name`
`getAppsList`	Returns a list of installed applications	None
`getWindowsList`	Returns information about all windows	None
`getFocusedWindowInfo`	Returns information about the focused window	None
`getWindowInfo`	Returns detailed information about a window	`pid`: Optional process ID

Getting Started

You need a Mac computer with Apple Silicon running macOS 14.0 (Sonoma) or later
Download the binary file from the Releases section
Configure your MCP-compatible application (Cursor or Claude Desktop app) by adding the following configuration: json { "mcpServers": { "macPilotCli": { "command": "/path/to/downloaded/binary" } } }
Grant the necessary permissions (screen recording, accessibility) to the application you're using with MacPilot CLI. For example, if you're using Cursor, make sure Cursor has the required permissions in System Settings.
Switch to a tool-compatible model according to your application's requirements, and you're ready to use MacPilot CLI