MCP.so
Sign In

MSPaint MCP Server with AI-based Planning Algorithms

@shettysaish20

Repository

About MSPaint MCP Server with AI-based Planning Algorithms

Using Advanced AI Prompting to enhance LLM planning to solve complex math problems and draw the answer on MSPaint Canvas

#mathgpt#math-solver#math-assistant

Config

Add this server to your MCP-compatible client using the configuration below.

{
  "mcpServers": {
    "MSPaint-MCP-Server-V2": {
      "command": "python",
      "args": [
        "mcp_paint_app/mcp_client.py"
      ]
    }
  }
}

Tools

No tools detected

We auto-extract tools from the README. The maintainer can list them under a ## Tools heading to populate this section.

Overview

What is MSPaint MCP Server with AI-based Planning Algorithms?

An MCP (Model Context Protocol) server that enables an AI agent powered by Google Gemini to automate legacy Windows MSPaint. The agent solves complex multi‑step math problems and draws the final answer on the Paint canvas using tools defined via fastmcp and pywinauto. It is intended for developers and researchers exploring structured prompting and tool‑augmented AI workflows.

How to use MSPaint MCP Server with AI-based Planning Algorithms?

  1. Create a Conda environment with Python 3.11 and activate it.
  2. Install dependencies with pip install -r requirements.txt.
  3. Place your Gemini API key in a .env file as GEMINI_API_KEY=YOUR_KEY.
  4. Run the client: python mcp_paint_app/mcp_client.py.
    This starts the client, which connects to the MCP server, initializes the AI agent, and begins solving the provided math expression.

FAQ from MSPaint MCP Server with AI-based Planning Algorithms

What are the system dependencies and runtime requirements?

Python 3.11+ and Conda are recommended. Dependencies include pywin32, pywinauto, fastmcp, python-dotenv, google-genai, and rich. A Google Gemini API key is required.

What if the AI agent does not select the correct tools?

Review the system prompt in the client code; ensure tool descriptions are accurate and complete. Adjust the prompt if necessary.

How do I fix coordinate issues when drawing in MSPaint?

Coordinates used for clicking and drawing may need adjustment based on your screen resolution and window size. Use the debugging print statements in the code to identify and set the correct values.

What should I do if I encounter permission errors?

Try running

Frequently asked questions

What are the system dependencies and runtime requirements?

Python 3.11+ and Conda are recommended. Dependencies include `pywin32`, `pywinauto`, `fastmcp`, `python-dotenv`, `google-genai`, and `rich`. A Google Gemini API key is required.

What if the AI agent does not select the correct tools?

Review the system prompt in the client code; ensure tool descriptions are accurate and complete. Adjust the prompt if necessary.

How do I fix coordinate issues when drawing in MSPaint?

Coordinates used for clicking and drawing may need adjustment based on your screen resolution and window size. Use the debugging print statements in the code to identify and set the correct values.

What should I do if I encounter permission errors?

Try running

Comments

Basic information

Category

Reasoning

Transports

stdio

Author

shettysaish20

More Reasoning MCP servers

Task Planner MCP Server

CaptainCrouton89

An MCP (Model Context Protocol) server that helps AI assistants (like Claude) break down complex tasks into manageable steps, track progress, and manage a hierarchical task list.

13

AWorld: Advancing Agentic AI

inclusionAI

Search, understand, reproduce, and improve an idea with ease

1.2K

Proplan Mcp

King-Proplan

MCP server that gives Claude persistent project memory — roadmap, session history, and codebase context. Type continue and Claude picks up exactly where you left off

5

Deno Sandbox MCP Server

bewt85

An MCP server that allows you to run TypeScript, JavaScript, and Python code in a sandbox on your local machine using the Deno® sandbox. This server provides a controlled environment for executing code with explicit permission controls.

13

MCP Sandbox

danstarns

Turn any JavaScript module into a sandboxed MCP (Model Context Protocol) server with automatic reflection and type inference.

5