desktop-computer-automation
Visual desktop automation for macOS, Windows, and Linux using AI vision models and natural language prompts.
Install
npx skills add https://github.com/web-infra-dev/midscene-skills --skill desktop-computer-automationStats
| Total installs | 1,504 |
| Weekly installs | 1.5K |
| GitHub stars | 152 |
| First seen | Mar 6, 2026 |
| Source | @web-infra-dev/midscene-skills |
Summary
- Controls macOS, Windows, and Linux desktops entirely from visual input; no DOM or accessibility labels required
- Operates synchronously with a screenshot-analyze-act loop: connect, observe screen state, execute high-level actions via natural language prompts, then disconnect
- Requires a vision-capable AI model (Gemini, Qwen, Doubao, or similar) configured via environment variables; supports multiple model providers and OpenRouter
- Takes over the user's mouse and keyboard during execution; best suited for desktop-native apps (Electron, Qt, native UIs) that cannot run headless; web apps should use Browser Automation instead
Tags
Related skills
| Skill | Installs | vs desktop-computer-automation |
|---|---|---|
| elite-powerpoint-designer | 1,556 | +52 |
| meta-tags-optimizer | 1,509 | +5 |
| screenshot | 1,514 | +10 |
| derivatives-trading-usds-futures | 1,469 | -35 |
| chinese-novelist | 1,409 | -95 |
FAQ
- How many installs does desktop-computer-automation have?
- desktop-computer-automation has 1,504 total installs and 1.5K installs this week.
- Where is desktop-computer-automation hosted?
- desktop-computer-automation is published by @web-infra-dev/midscene-skills at https://github.com/web-infra-dev/midscene-skills.
- How many GitHub stars does desktop-computer-automation have?
- desktop-computer-automation has 152 GitHub stars.
- When was desktop-computer-automation first indexed?
- OrangeBot.AI first indexed desktop-computer-automation on Mar 6, 2026.
- How do I install desktop-computer-automation?
- Run: npx skills add https://github.com/web-infra-dev/midscene-skills --skill desktop-computer-automation