midscene
AI-powered, vision-driven UI automation for every platform.
Writing UI tests in natural language across web, iOS, and Android.
About midscene
Open-source, vision-driven UI testing — write tests in natural language, automate any platform.
Most UI automation — including AI tools that read the DOM or the accessibility tree — depends on page structure. That structure is fragile and incomplete: selectors break on every refactor, elements without semantic markup (icon-only buttons, custom controls, ) are invisible to it, native apps and cross-origin iframes are out of reach, and it cannot tell whether something actually looks right. Midscene works from the screenshot alone, and you describe each step in natural language:
Midscene is built for UI testing first, but the same vision-driven engine handles any UI automation task.
midscene is listed in this index written primarily in TypeScript, with 16k stars on GitHub. Its latest recorded repository push was in November 2026; that is not an ASE editorial review date.
