Alibaba’s Tongyi MAI team launched Qwen-UI-Agent on 20 August 2026 — an AI agent trained to operate a device by looking at its screen, the same way a person does, rather than through app-specific APIs. It reads what’s on screen and executes clicks, swipes and multi-step actions directly, chaining together sequences of 100+ steps to complete a task. On Alibaba’s MobileWorld benchmark it scored 82.1%, ahead of GPT-5.6 Sol by 12 points and Claude Opus 4.8 by 14.6 points; on real-device testing it hit 92.2%, and 97.5% on Android-specific tasks.
What makes the benchmark credible rather than just a marketing number is the training data: over 100 real mobile devices and 150+ real applications, plus a purpose-built benchmark (MobileWorld-Real, 400+ tasks) designed to close the usual gap between simulated test environments and how apps actually behave in the wild. The system ships with safeguards around payments and other sensitive actions, which suggests Alibaba is positioning it for genuine production automation rather than a research demo.
Why this is worth watching even outside China’s AI ecosystem
Screen-operating agents are a different capability from the code-writing agents that dominate most AI coding tool coverage — this is an agent that uses an app the way an end user does, not one that edits its source. That has two practical implications for anyone building or commissioning mobile software: first, automated QA and regression testing that doesn’t depend on brittle, app-specific test scripts becomes more realistic, since a GUI agent can navigate a real UI without custom hooks. Second, in-app AI assistants that can complete multi-step tasks on a user’s behalf — booking, form-filling, navigating a complex flow — move from novelty to something benchmarked and competitive across US and Chinese labs simultaneously.
So what
Whether this specific agent ever ships inside a Western product, the benchmark result confirms screen-level automation is now a genuine, competitive capability class, not a research curiosity — worth factoring into both QA tooling decisions and product roadmaps for AI-assisted features. See our iOS & Android development work, or get in touch if you’re scoping a mobile build where AI-driven automation or testing could shape the approach.