Google's Computer Control feature brings Rabbit R1-style automation to Android
Google is developing a new Computer Control feature that could enable automated Android app control, similar to the Rabbit R1's functionality. Here's what we know.
Google is working on a new Computer Control feature for Android, which could bring Rabbit R1-style automation to the platform. Discovered in Android 16 QPR2 Beta 2 code, this framework aims to enable trusted AI agents to control apps automatically in the background.
How It Works
The system leverages Android's Virtual Device Manager (VDM) to:
- Create isolated virtual displays for automated apps
- Stream app content to remote devices for analysis
- Inject touch/keyboard inputs without user intervention
Key technical details:
- Requires
ACCESS_COMPUTER_CONTROLpermission (restricted to Google-approved apps) - Supports mirrored interactive displays for user supervision
- Bypasses lock screen interruptions during automation
Project Astra Connection
This development aligns with Google's Project Astra demo at I/O, where an AI agent:
- Found documents online
- Extracted specific information
- Searched for related YouTube videos
However, the prototype relied on hacked-together solutions using:
- MediaProjection API for screen recording
- Accessibility API for input simulation
Potential Impact
If successful, Computer Control could:
- Save time through true app automation
- Enhance accessibility features
- Enable new AI agent capabilities
Major questions remain:
- Will processing happen on-device or in the cloud?
- How will Google ensure security and privacy?
- What's the official launch timeline?
The feature is expected to debut with Android 17 and could position Android as a leader in agentic AI.
Related News
Google Launches Jules API to Automate Developer Workflows
Google introduces the Jules API, enabling developers to automate and integrate tasks across the software development lifecycle.
Google Expands Jules AI Coding Tools with CLI and API
Google introduces Jules Tools CLI and Jules API for integrating its AI coding agent into developer workflows.
About the Author
Dr. Lisa Kim
AI Ethics Researcher
Leading expert in AI ethics and responsible AI development with 13 years of research experience. Former member of Microsoft AI Ethics Committee, now provides consulting for multiple international AI governance organizations. Regularly contributes AI ethics articles to top-tier journals like Nature and Science.