Ace About Research Preview

Intelligence. On your computer.

Ace is a computer autopilot that performs tasks on your desktop using your mouse and keyboard.

Ace outperforms other models on our suite of computer use tasks, which we are open-sourcing here. We're making the ace-control models available to selected partners through our developer platform.

Model Accuracy Comparison

Correct Left-Click Predictions

ace-control-medium
ace-control-small
Operator
Molmo-72B-0924
Claude 3.7 Sonnet
UI-TARS-72B-SFT
OmniParser V2 + GPT-4o
Gemini 2.0 Flash
Qwen2.5-VL-72B-Instruct
Click Accuracy (95% CI)

Ace is exceptionally fast! It can perform many tasks in superhuman time.

Action Prediction Latency (ms)

Ace works like we do—performing mouse clicks and keystrokes based on the screen and prompt—trained with <3 by our team of software specialists and domain experts on over a million tasks.

Ace is still learning and can make mistakes. Here are some examples of its failures:

We're just beginning. As we increase training resources, Ace will become more intelligent and capable.

Accuracy vs Training Resources

1x
2x
4x
8x
16x
Normalized Training Resources (log scale)
Accuracy

We're launching an early version of Ace in research preview. We invite you to try Ace for yourself.