Screwed three‑board corner frame by a bimanual robot
ID llarms/task04 · revision 2 · results as of 29 October 2026
In a simulated robot workshop, the agent drives a two‑handed robot by typed commands to build a flat U‑shaped corner from three boards out of angled stock, each exactly inside its outline, and fix both overlaps with three screws each from a hand‑held drill.
- Checks
- 1, 1 point for the whole build, none for part of it
- Tested
- 1 model, one attempt
- Best
- 0% (GPT‑6.1 Sol)
- Full solves
- 0 of 1
- Attempt
- 20 min
Three boards laid as a flat corner, with both overlaps screwed
Robot control
Three boards come out of angled stock into a flat U, and both overlaps need three screws each, driven with a hand‑held drill.
A simulated workshop, two hands, two drills and three boards in angled stock
The agent's world
A coding agent sends JSON to a local robot server: read the state, or send a motion of 1 to 32 velocity segments.
The robot
Two seven‑joint manipulators on sliding bases, each with a five‑fingered hand that holds by friction alone, so boards can slip, turn or drop.
Limits
One session of 20 minutes of wall time, planning included, with action and simulation‑time budgets; no resets or direct state changes.
The reward
One point only if all three boards settle inside outlines of their own size and both joints are rigid with three screws each.
All three boards ended centimetres out, and no screw went in
The dot is the one attempt.
| Model | Reward |
|---|---|
| GPT‑6.1 SolOpenAI | 0% |
This attempt was told an earlier, looser target that accepted boards centimetres off, and not the corner rule; its score uses the strict outlines. A person can complete this build easily.
It leaves the boards centimetres out and runs out of time before a screw
Robot control
All three boards came to rest outside their outlines, by 61.2, 38.2 and 38.1 mm at the worst corner.
Placement never led to a full fastening cycle, so none of the six screws went in and neither joint was rigid.
The server stopped the attempt at the 20‑minute limit, after 41 motion commands covering 299 simulated seconds.
What an attempt takes, and what the environment includes
An attempt
Cost and tokens weren't recorded: the attempt ran on a subscription sign‑in, which logs neither.
What's in it
The frozen runtime with this scenario, the request and interface document, the grader and its self‑test, and the attempt's full record and videos.
Format
Node.js, with the physics in headless Edge and a Python grader; it runs on a Windows PC today, and other packaging is on request.
Fresh variants
Other builds and layouts in the same design, made on request and never published.
The files and grader aren't published; the job's row on The AI Agent Trials, our public benchmark, sums up the job and shows each model's score.
Try one of our three sample environments
Three environments are packaged as samples you can download, with their graders and reference solutions. Ask for them with your work email, or book a call about the rest of the catalogue.
AsapiThe AI Agent Trials