Dog‑house frame and roof from 19 boards by a bimanual robot
ID llarms/task10 · revision 1 · results as of 2 November 2026
In a simulated robot workshop, the agent drives a two‑handed robot by typed commands to build an open frame of four corner posts and two rings of rails, then a flat roof of seven slats: 19 boards, each exactly in its outline, fixed with 90 screws.
- Checks
- 1, 1 point for the whole build, none for part of it
- Tested
- 1 model, one attempt
- Best
- 0% (GPT‑6.1 Sol)
- Full solves
- 0 of 1
- Attempt
- 20 min
A dog‑house frame and roof of 19 boards, with 90 screws
Robot control
The robot builds a dog‑house frame and flat roof from 19 boards out of crowded stock, driving 90 screws across 30 joints.
A simulated workshop, two hands, two drills and 19 boards in crowded stock
The agent's world
A coding agent sends JSON to a local robot server: read the state, or send a motion of 1 to 32 velocity segments.
The robot
Two seven‑joint manipulators on sliding bases, each with a five‑fingered hand that holds by friction alone, so boards can slip, turn or drop.
Limits
One session of 20 minutes of wall time, planning included, with action and simulation‑time budgets; no resets or direct state changes.
The reward
One point only if all 19 boards settle inside outlines of their own size and all 30 joints are rigid with three screws each.
Much of the attempt went on reaching stock, and no tool was picked up
The dot is the one attempt.
| Model | Reward |
|---|---|
| GPT‑6.1 SolOpenAI | 0% |
A person can complete this build easily.
It's blocked reaching the stock, and never picks up the drill
Robot control
After taking two roof slats, it spent two long stretches approaching the rails around the cradles, with both manipulators often blocked.
It carried and turned a corner post toward its outline, lost contact, recovered it twice and released it again.
It never grasped the drill or a screw: none of the 90 screws and none of the 30 joints at the 20‑minute limit.
All 19 boards ended outside their outlines, the closest 454 mm out.
What an attempt takes, and what the environment includes
An attempt
Cost and tokens weren't recorded: the attempt ran on a subscription sign‑in, which logs neither.
What's in it
The frozen runtime with this scenario, the request and interface document, the grader and its self‑test, and the attempt's full record and videos.
Format
Node.js, with the physics in headless Edge and a Python grader; it runs on a Windows PC today, and other packaging is on request.
Fresh variants
Other builds and layouts in the same design, made on request and never published.
The files and grader aren't published; the job's row on The AI Agent Trials, our public benchmark, sums up the job and shows each model's score.
Try one of our three sample environments
Three environments are packaged as samples you can download, with their graders and reference solutions. Ask for them with your work email, or book a call about the rest of the catalogue.
AsapiThe AI Agent Trials