Flat‑beam transfer by a bimanual robot with friction‑only grips
ID llarms/task01 · revision 2 · results as of 29 October 2026
In a simulated robot workshop, the agent drives a two‑handed robot by typed commands to pick up one flat beam, carry it a short way and let it settle exactly inside its target outline.
- Checks
- 1, 1 point for the whole build, none for part of it
- Tested
- 1 model, one attempt
- Best
- 0% (GPT‑6.1 Sol)
- Full solves
- 0 of 1
- Attempt
- 2 min
One beam lifted, carried about 15 cm and set down within its outline
Robot control
The robot must lift one loose beam by friction alone, carry it about 15 cm and set it down with every corner inside its outline.
A simulated workshop, two five‑fingered hands and one beam
The agent's world
A coding agent sends JSON to a local robot server: read the state, or send a motion of 1 to 32 velocity segments.
The robot
Two seven‑joint manipulators on fixed bases, each with a five‑fingered hand that holds by friction alone, so boards can slip, turn or drop.
Limits
One session of 20 minutes of wall time, planning included, with action and simulation‑time budgets; no resets or direct state changes.
The reward
One point only if the beam settles with all eight corners inside an outline of its own size, after a real lift and release.
The beam came to rest 16 mm outside its outline
The dot is the one attempt.
| Model | Reward |
|---|---|
| GPT‑6.1 SolOpenAI | 0% |
This attempt was told an earlier, looser target that accepted boards centimetres off, and not the corner rule; its score uses the strict outlines. A person can complete this build easily.
It stops close, on the old check, with most of its time unused
Robot control
The beam came to rest with its worst corner 16.4 mm outside its outline, so the build didn't count.
When the engine's looser check reported success, the attempt stopped, as the request said it should.
It stopped after 2.3 of its 20 minutes, having sent 6 motion commands covering 14 simulated seconds.
What an attempt takes, and what the environment includes
An attempt
Cost and tokens weren't recorded: the attempt ran on a subscription sign‑in, which logs neither.
What's in it
The frozen runtime with this scenario, the request and interface document, the grader and its self‑test, and the attempt's full record and videos.
Format
Node.js, with the physics in headless Edge and a Python grader; it runs on a Windows PC today, and other packaging is on request.
Fresh variants
Other builds and layouts in the same design, made on request and never published.
The files and grader aren't published; the job's row on The AI Agent Trials, our public benchmark, sums up the job and shows each model's score.
Try one of our three sample environments
Three environments are packaged as samples you can download, with their graders and reference solutions. Ask for them with your work email, or book a call about the rest of the catalogue.
AsapiThe AI Agent Trials