Skip to submissions

Author guide Submit a task Propose a task Review

RLE-Bench 2.0 · Contributions

Submit a task

Upload a finished robotics task with its environment, solution, and evaluation. Have an idea to develop first? Submit a proposal.

Task submissions Proposals

Loading your session…

Start with your GitHub account

Sign in to upload your task and follow its review.

Sign in with GitHub

Signed in as

Your proposal

Describe a robotics problem worth turning into a benchmark task. A finished task package is not required.

Task and environment Task name Robotics domain Software and versions Task description

Describe the objective, starting state, available inputs, constraints, and what the agent should deliver—as if assigning the work to a colleague.

How should we verify success? Contact email

Materials Input materials (optional) Input materials link (optional) Reference output (optional) Reference output link (optional)

Use links for supporting files at the proposal stage. Make sure the reviewers can access them.

Difficulty self-test (optional)

If you have tried an agent on the problem, share the result. You can propose an idea before running this test.

Model

Agent harness

Score or outcome Evidence link

Drafts are visible only to you. Submitted proposals and feedback are visible to you and designated RLE-Bench reviewers.

Before you build

Start with the problem

Choose a problem from real robotics engineering or research.
Explain the starting point, expected result, and what makes it challenging.
Define a reliable way to check success.

Save a draft with a task name and return to it below. Submit when the required fields are ready for review.

Read the task criteria Have a finished package? Submit a task

Proposal acceptance is feedback on the idea. The finished task package receives its own review.

Your task

Task title

Version

Workflow

Engineering problem and evaluation Contact email Task archive

ZIP up to 25 MiB. Include your completed SUBMISSION.md and task/ directory at the ZIP root.

Your ZIP, contact email, and review feedback are visible only to you and designated RLE-Bench reviewers.

Before you upload

A complete task package

Replace the example with your own engineering task.
Run the local checks and record expected and actual results.
Complete the author documents and include all build inputs.

Download the template ↗ Read the preparation guide ↗

Upload checks cover package structure. Reviewers assess task quality and validation evidence separately.

Your submissions

Filter submissions by status

Back to the contribution guideRLE-Bench · Contributions

Submission

Resume your upload

Select the original ZIP

Update review

Status Feedback visible to the contributor