Prepare your submission

Coming soon

Format your predictions, validate them with the official evaluation tools, and prepare your method details before submissions open.

Submission workflow

  1. 01

    Prepare

    Format prediction records.

  2. 02

    Validate

    Check the schema and run the scorer.

  3. 03

    Submit

    Available after launch.

Prediction package

One qlb.solution.v1 record per document, including empty predictions.

File
JSONL with unique document IDs
Groups
Attribute labels and evidence spans
Offsets
Half-open Unicode-code-point intervals
Download prediction schema

Method details

Use the metadata template to document how your predictions were produced.

System
Model, checkpoint and revision
Settings
Prompting or fine-tuning, decoding and seeds
Provenance
Data usage, evaluation split and scorer revision

Submissions are not open yet.

View leaderboard