ComingOn text
Contract summarisation
Does the summary say what the contract says — and nothing more?
The protocol for this benchmark is written. No model has been queried yet, so this hub shows no figure for this task.
What this test will measure
Summarise a commercial contract in one page for a busy executive. Every statement is traced back to a clause; an obligation absent from the contract counts as invented.
What will be graded
- Parties and term
- Mutual obligations
- Financial terms
- Termination
What it is waiting for
No public reference says what the right answer is. A scoring rubric and human arbitration are needed before anything can be ranked.
- Place on the roadmap
- Wave 3
- Target sample
- 40 contracts
- What the model receives
- Text
One business function at a time, one task at a time. Every wave ends with a publication.
No figure is shown here because there is none. The day this task is measured, its ranking will appear on this very page.
How the hub measures — how an answer is verified, the rubric and the verdicts, on the task already measured.