Version 2.20.12
2026-10-23Model keys are kept by the platform; every run has a fixed record.
New
- Every run has a fixed record: the model, data, prompts, scorer and settings it used. The Run record tab in the submission details shows the run id and the record, which you can download as JSON.
- If the model changes during a run, the run is marked Not comparable; its results are kept but it is not on the leaderboard.
Improvements
- A model key never appears in a file, page or record; the My AI Models page no longer shows it. You never enter or copy a key to make a submission.
- Every model key can call only its own model.
- When a run is repeated, it uses the same model and the new run is linked to the earlier one.
Fixes
- Security improvements: for models, the platform calls only its own model service.