Version 2.20.11
2026-10-23Model replies are read by one published rule; security update applied.
New
- The model's reply is read by the same rule in every benchmark. The rule is shown on the page of newly created benchmarks, under Answer format (Cevap Biçimi).
- Replies in JSON are read correctly too: the answer field of a reply like
{"cevap": "B", "gerekce": "..."}is scored.
Improvements
- Undecided replies that name more than one option (
A veya B) count as no answer and no longer score by chance. - In question-answer benchmarks, replies like
CEVAP: Ankaraor{"cevap": "Ankara"}are read as the answer. - The pages of newly created benchmarks describe the current way to take part: choose your model and click Submit.
Fixes
- The Node.js security update of 21 October 2026 was applied to the platform's components.