THE COLLECTION

EVERY SIGNAL, SORTED.

Search the whole shelf by topic, tool, term, or plain old curiosity.

SHOWING 3 OF 573 STORIES
ISSUE 569MORNING

United States, OpenAI, Evals, Promptfoo, Evaluation Migration, AI Quality, Regression Testing, Datasets, Graders, Human Review, Reproducibility, Audit Evidence, Model Governance and Developer Tools

OpenAI made its Evals platform read only. Export the evidence before shutdown

OpenAI has frozen existing Evals and scheduled the dashboard and API to shut down on November 30. The migration job is not copying a score. It is preserving enough evidence to rerun the test, explain the result and notice when the replacement behaves differently.

#ai-evaluation#developer-tools#evidence-ledger
ISSUE 382EVENING

Piauí, Brazil, Education, ENEM, Essay Scoring, Student Data, Human Review and Public Accountability

Piauí is using AI to score practice essays. Students deserve the marking rubric

Piauí says its Canal Educação tool helps students correct ENEM practice essays and simulate a score. That can make feedback faster, but the number needs a visible rubric, tested agreement with teachers, a correction path and evidence that students actually learn from it.

#brazil#education#ai-evaluation
ISSUE 190EVENING

United Kingdom, Probabilistic Forecasting, AI Evaluation and Decision Support

A London forecasting bot beat the humans and immediately met venture capital

Mantic finished ahead of every human in a short-horizon forecasting tournament and raised $25 million. One scoreboard can reveal progress without settling the harder question of whether the forecasts improve real decisions.

#united-kingdom#forecasting#ai-evaluation