Home/Archive

The archive

48 posts
Showing 1–1 of 1 · #bias
Model graders are useful, if you calibrate them firstBENCHMARKS

Model graders are useful, if you calibrate them first

Position bias, verbosity bias and self-preference. How to measure a model grader against human labels, fix its rubric and keep it honest over time.

SPSana PatelOct 24 · 6 min

Get the Sunday Diff — every post worth reading, once a week.