No. 028 · Week 41 · Michael Taylor · Exploring
Multi-sample checks
The same task run ten times on four models, to turn repeated answers and repeated failures into checks.
Do models keep giving the same answer, and do repeated mistakes tell you what to check?
See the rest of the write-up and 1 more image.A free Every account opens this. Nothing to buy.