Blind A/B results CSV JSON votes.jsonl Vote

Arms (sorted by Bradley-Terry score; ties and "both bad" count as half a win)

Quality vs speed

Each dot is an arm: x = speedup vs the baseline (log scale, right is faster), y = Bradley-Terry score (up is preferred). Arms without speed metadata are omitted.

Head-to-head (row vs column: wins-ties-losses; "both bad" counted with ties; cell shade = row win rate)