How do you evaluate an LLM classifier when positive cases are rare?
High accuracy can hide an unusable review queue. Compare classifier operating points at the expected positive rate, then check recall and review capacity together.
High accuracy can hide an unusable review queue. Compare classifier operating points at the expected positive rate, then check recall and review capacity together.