Response rating & ranking (RLHF)
Human feedback is how models learn what a good answer looks like. I compare responses side by side, score them on each rubric dimension, and explain my choice so reviewers can trust and reuse it.
- Pairwise preference and multi-response ranking
- Rubric scoring: accuracy, helpfulness, safety, tone, instruction-following
- Short, specific justifications that cite the exact problem
- Consistent calibration against reference examples
Draws on: following clinical protocols exactly, written reporting at Lopfatec, and writing a 41-item weighted rubric for an expert benchmark task.
Example deliverable
A rating with a rationale a reviewer can verify quickly: