Set up a jury round with a weighted rubric

A jury round is one stage in your pipeline where a group of evaluators scores applications against the same rubric. Setting it up properly before reviews start is what keeps scores comparable.

Steps

1. 1Go to Settings → Programs → Application Stages, pick your program type and choose + Add Stage. Name it for the round, for example "Final round".
2. 2Agree on four to six criteria and give each a weight. Weights should add up to 100%, and each criterion has a maximum score (10 by default).

3. 3Invite your jurors with the Evaluator role, then move applications into review with Move to Review. Evaluators score each application in the Evaluation Rubric panel and submit their recommendation with Add Review.

Criteria and weights

Write one line per criterion describing what a low, middle and high score looks like. Weight the criteria that matter most for this stage. Team and problem often matter more early on, traction and plan more in a final round. The Evaluation Rubric panel shows each criterion's weight and works out the weighted total for you.

Starting reviews

Before the round opens, run a short calibration with every evaluator on the same three applications (see Calibrate scores before a jury round). Then move the round's applications to Under Review and let each evaluator know which applications are theirs to score.