How to run a 500-application intake without losing a weekend

Most programs open applications with a Google Form, close it with 500 rows in a sheet, then spend two weeks forwarding PDFs to jurors. Here is the method we use instead.

1. Decide the stages before you open the form

Write down every stage an application passes through, from screening to the final pitch, and who moves it to the next one. A stage with no owner becomes the bottleneck.

A useful rule of thumb: each stage should cut the pool by three to five times, and the people working that stage should be able to clear their share inside one working week. If the numbers don't work, add reviewers or add a stage. Don't stretch the deadline.

If two jurors score the same deck a 3 and a 9, the problem is your rubric, not your jurors.

2. Give every juror one rubric and a short queue

Use four to six weighted criteria, each with a line on what a 1, a 3 and a 5 look like. Cap queues at 15 applications per juror per round, and assign by sector rather than alphabetically.

Short queues matter more than most teams expect. A juror's fifteenth review is rarely as careful as their first, and a juror who sees only fintech decks scores fintech more consistently than one who jumps between sectors. When the pool grows, split it. Keep the rubric the same.

3. Ask only what you will score

Every question on the form should map to a criterion or to an eligibility rule. If nobody will read the answer during screening, cut it. Twelve good questions get fuller answers than forty.

• Basics: founder names, contact details, city, stage and sector.
• Evidence: one short answer each on the problem, the customer and traction so far.
• Files: the pitch deck as a single file upload.
• One open question you genuinely want to read.

Mark the fields you need as required, set an opening date, a closing date and a response cap, and test the public link on a phone before you share it. Many founders will apply from one.

4. Run screening as a checklist, not a debate

Screening exists to remove applications that don't fit: wrong stage, wrong geography, missing deck. Three people with a shared checklist can clear 500 in two or three days. Move what passes into review. Reject what clearly doesn't fit with a short, specific note. Park anything borderline for one named person to decide at the end of each day.

5. Calibrate before the first jury round

Before jurors start, pick three applications (one strong, one weak, one in between) and have every juror score them. Compare the results. Wherever two scores on the same criterion differ by more than three points, rewrite that criterion's descriptor until the jurors agree. Thirty minutes here saves a week of arguing over the shortlist.

6. Close the loop with every applicant

Applicants remember how a rejection felt long after they forget which program sent it. Tell people where they stand at every stage, including the ones who don't make it. CohortOS sends an email when an application's status changes, so you only have to write each message once, not 500 times.