Outside Judge

Two simulated readers score every deal seed before anyone real sees it

What it is

Before the team decides on a proposed deal, two simulated readers look at it and say whether it is worth sending. One is Brand buyer, a skeptical buyer who spends real marketing money. The other is Talent manager, a protective manager who guards their client's rate card and reputation.

They are a cheap first filter, not real people. The real judges come later: a talent manager who reviews samples, and a brand that says yes and pays. Until enough real answers exist, treat the two scores as a hint.

The two readers

ReaderWhat it asks itself
Brand buyerWould I pay this price for this talent for this deal? Is it clear what we get, where it runs, and for how long? Does this person fit my brand?
Talent managerWould I let my client do this at this price? Are the terms vague, too broad, or unpaid? Does the brand clash with my client's niche or values?

Both are told to be hard to impress. A seven out of ten means they would really sign it or recommend it.

What they send back

Each reader returns four things:

  • A score out of ten. One means never, ten means yes today.
  • A verdict: send, fix, or drop. Send is good enough to show the other side now. Fix means one thing must change first. Drop means no small change saves it.
  • Up to three reasons, each a short line in plain words.
  • One concrete fix. Not advice, but a change a person can make: a price, a deliverable, a usage term.

A seed carries the worse of the two verdicts and the lower of the two scores, so a single drop is not hidden by a friendlier second opinion.

What they see, and what they never see

The two readers get the same facts and nothing else: the brand and its categories, a short talent card, the kind of deal, the proposed terms, the price, and the reasons the pair was matched.

They never see each other's answer. They are asked separately and at the same time, so one cannot lean on the other.

They never see protected traits. Gender, age, race, religion, looks, and similar personal details are kept out of what they are shown, and they are told never to judge by them.

When they run

  • When seeds are made. Every new batch of seeds is scored before the team, or automation, looks at it.
  • On demand. Re-judge asks both readers again, as long as nobody has been approached yet.
  • After a price change. The readers saw the old price, so changing the price runs them again on the new one.

If a reader fails or is skipped, the seed simply shows as not judged. It does not stop the seed from being made or seen. A failed re-judge never wipes out an earlier answer, so a drop already on a seed stays there.

What the team sees on the Seeds page

Each seed shows a small panel with both readers side by side:

  • The reader's name, their score out of ten, and their verdict as a colored tag
  • Their reasons, as a short list
  • Their Fix, when they gave one

The seed's own badge shows the combined verdict and score. Above the list, the page says whether the judges are on, how much of this month's budget is used, and that a seed a judge said drop is never sent automatically.

A warning appears when the price has moved since the score was made: the old price is named and the panel asks for a re-judge.

Filters narrow the list to what needs attention: needs a fix, judge said drop, judges say send, or not judged, each with a count. Re-judge sits next to Edit price on any seed nobody has been asked about yet.

When a seed has a drop, Approve becomes Approve over drop, and a confirmation says plainly that the asks will not go out by themselves. The seed's timeline records who approved it and that it was over a judge's drop.

A drop stops automatic sending

A drop is the one verdict that changes what the system may do on its own:

  • Auto. The seed is never approved automatically, however high its match.
  • Semi. Approval is refused until a person approves over the drop. Even then, the talent ask and the brand ask do not send themselves: a person taps Ask talent or Ask brand.
  • Manual. Every step is a click anyway, and approval still needs the explicit override.

Fix, send, and not judged do not block anything. A seed the judges did not score — judges off, budget used up, or the call failed — can still be approved automatically. Once both real people have said yes, the introduction is not blocked either.

The off switch and the budget

The judges can be switched off. When they are off, no calls are made and each new seed records that it was not judged.

There is a monthly budget, ten dollars by default. Spend is counted from the first of each month (UTC). When one more round would go over, new seeds are left unjudged with a note, and the page says the cap has been reached. Nothing else about seeding changes.

How the team knows the judges are any good

Show calibration puts the scores next to what really happened to each seed:

  • Whether a person on the team approved or rejected it
  • Whether the talent said yes or no
  • Whether the brand said yes or no

For each reader it reports how often send lined up with a yes and drop lined up with a no. Fix is counted separately, because it means "not like this", not a no. It also counts the seeds the team approved over a drop.

Read small numbers with care: under about twenty decided seeds the rates are noise, and the report says so.

What it does not do

  • It does not change a deal or a price. It suggests one fix; a person applies it.
  • It does not decide. A drop only stops automatic sending. A person can still approve over it.
  • It is not a real buyer or manager. It is a stand-in until real answers are in.

Known issues

  • Opinion, not fact. Different brands, talents and managers would score the same deal differently, so the scores are closer to a guess than a right answer.
  • Built to find problems. Both readers are told to be hard to impress or protective, so they lean toward objecting.
  • The harsher verdict wins. One drop from either reader blocks automatic sending, so the two together block more often than either would alone.
  • Not tested on real cases. Checks so far use fake answers. Nothing shows the scores match what good deals look like.
  • Team sees the verdict first. Team agreement partly measures trust in the readers, not whether they are right.