Quanta

← Back to Briefings

Two Reviewers, One Queue: Gatekeeping GPT-6 Astra Drafts

Team playbooksEN6 reads

01 · Where the human gate sits in a sustained-generation pipeline

At sustained volume, generated customer-facing copy stops behaving like a writing task and starts behaving like a routing problem. The question is not whether a draft is good, but whether this particular draft has earned the right to reach a customer without a person looking at it. Teams that answer that question before generation, as a policy attached to the content type, keep their reviewers working on the small slice of output that genuinely needs judgement. Teams that answer it after generation drown reviewers in routine drafts until they start rubber-stamping them, which is worse than having no review at all.

Put the gate early and make it explicit:

  • › Every content type carries a review tier before it is queued for generation.
  • › Every tier names who reviews, who approves, and who holds release authority.
  • › Every draft logs its tier, its generation prompt version, its reviewer, and the decision.

A practical starting point is three tiers. Direct-send covers low-risk, highly derivative text such as order confirmations and shipping updates. Sampled review covers high-volume text with a stable pattern, such as help-centre answers and onboarding messages. Mandatory review covers anything financial, contractual, legal, or emotional: refunds, outage notices, security advisories, and anything addressed to a customer who is already upset. Most teams discover that mandatory review is a much larger share of their traffic than they expected, and that this is a healthy sign.

02 · Tiering content by what a bad draft can cost

Risk tiering fails when it is defined by content category alone. Two help-centre answers can belong in different tiers depending on who reads them and what happens next. Ask three questions before assigning a tier to any content type. First, can the customer act on this text in a way that is hard to reverse? Second, does the text commit the company to a price, a date, a policy, or a legal position? Third, is the reader in a state where an imprecise sentence makes the situation worse?

  • › Any yes to the first two questions pushes the draft into mandatory review.
  • › Any yes to the third question adds a second reviewer or a senior approver.
  • › Only text with no yes answers qualifies for direct-send, and only after it has held up under sampling for a defined period.

Sampling is the underrated lever. Start every new prompt, template, or model change with a high sample rate, then decay it as the reviewer disagreement rate falls. Keep a permanent floor sample even on mature paths. Most teams find their first serious incident not on a new feature, but on a template that drifted quietly over months while sitting at zero-percent review. Treat a tier change as a release event: version it, review it, and log who approved the change.

03 · Roles, queues, and a release path with one owner

A review loop breaks when responsibility is diffuse. Define four roles even if one person holds two of them. The authoring system produces the draft and attaches its tier and prompt version. The reviewer checks accuracy, policy, and tone against a written rubric, not personal taste. The approver owns exceptions and signs off on anything that deviates from the template. The release owner is the single person who can let content reach customers, and the one accountable when it should not have.

  • › Run one queue with typed lanes rather than many small queues, so load balancing and overflow are possible.
  • › Set a target time to release per tier and treat breaches as an operational metric, not an annoyance.
  • › Route disagreements to the approver, not back to the first reviewer, and record the outcome as precedent.
  • › Keep the decision log next to the draft; an unexplained approval is an unauditable approval.

Rubrics matter more than headcount. A short rubric with concrete examples of acceptable and unacceptable phrasing produces far more consistent reviews than a long style guide, and it makes reviewer onboarding a day rather than a fortnight. When two reviewers regularly disagree on the same content type, the rubric is unclear, not the reviewers, and the fix is to rewrite the rubric before you touch the queue.

04 · Token metering and review latency in the same loop

Human review adds wall-clock time, so generation economics become part of loop design. Regenerated drafts cost tokens twice, and they also occupy reviewer attention a second time, which is the more expensive of the two. Tighten prompts and rubrics upstream before you add reviewers downstream. For teams running heavy, sustained workloads through a relay, the accounting detail that matters is that every call is metered on real tokens, with cache writes and cache reads priced separately, so a stable system prompt that the model reads from cache on every call is cheaper than one that gets rewritten per draft.

  • › Route high-volume derivative drafts to a smaller model, such as Claude Haiku 4.5, and reserve a larger model for sensitive or exception-driven copy.
  • › Keep the review rubric in the cached portion of the prompt so revisions change only the variable inputs.
  • › Feed rejected drafts back with the reviewer note attached, so the next attempt converges instead of wandering.

Quanta is built for exactly this pattern: a pay-as-you-go API relay where one balance covers a wide set of models, works with the coding tools and SDKs your team already uses, and bills transparently per token at the relay base. It suits teams whose generation volume is high enough that metering discipline is a budget decision. If you are running this loop at sustained volume, open a Quanta account and put a single metering surface behind all of your review tiers.

05 · Drift metrics and a rollout that survives week five

Review loops degrade slowly and invisibly. Watch four numbers weekly. Disagreement rate tells you whether the rubric is still understood. First-pass approval rate tells you whether generation quality is improving or reviewers are tiring. Time to release per tier tells you whether the loop is still operationally viable. Reverted or corrected sends tell you what actually reached customers and was wrong, which is the only outcome metric that ultimately counts.

  • › Week one: map content types to tiers and publish the rubric.
  • › Week two: stand up the queue and decision log with mandatory review on high-risk types.
  • › Week three: start sampling on direct-send paths and set the decay schedule.
  • › Week four: tune prompts and models against reviewer notes and measure regeneration cost.
  • › Week five: review the four metrics, adjust tiers, and only then widen direct-send.

Expect the hardest conversation to be about volume: someone will argue that mandatory review blocks throughput, and they will be right in the short term. The answer is not to remove the gate but to shrink the mandatory tier through better prompts, clearer templates, and a smaller, better-specified set of approved phrasings. Once first-pass approval is high and disagreement is low, tier changes can be earned rather than argued, and the loop scales with your generation volume instead of against it.