REFERENCE QUALITY REVIEW · Workflow idea

Make sure an answer is drawing on information that fits the question.

Review test questions alongside the reference material selected to support their answers. Help a team see when the material is useful, incomplete, outdated, or off-topic, and keep the original context available to reviewers. A knowledgeable person should verify important findings before changing guidance, relying on a result, or sharing a report publicly.

A Roman aqueduct taking shape from architectural sketch to marble.
A little structure. A clearer outcome.
Starts with
Questions and reference material are ready to check
Produces
A reviewable assessment of reference relevance with supporting context and uncertain cases identified.
Category
Reviews & approvals

01 / The starting point

A clear request.
A useful direction.

A set of test questions and the documents selected to support their answers

“Assess whether selected reference material is relevant to each question and identify cases that need human review.”
An example request · Make it specific to your team.

02 / The work

5 tasks.
One useful outcome.

Helps teams check whether the material available for answering a question actually addresses what the person asked.

  1. Prepare representative questions

    Choose questions that reflect the information needs the selected reference material is expected to support.

  2. Review the material associated with each question

    Keep each document and its surrounding context connected to the question for a reviewer to inspect.

  3. Identify useful and weak matches

    Note whether the material addresses the question, only covers part of it, or appears unrelated.

  4. Flag missing or conflicting guidance

    Point out questions with no useful support, outdated details, or inconsistent source material.

  5. Verify important findings with an owner

    Ask a knowledgeable person to check significant assessments and approve any consequential guidance change or public release.

03 / The result

Something useful.
Something to build on.

A reviewable assessment of reference relevance with supporting context and uncertain cases identified.

AmbactiWorkflow folio · 5 steps

Review answer source relevance

Reviews & approvals · Example outcome

The handoff

A reviewable assessment of reference relevance with supporting context and uncertain cases identified.

Keep in mind

A relevant passage may still be incomplete, outdated, or interpreted incorrectly. Keep source titles and context available, have a subject owner verify significant findings, and require human approval before changing consequential guidance or publishing a report or answer externally.

04 / Make it yours

Set the brief.
Set the standard.

A few choices shape the work around your team.

Choose the questions and reference collection

Define the questions to assess and confirm which approved material is intended to support them.

Confirm document ownership and currency

Identify owners who can confirm that references are current, relevant, and appropriate for the intended readers.

Set relevance and exception guidance

Agree on how partial, outdated, contradictory, and missing information should be described.

Assign subject and publication reviewers

Name who checks important findings and approves guidance changes or external publication.

Put your next idea to work.

Start with your brief. Make the process your own.

Explore more workflows ↗