ambacti
Explore workflows

CONVERSATION QUALITY REVIEW · Workflow idea

Find out which conversation guide works better for your team.

Compare a baseline conversation guide with an alternative across a clearly defined evaluation. Keep each consenting test session on the same guide, record only the minimum information needed to assess results, and have reviewers inspect response quality and fairness before drawing conclusions or changing the experience.

Make it yours See how it works ↓
A Roman aqueduct taking shape from architectural sketch to marble.
A little structure. A clearer outcome.
Starts with
An informed test conversation
Produces
A comparison of two conversation approaches with test context and limitations ready for a reviewer to assess.
Category
Research & strategy

01 / The starting point

A clear request.
A useful direction.

A test participant who has been told that responses may vary and agrees to the evaluation

“Assign each test session consistently to one of two approved guides, collect limited evaluation information, and keep conclusions and external communication under human review.”
An example request · Make it specific to your team.

02 / The work

5 tasks.
One useful outcome.

Helps a team compare alternative conversation guidance in a structured, reviewable evaluation.

  1. Define the evaluation question

    Choose a specific quality measure and decide what evidence would make one guide more useful.

  2. Prepare two reviewed conversation guides

    Set a baseline and alternative that differ in the intended way and avoid instructions that could lead to unsafe or misleading replies.

  3. Inform participants and obtain consent

    Explain that session responses may vary, what information is recorded, and how a participant may decline or stop.

  4. Keep each session on its assigned guide

    Use a consistent assignment for follow-up messages and limit stored session details to what the evaluation requires.

  5. Review results before making changes

    Have people assess response quality, participant impact, and limitations before adopting a guide or sharing a conclusion.

03 / The result

Something useful.
Something to build on.

A comparison of two conversation approaches with test context and limitations ready for a reviewer to assess.

AmbactiWorkflow folio · 5 steps

Compare two conversation guides

Research & strategy · Example outcome

The handoff

A comparison of two conversation approaches with test context and limitations ready for a reviewer to assess.

Keep in mind

A small or unbalanced test may not show which guide is better, and different responses can affect participants. Explain the evaluation and obtain consent, avoid sensitive or consequential use, minimize and protect session records, assess quality with human reviewers, and require approval before changing a live experience or sharing findings externally.

04 / Make it yours

Set the brief.
Set the standard.

A few choices shape the work around your team.

Choose guides and evaluation measures

Document the baseline, alternative, intended audience, and measures that matter to the test.

Set participant notice and data limits

Obtain informed participation, avoid sensitive inputs, and define access and deletion timing for session records.

Keep assignments consistent

Choose a stable session reference and verify that later messages remain associated with the same guide.

Assign reviewers and test fairness

Have people review representative answers, missing data, uneven assignments, and possible harms before any rollout.

Put your next idea to work.

Start with your brief. Make the process your own.

Explore more workflows ↗