What this workflow should accomplish
Competitor Set Design gives teams choosing which vendors to compare in an audit a controlled input for AI visibility measurement instead of relying on ad hoc prompts or screenshots.
The result is a bounded measurement for a defined question set and collection period. It does not establish a universal ranking, guarantee future inclusion, or prove why a model produced an answer.
Why a generic visibility score is insufficient
internal rivals, search rivals, and AI-answer rivals may not be the same set.
Keep the full evidence trail so a reviewer can distinguish absence, mention, recommendation, citation, and description accuracy.
teams choosing which vendors to compare in an audit
Use this playbook when the result will change a content, positioning, measurement, reporting, or go-to-market decision. Assign an owner before collection begins and agree on what evidence would justify action.
Start with a decision-shaped question
“Which alternatives actually appear for the controlled buyer questions, including adjacent categories?”
Evidence to retain
declared competitors, observed competitors, category fit, buyer overlap, and exclusion reason.
Interpretation boundary
a narrow hand-picked set can overstate share while missing the vendor that wins the answer.
Move from scope to a reviewable retest
- 01
Define the decision and audience
Define the decision and audience: teams choosing which vendors to compare in an audit.
- 02
Build a controlled question set. Start with
Build a controlled question set. Start with: “Which alternatives actually appear for the controlled buyer questions, including adjacent categories?”
- 03
Retain declared competitors, observed competitors, category fit, buyer overlap, and exclusion reason.
Retain declared competitors, observed competitors, category fit, buyer overlap, and exclusion reason.
- 04
Review the main failure mode
Review the main failure mode: a narrow hand-picked set can overstate share while missing the vendor that wins the answer.
- 05
Turn the finding into a test
Turn the finding into a test: retain a declared set and add observed competitors through a documented review rule.
eligible observations covered by the reviewed competitor set
Publish the numerator, denominator, eligible question set, providers, collection dates, and exclusions beside the result. A score without its measurement contract is difficult to compare or audit.
Turn the observation into a test
retain a declared set and add observed competitors through a documented review rule.
Record the observation, hypothesis, planned change, owner, expected mechanism, and retest condition separately. This keeps the report honest when evidence is incomplete.
Questions to resolve before acting
What should Competitor Set Design measurement include?
At minimum, keep declared competitors, observed competitors, category fit, buyer overlap, and exclusion reason. The result should remain traceable to the exact question and collection conditions.
What is the main interpretation risk?
a narrow hand-picked set can overstate share while missing the vendor that wins the answer. Treat observed answers as bounded evidence, not proof of a universal ranking or a hidden model cause.
Which metric should the team review first?
Start with eligible observations covered by the reviewed competitor set. Keep its numerator, denominator, eligible question set, and collection period visible beside the result.