What is Prompt Set?
Prompt Set is a curated collection of prompts used for testing or monitoring AI outputs. Prompt Set design determines what is measured and how representative the monitoring results are.
Quick definition
Prompt Set is a list of prompts chosen to measure a specific topic or goal.
How Prompt Set works
- Prompt Set selection typically includes prompts across multiple intents.
- Prompt Set is stored as a stable list so prompt tracking can compare runs.
- Prompt Set can be expanded by prompt discovery to increase coverage.
- Prompt Set can be segmented by topic, product area, or audience.
Why Prompt Set matters
Prompt Set matters because a narrow prompt set can overstate or understate AI visibility.
Prompt Set supports:
- repeatable monitoring across time
- controlled experiments for AI prompt testing
- clear reporting by intent category
Example use cases
- Creating a prompt set for product evaluation questions and comparisons.
- Creating a prompt set for definitions and how-to troubleshooting.
- Maintaining separate prompt sets for different markets or personas.