What is Prompt Set?

Prompt Set is a curated collection of prompts used for testing or monitoring AI outputs. Prompt Set design determines what is measured and how representative the monitoring results are.

Quick definition

Prompt Set is a list of prompts chosen to measure a specific topic or goal.

How Prompt Set works

  • Prompt Set selection typically includes prompts across multiple intents.
  • Prompt Set is stored as a stable list so prompt tracking can compare runs.
  • Prompt Set can be expanded by prompt discovery to increase coverage.
  • Prompt Set can be segmented by topic, product area, or audience.

Why Prompt Set matters

Prompt Set matters because a narrow prompt set can overstate or understate AI visibility.

Prompt Set supports:

  • repeatable monitoring across time
  • controlled experiments for AI prompt testing
  • clear reporting by intent category

Example use cases

  • Creating a prompt set for product evaluation questions and comparisons.
  • Creating a prompt set for definitions and how-to troubleshooting.
  • Maintaining separate prompt sets for different markets or personas.

Related terms