Skip to content

New

Prompt A/B Diff

Ask one model the same thing two ways and see what each phrasing costs.

How you word a prompt has a price. Ask one model the same thing two ways, with your own key, and see each answer next to its token cost and speed. Comes pre-loaded with a long, rambling ask beside a short, tight one, so your first run shows the rambling version using far more tokens and costing more for the same answer. It works with any model your key can reach, so it never goes out of date.

This free tool is a slice of the full product. With a paid plan you also get:

  • score which prompt answers best
  • test many prompts across your workload
  • see which part of your setup caused a weak answer
  • track drift over time
  • let your AI agent run it for you
See plans ->

Free tool, provided as-is, no warranty. Uses your own API key. You are responsible for your usage and costs. Keys never leave your machine and are never sent to pysolvr. Outputs are informational, not advice. pysolvr is not liable for decisions made from these results.