Skip to content

New

System-Prompt A/B

Ask one model the same question under two sets of standing instructions and see what each costs.

The standing instructions you give a model, its persona and rules, have a price too. Ask one model the same question under two of them, with your own key, and see each answer next to its token cost and speed. Comes pre-loaded with a vague instruction beside a tight one, so your first run shows the vague version using more tokens and costing more for the same answer. It works with any model your key can reach, so it never goes out of date.

This free tool is a slice of the full product. With a paid plan you also get:

  • score which system prompt answers best
  • test guardrails across your workload
  • see which part of your setup caused a weak answer
  • track drift over time
  • let your AI agent run it for you
See plans ->

Free tool, provided as-is, no warranty. Uses your own API key. You are responsible for your usage and costs. Keys never leave your machine and are never sent to pysolvr. Outputs are informational, not advice. pysolvr is not liable for decisions made from these results.