New
Variance Tester
Run the same prompt at one model several times and see how much the answer moves.
Ask one model the same question five times, with your own key, and watch five different answers come back. You get every answer, its cost and speed, and a simple number for how much the wording changed from one run to the next. About a minute, free, no signup. Your keys stay on your machine. It works with any model your key can reach, so it never goes out of date.
This free tool is a slice of the full product. With a paid plan you also get:
- score how consistent a model is across runs
- spot when answer quality swings from one run to the next
- see which part of your setup caused a weak answer
- track consistency over time
- let your AI agent run it for you
Free tool, provided as-is, no warranty. Uses your own API key. You are responsible for your usage and costs. Keys never leave your machine and are never sent to pysolvr. Outputs are informational, not advice. pysolvr is not liable for decisions made from these results.