← jwatte.com

AI Answer Accuracy Monitor

Profound charges $499/month and Athena AI charges $299/month for LLM-accuracy monitoring. This runs the same loop: declare facts → generate prompts → paste LLM responses → score → track over time. LocalStorage-backed history, per-model trend, CSV export. Free.

Context and background

Read the story behind this tool: Per-model accuracy tracking without a $500/month subscription →

Brand + canonical facts

Log an observation

Run one of the prompts above in a fresh LLM chat (no prior context). Paste the response below, pick which LLM it came from, click "Score + log." The tool runs accuracy matching and appends to history.