dheeraj1918/llm-analyzer

LLM-Analyzer is a provider-agnostic Python library and local observability dashboard. An application captures a response directly or wraps a synchronous/asynchronous LLM call; the analyzer measures latency, extracts available metadata, records successes or errors, and can optionally evaluate responses using supplied evidence or a custom evaluator. Captures and evaluation results are stored in temporary SQLite, then served through dashboard APIs and a browser UI, with CSV export. The CLI starts the dashboard or reports the database path. The workflow is supported by sampled core, extraction, evaluation, storage, and dashboard code; other README capabilities are represented only where their module path or documentation supports them.