SCRIPTMASTERLABS — Calibration Court
Calibration Court MCP: model calibration leaderboard, ledger verify, paid recalibration via x402.
| Endpoint | https://calibration-court.onrender.com/mcp (streamable-http) |
|---|---|
| Registry version | 1.0.1 |
| Now | 5 tools · grade A (97) · pin ts_38c79613c0222c4549bf10dc45b06b39 · protocol 2025-06-18 |
| First / last listed | 2026-11-01 00:26 UTC / 2026-11-01 00:26 UTC |
| Grade over time | 2026-11-01: A (97), 5 tools |
Is this your server? Own a server? ToolFit hosted watch re-checks it every 24 h ($0.25 per 30 days) or 6 h ($0.60) and sends you an HMAC-signed webhook when its tools or grade change: POST https://api.youraitools.co/toolfit/v1/watch. To opt out, see About & opt-out.
Tools: court_leaderboard court_model_report court_verify_ledger court_recalibrate court_calibrate_labels
court_leaderboard | Live ranking of decision models by Brier score on resolved real-world questions. Free. Returns empty lists when nothing has resolved. params: task_type |
court_model_report | Calibration report for one model: Brier, ECE, reliability bins with Wilson intervals, overconfidence, drift. Free. params: model*, task_type |
court_verify_ledger | Recompute the SHA-256 hash chain and cross-check derived tables. Free. params: none |
court_recalibrate | Paid (x402, USDC on Base). Map a model's raw probability to an empirically calibrated one using resolved outcomes on the ledger. Refuses with insufficient_data below 30 samples. params: model*, prob*, task_type |
court_calibrate_labels | Paid (x402, USDC on Base). Fit isotonic calibration on YOUR labelled outcomes ({p,y} pairs) and recalibrate the given probabilities. Stateless; nothing is stored. params: examples*, probs* |
Entries describe changes in tool definitions. They are not statements about a server, its quality or its author. The grade measures how the tool definitions fit model providers (token cost, schema compatibility, confusable names) as scored by the ToolFit engine at the time of the listing. JSON: append .json. Opt-out: how or hello@youraitools.co.