MCP-native AI evaluation: rubric audits, eval suites, and proof reports for AI/LLM output.
| Endpoint | https://www.rubrkit.com/api/v1/mcp (streamable-http) |
|---|---|
| Registry version | 1.0.0 |
| Now | 41 tools · grade C (67) · pin ts_503c682b6b00174c4fb62d3d86f9c330 · protocol 2025-06-18 |
| First / last listed | 2026-11-12 01:20 UTC / 2026-11-12 01:20 UTC |
| Grade over time | 2026-11-12: C (67), 41 tools |
Is this your server? Own a server? ToolFit hosted watch re-checks it every 24 h ($0.25 per 30 days) or 6 h ($0.60) and sends you an HMAC-signed webhook when its tools or grade change: POST https://api.youraitools.co/toolfit/v1/watch. To opt out, see About & opt-out.
Tools: rubrkit_search_api_docs rubrkit_read_api_doc rubrkit_read_openapi_contract rubrkit_create_artifact_bundle rubrkit_list_artifact_bundles rubrkit_read_artifact_bundle rubrkit_delete_artifact_bundle rubrkit_hard_delete_artifact_bundle rubrkit_upload_artifact_files rubrkit_list_artifact_files rubrkit_read_artifact_file rubrkit_update_artifact_file rubrkit_compact_artifact_file rubrkit_estimate_deep_compaction rubrkit_apply_deep_compaction rubrkit_start_audit rubrkit_list_audits rubrkit_read_audit rubrkit_apply_audit_rewrite rubrkit_poll_job rubrkit_list_job_events rubrkit_list_artifact_bundle_versions rubrkit_restore_artifact_bundle_version rubrkit_list_file_versions rubrkit_restore_file_version rubrkit_run_evals rubrkit_list_evals rubrkit_read_eval rubrkit_export_proof_report rubrkit_read_proof_report rubrkit_list_golden_cases rubrkit_add_golden_case rubrkit_retire_golden_case rubrkit_create_drift_monitor rubrkit_list_drift_monitors rubrkit_read_drift_observations rubrkit_run_drift_check rubrkit_set_drift_monitor_status rubrkit_record_outcome rubrkit_read_input_drift rubrkit_read_validity_drift
rubrkit_search_api_docs | Search the canonical docs/api Markdown guides and OpenAPI operation summaries. params: query*, limit |
rubrkit_read_api_doc | Read a docs/api Markdown guide or OpenAPI source by slug, file name, or docs/api path. params: slugOrPath* |
rubrkit_read_openapi_contract | Read the canonical docs/api/openapi.yaml contract. params: none |
rubrkit_create_artifact_bundle | Create an artifact bundle through /api/v1/artifact-bundles. Requires artifact_bundles:write for API keys. params: name*, description, customRubric, settings |
rubrkit_list_artifact_bundles | List artifact bundles through /api/v1/artifact-bundles. Requires artifact_bundles:read for API keys. params: status, limit |
rubrkit_read_artifact_bundle | Read artifact bundle details, files, and file tree. Requires artifact_bundles:read for API keys. params: artifactBundleId* |
rubrkit_delete_artifact_bundle | Archive an artifact bundle (soft delete) through DELETE /api/v1/artifact-bundles/{artifactBundleId}. The bundle moves to the archived state and can be restored or permanently deleted later. Requires artifact_bundles:write for API keys. params: artifactBundleId* |
rubrkit_hard_delete_artifact_bundle | Permanently delete an archived artifact bundle and all of its files, versions, and run history through DELETE /api/v1/artifact-bundles/{artifactBundleId}/permanent. This is irreversible and only works on bundles that are already archived. Requires artifact_bundles:write for API keys. params: artifactBundleId* |
rubrkit_upload_artifact_files | Upload one or more text files into an artifact bundle. Requires files:write for API keys. params: artifactBundleId*, files* |
rubrkit_list_artifact_files | List files in an artifact bundle. Requires files:read for API keys. params: artifactBundleId*, limit |
rubrkit_read_artifact_file | Read the latest file metadata and content. Requires files:read for API keys. params: artifactBundleId*, fileId* |
rubrkit_update_artifact_file | Write a new editable version for a file. Requires files:write for API keys. params: artifactBundleId*, fileId*, content*, mediaType, message |
rubrkit_compact_artifact_file | Shorten a markdown or text prompt without losing instructions. mode standard (default) is a free deterministic pass that saves a new version unless dryRun is true; requires files:write for API keys. mode deep starts an AI compaction job that uses credits, verifies every instruction was kept, and never saves on its own: poll the returned job, then call rubrkit_apply_deep_compaction; requires compac params: artifactBundleId*, fileId*, mode, dryRun |
rubrkit_estimate_deep_compaction | Estimate the credit cost of a deep compaction of one file before starting it. Requires compactions:run for API keys. params: artifactBundleId*, fileId* |
rubrkit_apply_deep_compaction | Save a succeeded deep compaction job's verified result as a new version of the file. Refused if the file changed since the job started. Requires files:write for API keys. params: artifactBundleId*, fileId*, jobId* |
rubrkit_start_audit | Start an async audit job. Audit results are cached per account by a content hash of their inputs; pass force: true to bypass the cache and run a fresh audit (the same as the CLI's --no-cache flag). Requires audits:run for API keys. params: artifactBundleId*, targetFileId, targetVersionNumber, artifactBundleVersionNumber, rubricKey, artifactType, customRequirements, modelTier, reasoningEffort, force |
rubrkit_list_audits | List persisted audit history. Requires artifact_bundles:read for API keys. params: artifactBundleId*, limit |
rubrkit_read_audit | Read a single audit run. Requires artifact_bundles:read for API keys. params: artifactBundleId*, auditRunId* |
rubrkit_apply_audit_rewrite | Apply a completed audit's AI rewrite to the bundle files (a new version per changed file). Requires audits:run for API keys. params: artifactBundleId*, auditRunId* |
rubrkit_poll_job | Read async job progress. Requires jobs:read for API keys. params: jobId* |
rubrkit_list_job_events | Read append-only job progress events. Requires jobs:read for API keys. params: jobId*, limit |
rubrkit_list_artifact_bundle_versions | List bundle-level version events. Requires artifact_bundles:read for API keys. params: artifactBundleId*, limit |
rubrkit_restore_artifact_bundle_version | Restore files from a prior artifact-bundle version by creating new file versions. Requires artifact_bundles:write and files:write for API keys. params: artifactBundleId*, versionNumber*, message |
rubrkit_list_file_versions | List immutable versions for a file. Requires files:read for API keys. params: artifactBundleId*, fileId*, limit |
rubrkit_restore_file_version | Restore a prior file version by creating a new version. Requires files:write for API keys. params: artifactBundleId*, fileId*, versionNumber*, message |
rubrkit_run_evals | Start an async eval run. Requires evals:run for API keys. Set mode: "advanced" with baselineVersionId and candidateVersionId to run a statistically-backed A/B (repeats defaults to 3, max 5). params: artifactBundleId*, auditRunId, sourceFileVersionId, sourceFileId, sourceVersionNumber, candidateFileVersionId, candidateFileId, candidateVersionNumber, rubricVersion, maxCases, testCases, mode, repeats, baselineVersionId, candidateVersionId |
rubrkit_list_evals | List eval history. Requires artifact_bundles:read for API keys. params: artifactBundleId*, limit |
rubrkit_read_eval | Read one eval run, including the `stats` statistical verdict on advanced-mode runs (empty for standard runs). Requires artifact_bundles:read for API keys. params: artifactBundleId*, evalRunId* |
rubrkit_export_proof_report | Start an async proof report job with export storage enabled by default. Requires evals:run for API keys. params: artifactBundleId*, evalRunId, auditRunId, sourceFileVersionId, sourceFileId, sourceVersionNumber, candidateFileVersionId, candidateFileId, candidateVersionNumber, rubricVersion, includeExport |
rubrkit_read_proof_report | Read one proof report. Requires artifact_bundles:read for API keys. params: artifactBundleId*, proofReportId* |
rubrkit_list_golden_cases | List the golden cases for an artifact bundle via /api/v1/artifact-bundles/{artifactBundleId}/golden-cases. Requires artifact_bundles:read (or artifacts:pull) for API keys. params: artifactBundleId*, status |
rubrkit_add_golden_case | Add a golden case (a real edge-case input with a confirmed-correct output) to an artifact bundle via POST /api/v1/artifact-bundles/{artifactBundleId}/golden-cases. Requires artifact_bundles:write for API keys. params: artifactBundleId*, input*, expectedOutput, criteria, origin, originRef, weight, tags |
rubrkit_retire_golden_case | Retire a golden case via DELETE /api/v1/golden-cases/{goldenCaseId}. Requires artifact_bundles:write for API keys. params: goldenCaseId* |
rubrkit_create_drift_monitor | Create a drift monitor pinned to a file version via POST /api/v1/artifact-bundles/{artifactBundleId}/drift-monitors. Requires artifact_bundles:write for API keys. params: artifactBundleId*, pinnedVersionId*, cadence, repeats |
rubrkit_list_drift_monitors | List the drift monitors for an artifact bundle via /api/v1/artifact-bundles/{artifactBundleId}/drift-monitors. Requires artifact_bundles:read (or artifacts:pull) for API keys. params: artifactBundleId* |
rubrkit_read_drift_observations | List the recorded observations for a drift monitor via /api/v1/drift-monitors/{driftMonitorId}/observations. Requires artifact_bundles:read (or artifacts:pull) for API keys. params: driftMonitorId* |
rubrkit_run_drift_check | Queue a drift check immediately instead of waiting for the monitor's schedule, via POST /api/v1/drift-monitors/{driftMonitorId}/check. The first check on a new monitor calibrates its baseline. Costs one audit per repeat. Requires artifact_bundles:write for API keys. params: driftMonitorId* |
rubrkit_set_drift_monitor_status | Pause or resume a drift monitor via PATCH /api/v1/drift-monitors/{driftMonitorId}. Requires artifact_bundles:write for API keys. params: driftMonitorId*, status* |
rubrkit_record_outcome | Record a production outcome event (input feature, metric, and/or label) for an artifact bundle via POST /api/v1/artifact-bundles/{artifactBundleId}/outcomes. Requires artifact_bundles:write for API keys. params: artifactBundleId*, artifactVersionId, inputHash, inputFeature, outcomeMetric, outcomeLabel, occurredAt |
rubrkit_read_input_drift | Compare recent production inputs against a prior reference window (population stability index) for an artifact bundle via GET /api/v1/artifact-bundles/{artifactBundleId}/drift/input. Requires artifact_bundles:read (or artifacts:pull) for API keys. params: artifactBundleId*, windowDays, binCount |
rubrkit_read_validity_drift | Correlate rubric scores against recorded outcome metrics for an artifact bundle to check whether the rubric is still predictive via GET /api/v1/artifact-bundles/{artifactBundleId}/drift/validity. Requires artifact_bundles:read (or artifacts:pull) for API keys. params: artifactBundleId* |
Entries describe changes in tool definitions. They are not statements about a server, its quality or its author. The grade measures how the tool definitions fit model providers (token cost, schema compatibility, confusable names) as scored by the ToolFit engine at the time of the listing. JSON: append .json. Opt-out: how or hello@youraitools.co.