rubrkit
MCP-native AI evaluation: rubric audits, eval suites, and proof reports for AI/LLM output.
Community: Submitted by a user or imported; check the owner before granting accessOnlineNo sign-inGlobalFreeRead-only
What it can do
What data it sees
Do you need an account
No: the server works without sign-in
MCP-native AI evaluation: rubric audits, eval suites, and proof reports for AI/LLM output.
Server tool list (41)
Raw names from tools/list. Only developers need these.
| rubrkit_search_api_docs | Search the canonical docs/api Markdown guides and OpenAPI operation summaries. |
| rubrkit_read_api_doc | Read a docs/api Markdown guide or OpenAPI source by slug, file name, or docs/api path. |
| rubrkit_read_openapi_contract | Read the canonical docs/api/openapi.yaml contract. |
| rubrkit_create_artifact_bundle | Create an artifact bundle through /api/v1/artifact-bundles. Requires artifact_bundles:write for API keys. |
| rubrkit_list_artifact_bundles | List artifact bundles through /api/v1/artifact-bundles. Requires artifact_bundles:read for API keys. |
| rubrkit_read_artifact_bundle | Read artifact bundle details, files, and file tree. Requires artifact_bundles:read for API keys. |
| rubrkit_delete_artifact_bundle | Archive an artifact bundle (soft delete) through DELETE /api/v1/artifact-bundles/{artifactBundleId}. The bundle moves to the archived state and can be restored or permanently deleted later. Requires artifact_bundles:write for API keys. |
| rubrkit_hard_delete_artifact_bundle | Permanently delete an archived artifact bundle and all of its files, versions, and run history through DELETE /api/v1/artifact-bundles/{artifactBundleId}/permanent. This is irreversible and only works on bundles that are already archived. Requires artifact_bundles:write for API keys. |
| rubrkit_upload_artifact_files | Upload one or more text files into an artifact bundle. Requires files:write for API keys. |
| rubrkit_list_artifact_files | List files in an artifact bundle. Requires files:read for API keys. |
| rubrkit_read_artifact_file | Read the latest file metadata and content. Requires files:read for API keys. |
| rubrkit_update_artifact_file | Write a new editable version for a file. Requires files:write for API keys. |
| rubrkit_start_audit | Start an async audit job. Audit results are cached per account by a content hash of their inputs; pass force: true to bypass the cache and run a fresh audit (the same as the CLI's --no-cache flag). Requires audits:run for API keys. |
| rubrkit_list_audits | List persisted audit history. Requires artifact_bundles:read for API keys. |
| rubrkit_read_audit | Read a single audit run. Requires artifact_bundles:read for API keys. |
| rubrkit_apply_audit_rewrite | Apply a completed audit's AI rewrite to the bundle files (a new version per changed file). Requires audits:run for API keys. |
| rubrkit_convert_to_rubr_flow | Start an async rubr_flow conversion job. Requires rubr_flow:convert for API keys. |
| rubrkit_list_rubr_flow_conversions | List conversion history. Requires artifact_bundles:read for API keys. |
| rubrkit_read_rubr_flow_conversion | Read one conversion report. Requires artifact_bundles:read for API keys. |
| rubrkit_poll_job | Read async job progress. Requires jobs:read for API keys. |
| rubrkit_list_job_events | Read append-only job progress events. Requires jobs:read for API keys. |
| rubrkit_list_artifact_bundle_versions | List bundle-level version events. Requires artifact_bundles:read for API keys. |
| rubrkit_restore_artifact_bundle_version | Restore files from a prior artifact-bundle version by creating new file versions. Requires artifact_bundles:write and files:write for API keys. |
| rubrkit_list_file_versions | List immutable versions for a file. Requires files:read for API keys. |
| rubrkit_restore_file_version | Restore a prior file version by creating a new version. Requires files:write for API keys. |
| rubrkit_run_evals | Start an async eval run. Requires evals:run for API keys. Set mode: "advanced" with baselineVersionId and candidateVersionId to run a statistically-backed A/B (repeats defaults to 3, max 5). |
| rubrkit_list_evals | List eval history. Requires artifact_bundles:read for API keys. |
| rubrkit_read_eval | Read one eval run, including the `stats` statistical verdict on advanced-mode runs (empty for standard runs). Requires artifact_bundles:read for API keys. |
| rubrkit_export_proof_report | Start an async proof report job with export storage enabled by default. Requires evals:run for API keys. |
| rubrkit_read_proof_report | Read one proof report. Requires artifact_bundles:read for API keys. |
| rubrkit_list_golden_cases | List the golden cases for an artifact bundle via /api/v1/artifact-bundles/{artifactBundleId}/golden-cases. Requires artifact_bundles:read (or artifacts:pull) for API keys. |
| rubrkit_add_golden_case | Add a golden case (a real edge-case input with a confirmed-correct output) to an artifact bundle via POST /api/v1/artifact-bundles/{artifactBundleId}/golden-cases. Requires artifact_bundles:write for API keys. |
| rubrkit_retire_golden_case | Retire a golden case via DELETE /api/v1/golden-cases/{goldenCaseId}. Requires artifact_bundles:write for API keys. |
| rubrkit_create_drift_monitor | Create a drift monitor pinned to a file version via POST /api/v1/artifact-bundles/{artifactBundleId}/drift-monitors. Requires artifact_bundles:write for API keys. |
| rubrkit_list_drift_monitors | List the drift monitors for an artifact bundle via /api/v1/artifact-bundles/{artifactBundleId}/drift-monitors. Requires artifact_bundles:read (or artifacts:pull) for API keys. |
| rubrkit_read_drift_observations | List the recorded observations for a drift monitor via /api/v1/drift-monitors/{driftMonitorId}/observations. Requires artifact_bundles:read (or artifacts:pull) for API keys. |
| rubrkit_run_drift_check | Queue a drift check immediately instead of waiting for the monitor's schedule, via POST /api/v1/drift-monitors/{driftMonitorId}/check. The first check on a new monitor calibrates its baseline. Costs one audit per repeat. Requires artifact_bundles:write for API keys. |
| rubrkit_set_drift_monitor_status | Pause or resume a drift monitor via PATCH /api/v1/drift-monitors/{driftMonitorId}. Requires artifact_bundles:write for API keys. |
| rubrkit_record_outcome | Record a production outcome event (input feature, metric, and/or label) for an artifact bundle via POST /api/v1/artifact-bundles/{artifactBundleId}/outcomes. Requires artifact_bundles:write for API keys. |
| rubrkit_read_input_drift | Compare recent production inputs against a prior reference window (population stability index) for an artifact bundle via GET /api/v1/artifact-bundles/{artifactBundleId}/drift/input. Requires artifact_bundles:read (or artifacts:pull) for API keys. |
| rubrkit_read_validity_drift | Correlate rubric scores against recorded outcome metrics for an artifact bundle to check whether the rubric is still predictive via GET /api/v1/artifact-bundles/{artifactBundleId}/drift/validity. Requires artifact_bundles:read (or artifacts:pull) for API keys. |