AimRank

Read public pairwise-preference rankings and their statistical quality evidence.

CommunityOnlineNo sign-inGlobalFreeRead-only

What it can do

    What data it sees

    Do you need an account

    No: the server works without sign-in

    Read public pairwise-preference rankings and their statistical quality evidence. No API key.

    How to connect

    How to connect AimRank to Claude

    The server address to paste into Claude settings:

    https://app.aimrank.io/mcp/public

    1. Open Claude (claude.ai or the desktop app).
    2. Go to Settings → Connectors.
    3. Click Add custom connector.
    4. Paste the server address copied below into Remote MCP server URL and click Add.
    5. In a chat, click + → Connectors and switch the new connector on.

    Custom connectors are available on Free, Pro, Max, Team and Enterprise plans (Free is limited to one). On Team and Enterprise an organization Owner adds the connector first under Organization settings → Connectors.

    Authorization

    After you click Add, a sign-in window for the service opens. Sign in with your own account and approve access. Claude never sees your password.

    How to connect AimRank to ChatGPT

    The server address to paste into ChatGPT settings:

    https://app.aimrank.io/mcp/public

    1. Open ChatGPT in a browser (chatgpt.com). A Plus, Pro, Business, Enterprise or Edu plan is required.
    2. Turn on developer mode once: Settings → Apps → Advanced settings → Developer mode.
    3. Open Settings → Connectors and click Create.
    4. Fill in the form: Name (anything), Description (one line about what the service does), MCP server URL (copy it below).
    5. Under Authentication choose OAuth if the service requires sign-in, otherwise None. Click Create.
    6. In a new chat open + → Apps/Connectors and enable the connector.

    OpenAI has renamed this section before (Connectors → Apps/Plugins). If the label differs, search settings for "developer mode". On Business/Enterprise workspaces an admin must allow custom connectors first.

    Authorization

    On first use ChatGPT opens the service's sign-in window. Sign in and approve access.

    How to connect AimRank to Cursor

    The server address to paste into Cursor settings:

    https://app.aimrank.io/mcp/public

    Fastest: click Open in Cursor below and confirm the prompt.

    Manually:

    1. In Cursor open Settings → Cursor Settings → MCP and click Add new global MCP server.
    2. Paste the JSON copied below into ~/.cursor/mcp.json (per project: .cursor/mcp.json in the repo root).
    3. Save the file. The server appears in the MCP list; authorize it there if asked.

    Authorization

    If the service needs sign-in, an authorize button appears next to the server in the MCP list.

    Server tool list (21)

    Raw names from tools/list. Only developers need these.

    aimrank_get_daily_pairFetch today's Daily Pair — the trending matchup chosen at 00:00 UTC. Pairs with the `vote_of_the_day` agent template. Returns the challenge + a fresh matchup. If the cron hasn't run yet, falls back via ok=False so the agent can use `aimrank_get_matchup` instead. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
    aimrank_get_rankingFetch a ranking's metadata + top 25 entities sorted by rating. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
    aimrank_get_leaderboardGet the top N entities of a ranking sorted by rating. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
    aimrank_get_matchupGet the next pair of entities to evaluate. Strategies: adaptive (default), swiss, balanced, random, uncertainty, explore, information_gain. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
    aimrank_search_entitiesFind entities by name substring within a ranking. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
    aimrank_create_share_cardReturn share-ready URLs + embed snippets for a ranking. Formats: "all" (default — everything), "twitter", "linkedin", "embed_leaderboard", "embed_vote", "badge_markdown", "qr_code", "data_card". Pass these to a human to paste into a tweet, blog, Notion page, or Slack message. The OG image renders automatically when the public_url is unfurled by Twitter / LinkedIn / Slack. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
    aimrank_predict_matchup_winnerPredict the winner of a matchup BEFORE a vote is cast. Uses Glicko-2 win probability under the same formula matchmaking uses internally. Pairs with aimrank_submit_vote for the "Claude predicts, you vote, we compare" demo. Does not record a vote — read-only. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
    aimrank_discover_public_rankingsBrowse public rankings — agent equivalent of surfing aimrank.io. Filters: category, media_type ("text" | "image" | "audio" | "video"), sort ("trending" | "recent" | "most_votes" | "random"), limit 1-50. Each result embeds share assets so the agent can hand any ranking back to the user as a clickable link without a follow-up call. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
    aimrank_list_domain_entitiesList all entities in a domain's pool sorted by rating. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
    aimrank_get_domainGet domain details including entity pool and competition list. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
    aimrank_list_competitionsList all competitions (open voting + brackets) in a domain. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
    aimrank_get_data_cardAuto data card — Layer 7. Provenance + IAA + coverage + per-annotator quality + transitivity + qualification stats in one synthesized markdown audit artefact. Format: 'markdown' (default) or 'json' for structured summary. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
    aimrank_get_agreementInter-annotator agreement — Layer 5. Returns Cohen's κ (n=2 raters), Fleiss' κ, Krippendorff's α, Scott's π + Landis-Koch interpretation, plus the multi-rater coverage report. `min_raters` overrides the ranking's configured min_raters_per_pair. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
    aimrank_get_ceilingPairwise-κ ceiling from qualification attempts. The upper bound any judge / RM can credibly hit on this domain — used to pin the L3 pilot refund clause (refund if κ < ceiling - 5pp). api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
    aimrank_get_plackett_lucePlackett-Luce listwise ranking aggregation — OFFLINE AUDIT ONLY. Reported post-hoc; it NEVER writes ratings, and setting it as a ranking's algorithm returns 400. AimRank has 6 rating engines plus 2 offline aggregators (this and CrowdBT) — never describe it as an 8th rating algorithm. Generalises Bradley-Terry to ranked lists. On pairwise data, collapses to BT MLE — useful as a second-opinion aggregator. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
    aimrank_get_crowd_btCrowdBT — joint fit of entity scores + per-annotator reliability η. Surfaces noisy / anti-correlated raters explicitly. Methodology audit, not a live engine. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
    aimrank_list_public_judgesBrowse public judge-prompt artifacts shared by other users. Filter by ``category`` (free-text), ``domain_id``, or both. Sort options: ``fork_count`` (default — most-forked first), ``recent``, ``faithfulness``. Returns artifact summaries WITHOUT the full prompt text — call `aimrank_fork_judge_prompt` or the REST GET to retrieve the full prompt before using it. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
    aimrank_find_similar_domainsFind public domains most similar to a query or a known domain. Use ``query`` for free-text search ("pharma evaluation") OR ``domain_id`` to find domains similar to one you already know. Exactly one must be provided. TF-IDF + cosine similarity over name + description + category + declared constitution + objectives text. Cheap (no embedding API calls), 5-minute in-process cache. Only public domains are searched / returned. Score in [0, 1] — typical "useful match" threshold is ≥0.15; "near duplicate" is ≥0.5. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
    aimrank_predictiCOMPLY contract: pairwise prediction with provenance fields. Returns the engine's predicted winner + probability shaped so iCOMPLY's Annex IV section-4 generator can ingest the response directly. See [iCOMPLY_INTEGRATION_STRATEGY.md] for the contract. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
    aimrank_explainiCOMPLY contract: explain a prediction in features + narrative. Returns the Glicko-2 μ/φ inputs for both entities + a deterministic narrative. No LLM-synthesised rationale — these are the actual numbers the math uses, which is exactly what an Annex IV auditor needs to trace. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
    aimrank_healthcheckiCOMPLY contract: liveness + DB-connectivity probe.