AimRank
Read public pairwise-preference rankings and their statistical quality evidence. No API key.
| Endpoint | https://app.aimrank.io/mcp/public (streamable-http) |
|---|---|
| Registry version | 4.12.0 |
| Now | 21 tools · grade C (75) · pin ts_03704ba8eaf7df4eba7a434b22faea54 · protocol 2025-06-18 |
| First / last listed | 2026-11-15 01:30 UTC / 2026-11-15 01:30 UTC |
| Grade over time | 2026-11-15: C (75), 21 tools |
Is this your server? Own a server? ToolFit hosted watch re-checks it every 24 h ($0.25 per 30 days) or 6 h ($0.60) and sends you an HMAC-signed webhook when its tools or grade change: POST https://api.youraitools.co/toolfit/v1/watch. To opt out, see About & opt-out.
Tools: aimrank_get_daily_pair aimrank_get_ranking aimrank_get_leaderboard aimrank_get_matchup aimrank_search_entities aimrank_create_share_card aimrank_predict_matchup_winner aimrank_discover_public_rankings aimrank_list_domain_entities aimrank_get_domain aimrank_list_competitions aimrank_get_data_card aimrank_get_agreement aimrank_get_ceiling aimrank_get_plackett_luce aimrank_get_crowd_bt aimrank_list_public_judges aimrank_find_similar_domains aimrank_predict aimrank_explain aimrank_healthcheck
aimrank_get_daily_pair | Fetch today's Daily Pair — the trending matchup chosen at 00:00 UTC.
Pairs with the `vote_of_the_day` agent template. Returns the challenge
+ a fresh matchup. If the cron hasn't run yet, falls back via
ok=False so the agent can use `aimrank_get_matchup` instead.
api_key is optional on the public endpoint; on /mcp/mcp a missing
key is refused. params: api_key |
aimrank_get_ranking | Fetch a ranking's metadata + its top 25 entities.
Entities carry a Bradley-Terry rating with a 95% interval (ci_95) and
a tie-aware rank: entities whose intervals overlap share a rank.
api_key is optional on the public endpoint; on /mcp/mcp a missing
key is refused. params: ranking_id*, api_key |
aimrank_get_leaderboard | Get the top N entities of a ranking with honest uncertainty.
Ratings come from a Bradley-Terry fit over the counted votes, each
with a 95% interval (ci_95). `rank` is tie-aware — entities the data
cannot separate share a rank — and `provisional` is true while any
do. `method` says how the numbers were computed.
api_key is optional on the public endpoint; on /mcp/mcp a missing
key is refused. params: ranking_id*, api_key, limit |
aimrank_get_matchup | Get the next pair of entities to evaluate.
Strategies: adaptive (default), swiss, balanced, random,
uncertainty, explore, information_gain, escalation -- the same
selection the web app uses. Left/right order is randomised, and the
pair comes with no rating or predicted winner (match_quality is
closeness only), so show it to the voter as-is.
`escalation` is the human review queue: only pairs an A params: ranking_id*, api_key, strategy |
aimrank_search_entities | Find entities by name substring within a ranking.
api_key is optional on the public endpoint; on /mcp/mcp a missing
key is refused. params: ranking_id*, query*, api_key, limit |
aimrank_create_share_card | Return share-ready URLs + embed snippets for a ranking.
Formats: "all" (default — everything), "twitter", "linkedin",
"embed_leaderboard", "embed_vote", "badge_markdown", "qr_code",
"data_card". Pass these to a human to paste into a tweet, blog,
Notion page, or Slack message. The OG image renders automatically
when the public_url is unfurled by Twitter / LinkedIn / Slack.
api_key is optional on params: ranking_id*, api_key, format |
aimrank_predict_matchup_winner | Predict a matchup's winner from the current ratings -- for analysis.
Uses Glicko-2 win probability under the same formula matchmaking
uses internally. Use it to analyse a ranking, or AFTER a vote to
compare the cast vote with what the ratings expected. Never show a
prediction to a voter before they vote: a voter who sees who
"should" win anchors on it, and the preference data stops being
independ params: ranking_id*, entity_a_id*, entity_b_id*, api_key |
aimrank_discover_public_rankings | Browse public rankings — agent equivalent of surfing aimrank.io.
Filters: category, media_type ("text" | "image" | "audio" | "video"),
sort ("trending" | "recent" | "most_votes" | "random"), limit 1-50.
Each result embeds share assets so the agent can hand any ranking
back to the user as a clickable link without a follow-up call.
api_key is optional on the public endpoint; on /mcp/mcp a missing
params: api_key, category, media_type, sort, limit |
aimrank_list_domain_entities | List all entities in a domain's pool sorted by rating.
api_key is optional on the public endpoint; on /mcp/mcp a missing
key is refused. params: domain_id*, api_key |
aimrank_get_domain | Get domain details including entity pool and competition list.
api_key is optional on the public endpoint; on /mcp/mcp a missing
key is refused. params: domain_id*, api_key |
aimrank_list_competitions | List all competitions (open voting + brackets) in a domain.
api_key is optional on the public endpoint; on /mcp/mcp a missing
key is refused. params: domain_id*, api_key |
aimrank_get_data_card | Auto data card — Layer 7. Provenance + IAA + coverage +
per-annotator quality + transitivity + qualification stats in
one synthesized markdown audit artefact.
Format: 'markdown' (default) or 'json' for structured summary.
api_key is optional on the public endpoint; on /mcp/mcp a missing
key is refused. params: ranking_id*, api_key, format |
aimrank_get_agreement | Inter-annotator agreement — Layer 4. Returns Cohen's κ
(n=2 raters), Fleiss' κ, Krippendorff's α, Scott's π +
Landis-Koch interpretation, plus the multi-rater coverage report.
`min_raters` overrides the ranking's configured min_raters_per_pair.
Also returns `judge_alignment` — how AI judges relate to people on
this ranking: each judge's agreement with the human majority (Cohen's
κ, Wilson 95% in params: ranking_id*, api_key, min_raters, judge_id |
aimrank_get_ceiling | Pairwise-κ ceiling from qualification attempts. The upper
bound any judge / RM can credibly hit on this domain — used to
pin the L3 pilot refund clause (refund if κ < ceiling - 5pp).
api_key is optional on the public endpoint; on /mcp/mcp a missing
key is refused. params: ranking_id*, api_key, min_overlapping_items |
aimrank_get_plackett_luce | Plackett-Luce listwise ranking aggregation — OFFLINE AUDIT ONLY.
Reported post-hoc; it NEVER writes ratings, and setting it as a
ranking's algorithm returns 400. AimRank has 6 rating engines plus
2 offline aggregators (this and CrowdBT) — never describe it as an
8th rating algorithm.
Generalises Bradley-Terry to ranked lists. On pairwise data,
collapses to BT MLE — useful as a second-opinion agg params: ranking_id*, api_key, min_appearances_per_entity, max_iterations |
aimrank_get_crowd_bt | CrowdBT — joint fit of entity scores + per-annotator
reliability η. Surfaces noisy / anti-correlated raters
explicitly. Methodology audit, not a live engine.
api_key is optional on the public endpoint; on /mcp/mcp a missing
key is refused. params: ranking_id*, api_key, min_votes_per_annotator, min_votes_per_entity, max_iterations |
aimrank_list_public_judges | Browse public judge-prompt artifacts shared by other users.
Filter by ``category`` (free-text), ``domain_id``, or both.
Sort options: ``fork_count`` (default — most-forked first),
``recent``, ``faithfulness``.
Returns artifact summaries WITHOUT the full prompt text — call
`aimrank_fork_judge_prompt` or the REST GET to retrieve the
full prompt before using it.
api_key is optional on the public e params: api_key, category, domain_id, sort, limit |
aimrank_find_similar_domains | Find public domains most similar to a query or a known domain.
Use ``query`` for free-text search ("pharma evaluation") OR
``domain_id`` to find domains similar to one you already know.
Exactly one must be provided.
TF-IDF + cosine similarity over name + description + category +
declared constitution + objectives text. Cheap (no embedding API
calls), 5-minute in-process cache. Only public domain params: api_key, query, domain_id, limit, min_score |
aimrank_predict | iCOMPLY contract: pairwise prediction with provenance fields.
Returns the engine's predicted winner + probability shaped so
iCOMPLY's Annex IV section-4 generator can ingest the response
directly. See [iCOMPLY_INTEGRATION_STRATEGY.md] for the contract.
api_key is optional on the public endpoint; on /mcp/mcp a missing
key is refused. params: ranking_id*, entity_a_id*, entity_b_id*, api_key |
aimrank_explain | iCOMPLY contract: explain a prediction in features + narrative.
Returns the Glicko-2 μ/φ inputs for both entities + a deterministic
narrative. No LLM-synthesised rationale — these are the actual
numbers the math uses, which is exactly what an Annex IV auditor
needs to trace.
api_key is optional on the public endpoint; on /mcp/mcp a missing
key is refused. params: ranking_id*, entity_a_id*, entity_b_id*, api_key |
aimrank_healthcheck | iCOMPLY contract: liveness + DB-connectivity probe. params: none |
Entries describe changes in tool definitions. They are not statements about a server, its quality or its author. The grade measures how the tool definitions fit model providers (token cost, schema compatibility, confusable names) as scored by the ToolFit engine at the time of the listing. JSON: append .json. Opt-out: how or hello@youraitools.co.