fitllm

Architecture-aware, read-only LLM fit checks for GPUs, multi-GPU rigs, and Apple Silicon Macs, with full memory breakdowns and no login.

CommunityOnlineNo sign-inGlobalFreeRead-only

What it can do

  • Check Llm Fit: Check whether a specific local LLM fits in the memory of a specific GPU or Apple Silicon Mac. Returns fits/tight/won't-fit verdict with the full memory breakdown (weights, KV cache, ove
  • What Fits On Hardware: Rank which popular local LLMs fit on a given GPU or Apple Silicon Mac (at ~4-bit quantization, 8K context) — models that fit come first, biggest first, with max context each. Us
  • List Supported: List the built-in model names and hardware names this fit-checker knows (for mapping user wording to exact names). Any public HuggingFace model also works via fitllm.run.

What data it sees

Do you need an account

No: the server works without sign-in

Architecture-aware, read-only LLM fit checks for GPUs, multi-GPU rigs, and Apple Silicon Macs, with full memory breakdowns and no login.

Server tool list (3)

Raw names from tools/list. Only developers need these.

check_llm_fitCheck whether a specific local LLM fits in the memory of a specific GPU or Apple Silicon Mac. Returns fits/tight/won't-fit verdict with the full memory breakdown (weights, KV cache, overhead), max context, and a concrete fix if it doesn't fit. Use this whenever a user asks anything like "can I run <model> on my <GPU/Mac>?", "will <model> fit in <N>GB?", or "what do I need to run <model>?". Architecture-aware math (MLA, sliding-window, hybrid attention, MoE) — more accurate than rule-of-thumb estimates.
what_fits_on_hardwareRank which popular local LLMs fit on a given GPU or Apple Silicon Mac (at ~4-bit quantization, 8K context) — models that fit come first, biggest first, with max context each. Use when a user asks "what can I run on my <GPU/Mac/N GB>?", "best local model for my machine?", or gives hardware without naming a model.
list_supportedList the built-in model names and hardware names this fit-checker knows (for mapping user wording to exact names). Any public HuggingFace model also works via fitllm.run.