vetted-consumer

Will a local LLM run on your hardware?

Community: Submitted by a user or imported; check the owner before granting accessOnlineNo sign-inGlobalFreeRead-only

What it can do

    What data it sees

    Do you need an account

    No: the server works without sign-in

    Will a local LLM run on your hardware? GGUF quant, buy-vs-rent-vs-API cost, used-GPU prices.

    Server tool list (9)

    Raw names from tools/list. Only developers need these.

    can_i_run_itWill a given local LLM run on given hardware? Returns fit, the best quant that fits, theoretical tok/s, and real owner-measured tok/s where available.
    recommend_quantWhich GGUF quantization to download for a model on given hardware: the full quant ladder with file size, max context, and tok/s for each, plus the recommended pick.
    cheapest_hardware_for_modelThe cheapest catalogued, buyable machine that runs a given model at Q4 with the requested context.
    list_modelsList the local LLM model classes the tools know about (params, dense/MoE, native context).
    list_hardwareList the machines the tools know about (memory, bandwidth, price, buy link).
    cost_compareBuy vs rent vs API cost to run a model locally: monthly/1y/3y totals, break-even months, and the energy cost per 1M tokens. Same math as /cost-calculator/.
    recommend_hardwareRanked list of catalogued, buyable machines that run a model at the requested context, cheapest first, with an optional budget cap.
    get_used_gpu_pricesCurrent typical used-GPU prices for local-AI rigs (eBay Browse API median asking + hand-verified, monthly).
    compare_hardwareSide-by-side memory, bandwidth, price, and (with a model) fit + tok/s for 2 to 4 machines.
    vetted-consumer: connect to Claude, ChatGPT, Cursor · Connectors.fun