token-optimizer
Reduce LLM API costs via semantic caching, prompt compression, model routing and context pruning.
От сообщества: Добавлен пользователем или импортирован; проверьте владельца перед подключениемРаботаетБез входаГлобальныйБесплатноТолько чтение
Что умеет
- Proxy Chat: Send a chat completion request through PromptThin's cost-saving proxy. Five optimization routes are applied automatically: (A) semantic cache, (B) prompt compression via LLMLingua 2, (C) m
- Proxy Predict: Estimate cost savings BEFORE making a real LLM call — completely free, no tokens consumed. Returns original token count, estimated tokens after savings, cost comparison, saving percenta
- Billing Start Trial: Start a 7-day free Pro trial. Returns a Stripe checkout URL. No charge for 7 days. Pro plan: $4.99 first month, then $11.99/month. 10,000 requests/month. Cancel anytime.
Какие данные видит
Нужен ли аккаунт
Не нужен: сервер работает без входа
Reduce LLM API costs via semantic caching, prompt compression, model routing and context pruning. Zero code changes required.
Список инструментов сервера (7)
Технические названия из tools/list. Нужны только разработчикам.
| proxy_chat | Send a chat completion request through PromptThin's cost-saving proxy. Five optimization routes are applied automatically: (A) semantic cache, (B) prompt compression via LLMLingua 2, (C) model routing to cheaper models, (D) context pruning at 8K tokens, (E) thinking budget caps on reasoning models based on task complexity. Use this instead of calling OpenAI, Anthropic, Gemini, or Groq directly. Returns the LLM response with a cost summary. |
| proxy_predict | Estimate cost savings BEFORE making a real LLM call — completely free, no tokens consumed. Returns original token count, estimated tokens after savings, cost comparison, saving percentage, applicable methods, and a recommendation. |
| billing_start_trial | Start a 7-day free Pro trial. Returns a Stripe checkout URL. No charge for 7 days. Pro plan: $4.99 first month, then $11.99/month. 10,000 requests/month. Cancel anytime. |
| usage_summary | Retrieve complete usage summary: total requests, cache hit rate, total tokens saved, estimated cost saved in USD, and requests routed to cheaper models. |
| billing_status | Retrieve current plan, monthly request limit, requests used this month, remaining requests, and usage percentage. Warns when usage exceeds 80%. |
| cache_flush | Mark all cached responses as stale, forcing fresh LLM calls. Use after updating a knowledge base or changing system prompts. |
| usage_recent | Retrieve recent proxied API requests with timestamp, provider, model, token counts, cache hit status, routing info, and tokens saved. |