llm-gateway
Centralizes LLM API consumption across teams, reducing costs through intelligent routing and prompt optimization while providing visibility into model usage …
Lightweight distributed LLM gateway w/ web UI for model mgmt & routing. Supports vibe programming, prompt opt., & optimized OpenAI API/Anthropic calls
- Route API requests across multiple LLM providers to optimize cost and latency
- Manage and switch between different language models through a centralized web interface
- Optimize prompts and track performance metrics for anthropic and OpenAI API calls
Centralizes LLM API consumption across teams, reducing costs through intelligent routing and prompt optimization while providing visibility into model usage and performance at scale.
Engineering teams standardizing LLM integrations across multiple services and managing API spend across OpenAI and Anthropic endpoints.
https://github.com/sxueck/llm-gateway
By sxueck
How to Get It
claude plugins install sxueck/llm-gateway
Tip: Paste this into a Claude Code conversation. Verify command matches your Claude Code version.
Auto-generated from the tool's public listing — not hands-on verified. Cross-check against the source repo's README before running.
After installing, paste this into Claude:
Help me route API requests across multiple LLM providers to optimize cost and latency
Trust Signals Auto-scanned
Community Pulse New
- Control LLM Spend and Access with any-LLM-gateway — Hacker News · 63 pts
- LLM Gateway: Secure and Reliable Exploration of Generative AI — Hacker News · 19 pts
- Show HN: Foreman, a self-hosted LLM gateway for cost aware model routing — Hacker News · 15 pts
3 mentions across 1 sources
Reviewer notes
Auto-scanned review. These are observations, not a security certification.
Scored from trust signals (evidence-eval-v1): 48 GitHub stars; contributors unknown; last commit 0d ago; license MIT.
Things to check
- Scanned, not hands-on tested — this entry was auto-scanned from public metadata (GitHub metrics, license, security flags). No reviewer has run it, and no tool-specific limitations have been documented yet.
How to evaluate tools before deploying →
Data shown here comes from public APIs and automated scanning. Reviewer notes reflect one person's experience. This is not a security certification or legal recommendation. Always evaluate tools according to your own organization's policies.
Evaluation
Scored from trust signals (evidence-eval-v1): 48 GitHub stars; contributors unknown; last commit 0d ago; license MIT.