What is Manifest?
Manifest is an open-source LLM gateway and router for AI agents. It helps developers and teams make reliable LLM calls by automatically fixing bad API requests on the fly, routing across providers, supporting local models and BYOK, and providing full observability into every request, token, and dollar spent.
SpecificationsAI-estimated
Key Features of Manifest
Use Cases for Manifest
AI builders
Connect subscription plans, BYOK providers, and local models with your harness in seconds. Customize routing and maximize plan usage.
Teams & startups
Manage inference consumption and settings, track every request and token through a dashboard.
Platforms & providers
Avoid client errors harming user experience and revenue by helping customers connect smoothly to models.
How to use Manifest?
Set up Manifest
Use the cloud version for easy onboarding or deploy the self-hosted Docker version on your infrastructure.
Connect providers
Add your own API keys for popular providers, subscription OAuth tokens, custom providers, or local model servers.
Route and monitor
Configure model parameters, fallbacks, and routing rules, then monitor requests, logs, and costs through the dashboard.
Let Autofix handle failures
Manifest automatically repairs broken requests on the fly, reducing avoidable LLM API errors.
Pros & Cons of Manifest
Pros
- Autofix capability repairs broken LLM requests on the fly, reducing downtime
- Open source and self-hostable
- Supports local models via Ollama, LM Studio, llama.cpp
- Bring your own key for popular providers
- Full body logs and cost visualization
- Backed by Berkeley SkyDeck and Inria
- Active community with 7.5k GitHub stars and 114.8k+ Docker pulls
Cons
- Autofix appears to be in an upcoming/new direction, requiring email waitlist
- Pricing details for cloud version not clearly stated on the page
- Competitive space with many LLM gateways and routers
Frequently Asked Questions
What is Manifest?
Manifest is an open-source LLM gateway and router that helps AI agents and teams make reliable LLM calls.
Is Manifest open source?
Yes, Manifest is fully open source and offers a self-hosted Docker version.
Does Manifest support local models?
Yes, it can route to Ollama, LM Studio, llama.cpp, or any local server.
What makes Manifest unique?
Manifest claims to be the only LLM gateway that autofixes bad requests on the fly.
Pricing Overview
View full pricing →All prices are listed in USD as shown.
Reviews & Ratings0.0
No reviews yet. Be the first to write one!
Top Alternatives & Similar Software
View all alternatives & similar software→People also viewed
Related searches
About the Product
Is this your tool?
Claim this page to update details, reply to user reviews, and drive more traffic to your product.
Claim this Product →Tags
Explore Related Topics
Keep up with Manifest alternatives
New alternatives, pricing changes and the week's biggest movers - one email every Tuesday.




