Skip to main content

Overview

Feature Details

LLM Cost Optimizer - Provider Strategy

Intra-provider: Routes within the same provider as requested
  • Example: gpt-4gpt-4o-mini (OpenAI only)
  • Typical savings: 60-85%
Flexible (any): Routes to cheapest model across ALL providers
  • Example: gpt-4qwen3.5 (any provider)
  • Typical savings: 70-90%
Fixed (select): Only route to your selected provider(s)
  • Use case: Contracts, data sovereignty, compliance

LLM Cost Optimizer - Routing Strategy

Smart (pattern matching): Analyzes request complexity using multi-factor scoring
  • Routes queries to cheaper models
  • Preserves quality for complex tasks
Adaptive (AI learning): Machine learning continuously improves routing decisions
  • Learns from your usage patterns
  • Additional 10-20% savings vs Smart routing
Custom ML logic: Custom models trained on your data
  • Enterprise-only feature
  • Tailored to your specific use cases

Support Levels

Community: Self-service documentation and community forums Email (48hr): Email support with 48-hour response time Priority (24hr): Priority email and chat support with 24-hour response time Dedicated CSM: Named Customer Success Manager with direct access

SLA Uptime

99.9% SLA: ~43 minutes downtime/month maximum 99.99% SLA: ~4 minutes downtime/month maximum 99.999% SLA (add-on): ~26 seconds downtime/month maximum