Changelog

What's new in LokaRouter — new endpoints, features, and fixes.

Resilience, rankings & billing polish
  • Rankings: public leaderboard of the most-used models (last 30 days, anonymized aggregates).
  • Mid-stream failover: if a provider closes the stream before emitting anything, the request retries on the next provider automatically.
  • Price sync is now automatic — an hourly cron keeps per-token billing prices fresh (admins can still sync manually from Ops).
  • Optional top-up fee (TOPUP_FEE_PERCENT) with the credited amount shown transparently before payment.
Tools registry & live prices
  • Tools registry: save reusable function definitions (name, description, JSON Schema) and restrict which tools each API key may call via the new allowed-tools guardrail (403 tool_not_allowed).
  • Playground: toggle your registry tools as chips and watch streamed tool_calls render inline.
  • Live model prices: admins can sync per-token pricing from the upstream model list; billing uses live overrides with catalog fallback.
Auto-routing & broader OpenAI surface
  • lokarouter/auto: heuristic model routing — set model to lokarouter/auto and the gateway picks the best hosted model per request.
  • New endpoints: POST /v1/completions, POST /v1/embeddings, GET /v1/models/{id}, GET /v1/key.
  • Observability headers on every gateway response: x-request-id and x-lokarouter-latency-ms; rate-limit headers on 429.
  • Public API reference at /docs/api.
Workspaces, Files (Beta), presets
  • Workspace invites over email with 7-day accept window; members accept from their dashboard.
  • Per-workspace monthly budget caps, enforced at the gateway (402 workspace_budget_exhausted).
  • Files (Beta): OpenAI-compatible /v1/files with a 5 MB cap and a dashboard manager.
  • Presets: save system prompts and sampling parameters, reuse them in the playground.
  • Activity page: 30-day spend, error rate, latency per model, and a daily health timeline.
Guardrails, routing control, settings
  • Guardrails page: budgets, allowed models, and routing preference per API key.
  • Routing page: live provider health, failover order, account-wide routing preference.
  • Settings page: appearance, dashboard language, low-balance email toggle.
  • Security: BYOK provider keys are now encrypted at rest (AES-256-GCM).

← Back to Docs