AI gateway
AI gateway: An infrastructure layer that centralizes access, routing, security and observability for AI services. It can manage authentication, quotas, retries and logging between applications and providers. It does not replace application-level semantic controls and must protect prompts and sensitive data.
In italiano: AI GatewayLegge IV · Loss, gradiente e ottimizzatoriIt can manage authentication, quotas, retries and logging between applications and providers. It does not replace application-level semantic controls and must protect prompts and sensitive data.
Examples
- Per-tenant rate limiting
- Provider fallback
- Call logging