# What is AI Gateway?

## Overview:

**AI Gateway** is a centralized access layer that enables you to integrate multiple AI models (OpenAI, Google, Deepseek, etc.). Using AI Gateway reduces the complexity of switching between models, while providing monitoring, management, cost optimization, and data security.

<figure><img src="/files/vuBnjrcxXM41as832uAb" alt=""><figcaption></figcaption></figure>

## Key Features of AI Gateway

* **Multi-LLM Support:** AI Gateway acts as a unified access point, allowing seamless integration with multiple large language models (LLMs) from various providers such as OpenAI, Google, Deepseek, and more.
* **Comprehensive Monitoring:** AI Gateway provides performance and operational monitoring through metrics and logs, helping users easily track, analyze, and optimize system performance.
* **Cost Optimization:** The caching feature (coming soon) reduces the number of requests sent to LLM models, helping save costs and improve response speed.
* **Content & Behavior Control – Guardrails** (coming soon): AI Gateway enables you to define safety layers to ensure that model inputs and outputs align with your requirements and expectations.
* **Automatic Load Balancing** (coming soon): AI Gateway automatically distributes traffic across AI models to optimize performance and ensure scalable operations.
* **Automatic Error Handling** (coming soon):
  * **Automatic Retries:** Automatically retries requests in case of temporary failures.
  * **Automatic Fallbacks:** Automatically switches to alternative models when the primary model fails, ensuring service continuity.
* **Security:** Ensures the protection of sensitive information such as authentication tokens and API keys.


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://docs.vngcloud.vn/vng-cloud-document/ai-stack/ai-gateway/what-is-ai-gateway.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.