This diagram shows an agentic framework for high-fidelity, conversational AI
with natural language to SQL on Oracle Cloud
Infrastructure (OCI). The process flow shown in the diagram is described in the surrounding
text.
- Application layer
- The front end uses APEX Service and includes a chat interface and Oracle JET charts.
- The front end connects to the OCI API Gateway by using representational state transfer (REST) application programming
interface (API) calls.
- API/Access layer
- Oracle Cloud Infrastructure Web
Application Firewall (WAF) protects the OCI API Gateway.
- OCI Identity and Access Management (IAM) and policies secure access to the OCI API Gateway.
- AI layer
- AI integration uses an OCI Compute virtual machine and LangChain to call large language models (LLMs) by
using REST API endpoints.
- OCI Generative AI chat models provide LLMs and connect to OCI Generative AI embedding
models.
- OCI Generative AI embedding models connect to Oracle Autonomous AI Database.
- AI data layer
Oracle Autonomous AI Database stores embeddings and model outputs and connects to OCI Generative AI embedding models.
- Customer data
Oracle Exadata Database
Service holds customer data and connects to Oracle Autonomous AI Database by using a database link. I also houses a standard database with customer
data.