Deploy an AI-Powered Chatbot
This reference architecture demonstrates how to quickly deploy an AI-powered chatbot in your Oracle Cloud Infrastructure (OCI) tenancy using Oracle Digital Assistant and OCI Generative AI. The provided infrastructure and components simplify customization for your organization’s needs. Key features include:
- Author: Generate documents such as sales plans, industry overviews, and customer research.
- Summarize: Upload transcripts or documents to receive concise summaries.
- Question & Answer: Ask general questions and get quick answers based on web content and the chatbot’s training data.
Use this reference architecture to quickly and easily deploy an AI-powered chatbot with Oracle Digital Assistant and Oracle AI services.
Architecture
This AI-powered chatbot leverages Oracle Digital Assistant and OCI Generative AI large language models (LLMs). Oracle Visual Builder is used to embed the chatbot in a web application. Users can interact with OCI Generative AI through natural language questions and receive responses from the LLM by using the chatbot interface.
The following diagram illustrates this reference architecture.
The flow for users and developers using this architecture resembles:
- Developers and chatbot users authenticate with OCI Identity and Access Management.
- Users access the chatbot using the Oracle Visual Builder app where it is embedded. Developers can configure the app from the Oracle Visual Builder service home page.
- Developers configure the chatbot using the Oracle Digital Assistant service console.
- Developers access OCI Generative AI LLMs using APIs.
The architecture has the following components:
- Region
An Oracle Cloud Infrastructure region is a localized geographic area that contains one or more data centers, hosting availability domains. Regions are independent of other regions, and vast distances can separate them (across countries or even continents).
- Identity and Access Management
Oracle Cloud Infrastructure Identity and Access Management (IAM) provides user access control for Oracle Cloud Infrastructure (OCI) and Oracle Cloud Applications. The IAM API and the user interface enable you to manage identity domains and the resources within them. Each OCI IAM identity domain represents a standalone identity and access management solution or a different user population.
- Oracle Visual Builder
Oracle Visual Builder is an intuitive development experience on top of a development and hosting platform that empowers you to create engaging responsive applications. Focusing on ease of use and a visual development approach, it provides an easy way for you to create applications that are hosted in Oracle’s secure and scalable cloud platform.
- Digital Assistant
Oracle Digital Assistant is a platform that allows you to create and deploy digital assistants for your users. With Oracle Digital Assistant, you can create AI-driven interfaces (or chatbots) for business applications through text, chat, and voice interfaces. Each digital assistant has a collection of one or more specialized skills to help users complete a variety of tasks in natural language conversations. For example, an individual digital assistant might have skills that focus on specific types of tasks such as tracking inventory, submitting time cards, and creating expense reports.
- Generative AI
Oracle Cloud Infrastructure Generative AI is a fully-managed OCI service that provides a set of state-of-the-art, customizable, large language models (LLMs) that cover a wide range of use cases for text generation, summarization, semantic search, and more. Use the playground to try out the ready-to-use pretrained models, or create and host your own fine-tuned custom models based on your own data on dedicated AI clusters.
Considerations
When deploying this AI-powered chatbot, consider the following.
- Region Availability
Oracle hosts its OCI services in regions and availability domains. A region is a localized geographic area, and an availability domain is one or more data centers in that region. AI services are not always available in all regions. To learn more, see Regions with Generative AI in the Explore More section.
- Document Processing
The document processing feature used in this architecture is intended for smaller documents. For solutions that analyze larger documents, see the other LiveLabs in the Explore More section.