Deployment Overview

The Agent Factory application runs in a container, an isolated package that lets the application run consistently across environments. Agent Factory uses Podman and Podman Compose to run on supported Linux and macOS hosts.

Currently supported operating systems:

Prerequisites

Regardless of the platform, Agent Factory requires the following prerequisites:

Installation Modes

Oracle AI Database Private Agent Factory offers two installation modes:

  1. Production: Production mode lets you manually set up the repository database, LLM endpoint, embedding model, TLS, proxy, SSO, and enterprise connectors. Use this mode for shared environments, private subnet deployments, production-like testing, and any deployment that must connect to external enterprise services.

  2. Quickstart: Quickstart mode creates a local database container and configures Agent Factory so you can evaluate the product without preparing a separate repository database. Use Quickstart for evaluation, demos, and local development. Do not use Quickstart as a substitute for a production deployment plan.

By default, the container running Oracle AI Database Private Agent Factory uses port 8080. If you install on Quickstart mode, the Oracle AI Database 26ai free instance runs on port 1521. Ensure this port is available on your system to avoid installation issues.

Parameter Quickstart Mode Production Mode
Setup Automated, local containers Manual, user provided endpoints
Database Local database container supplied by the kit User-provided Oracle AI Database repository
LLM User selected LLM (Ollama/OpenAI/vLLM/Google/OCI Gen AI) User selected LLM (Ollama/OpenAI/vLLM/Google/OCI Gen AI)
Storage ~30 GB ~10 GB
RAM ~10 GB ~8 GB
Ports 8080, 1521, 11434 8080

Review your environment and operational requirements before choosing the installation mode. If more than one user or team will depend on the deployment, use Production mode.

LLM Preferences

Generative Models:

Below are the recommended options, listed in order of preference:

  1. OCI Generative AI (most preferred)
  2. OpenAI/Google
  3. vLLM
  4. Ollama

Embedding Models:

Below are the recommended options, listed in order of preference:

  1. OCI Generative AI (most preferred)
  2. Google
  3. vLLM
  4. Ollama
  5. Local

Types of Setup

Oracle AI Database Private Agent Factory can be installed on both Linux and Mac environments. For both operating systems, you can choose between Production and Quickstart installation modes, with or without a VPN connection. Please refer to the appropriate links in the table for detailed setup instructions for your specific platform and installation scenario.

Linux

Oracle AI Database Private Agent Factory offers support for Linux environments based on X86-64 and ARM64 architectures.

Installation mode VPN on VPN off
Production Linux-Prod-With VPN Linux-Prod-No VPN
Quickstart Linux-Quickstart-With VPN Linux-Quickstart-No VPN

Mac

Oracle AI Database Private Agent Factory is certified for Mac systems based on Intel and Apple Silicon Chips.

Installation mode VPN on VPN off
Production Mac-Prod-With VPN Mac-Prod-No VPN
Quickstart Mac-Quickstart-With VPN Mac-Quickstart-No VPN