Install with HTTP
Configure the Private AI Services Container with HTTP.
Before following these configuration steps, ensure that you have downloaded the setup scripts from Configure the Private AI Services Container.
-
Determine the fully qualified hostname where the container will run.
export HOST=$(hostname -f) echo $HOST -
Define the directory structure, including the directory where you want the Private AI Services Container to be installed, along with locations to store the configuration file and models. A Linux user with the least privilege will own the subdirectories that the container uses.
mkdir -p /home/opc/privateai mkdir -p /home/opc/config mkdir -p /home/opc/models export PRIVATE_DIR=/home/opc/privateai -
Navigate to the directory that stores the setup scripts and then run the configuration and container setup.
cd /home/opc/setup ./configSetup.sh -d $PRIVATE_DIR -c /home/opc/config/config.json -m /home/opc/models ./containerSetup.sh -d $PRIVATE_DIR -r container-registry.oracle.com --http -
List the loaded models:
curl http://$HOST:8080/v1/models