Considerations for the Inference Service

• Private AI Environment Variables
  Environment variables can be used to set configuration properties, such as file locations, logging settings, and others. They can be passed to the container when running the container using the standard -e flag.
• Inference Service Model Property
  The model property, specified in the service configuration file, holds the list of models that need to be loaded by the container. When the property is not provided, only pre-approved models that are included with the container will be available.