6 General Considerations for Container Configuration

When you configure the Private AI Services Container, there are a number of options and information to consider that can help you get the most out of this service.

• Rate Limiting
  The Private AI Services Container provides a configurable method to control the number of requests per minute that the container can handle for different categories of endpoints. This improves scalability and helps prevent abuse, including denial-of-service (DOS) attacks.
• Use API Keys in Clients
  Clients to the Private AI Services Container must send a valid API key if the service has PRIVATE_AI_AUTHENTICATION_ENABLED set to true.
• Container Log Files
  Diagnostic information about the Private AI Services Container is available and stored in log messages.