Considerations for the Vector Index Service

• Memory Restrictions

  With index creation offloaded to a remote container, there is a memory requirement for the host memory as well as GPU memory on the container side.

• Deploy Behind a Proxy

  If the Private AI Services Container vector index service is deployed behind a TLS or HTTP proxy, additional proxy configuration is required to support bidirectional HTTP/2 streaming between Oracle AI Database and the Private AI Services Container (for sending source data and receiving generated index artifacts).