Advanced Configuration Options

Additional options are available when configuring the vector index service, such as specifying a particular GPU to use.

To target a specific GPU when launching the container, supply --gpu <device_id> to the containerSetup.sh script.

First, list the available GPUs so that you can determine the correct ID:

nvidia-ctk --debug cdi list

Then, use the following command to bind the container to, for example, GPU 1:

./containerSetup.sh -d "$PRIVATE_DIR" --gpu 1

If you omit the flag entirely, the setup uses the first GPU visible to the host (device 0) for index creation.