Increased dom0 memory requirement when using Mellanox
HCAs on Oracle VM Server
Oracle VM Servers running UEKR4u2 and upward in
dom0 require at least 400MB more memory to
use the Mellanox® drivers. This memory requirement is a
result of the default size of the SRQ count being increased from
64K to 256K in later versions of the kernel and the
scale_profile option is now enabled by
default in the mlx_core module.
In the case where out-of-memory errors are observed in dom0, the maximum
dom0 memory size should be increased. Alternative workarounds might involve
manually setting the module parameters for the mlx4_core driver. To set these
parameters, edit /etc/modprobe.d/mlx4_core.conf and set
scale_profile to 0. Alternately, set
log_num_srq to 16. The preferred resolution to this issue
is to increase the memory allocated to dom0 on an Oracle VM Server. (Bug ID
23581534)