Consider the following for Jumbo Frames:
True Jumbo Frames are not supported.
The maximum MTU is limited by the MTU of the InfiniBand fabric.
The MTU of the HCA is 2048 by default, but can be increased up to 4096.
The default MTU of the I4 switch chip and BridgeX chips is 4096.
The gateway supports Jumbo Frames up to the InfiniBand limit of 4096 bytes.
You must configure the entire InfiniBand fabric to use a 4096 MTU. This configuration includes configuring the Subnet Manager, InfiniBand devices, and the ConnectX HCAs. You can configure a ConnectX HCA by activating the set_4k_mtu parameter of the HCA's mlx4_core module.