6.11 InfiniBand Network Fabricネットワークの確認
この手順では、InfiniBand Network Fabricネットワークの確認方法について説明します。
-
ラック内のすべてのRDMAネットワーク・ファブリック・ケーブル接続を視覚的に確認します。ポート・ライトが点灯し、LEDの電源が投入されていることを確認します。各コネクタを押して接続を確認しないでください。
-
ラックのコンポーネントに
rootユーザーとしてログインします。 -
次のコマンドを使用して、InfiniBand Network Fabricトポロジを確認します。
# cd /opt/oracle.SupportTools/ibdiagtools # ./verify-topology [-t rack_size]次の例は、ネットワーク・コンポーネントが正しい場合の出力を示しています。
[DB Machine Infiniband Cabling Topology Verification Tool ] Is every external switch connected to every internal switch......[SUCCESS ] Are any external switches connected to each other................[SUCCESS ] Are any hosts connected to spine switch..........................[SUCCESS ] Check if all hosts have 2 CAs to different switches..............[SUCCESS ] Leaf switch check:cardinality and even distribution..............[SUCCESS ] Check if each rack has an valid internal ring....................[SUCCESS ]前述のコマンドのrack_sizeは、ラックのサイズです。
-t rack_sizeオプションは、ラックがOracle Exadataハーフ・ラックまたはOracle Exadataクオータ・ラックの場合に必要です。必要に応じて値halfrackまたはquarterrackを使用します。次の例は、誤ったRDMAネットワーク・ファブリック・スイッチをケーブルに接続した場合の出力を示しています。
#./verify-topology [DB Machine Infiniband Cabling Topology Verification Tool ] Is every external switch connected to every internal switch......[SUCCESS ] Are any external switches connected to each other................[SUCCESS ] Are any hosts connected to spine switch..........................[SUCCESS ] Check if all hosts have 2 CAs to different switches..............[SUCCESS ] Leaf switch check:cardinality and even distribution..............[SUCCESS ] Check if each rack has an valid internal ring....................[ERROR ] Switches 0x21283a87cba0a0 0x21283a87b8a0a0 have 6 connections between them. They should have at least 7 links between them次の例は、データベース・サーバーに誤ったRDMAネットワーク・ファブリック・ケーブルがある場合の出力を示しています。
#./verify-topology [DB Machine Infiniband Cabling Topology Verification Tool ] Is every external switch connected to every internal switch......[SUCCESS ] Are any external switches connected to each other................[SUCCESS ] Are any hosts connected to spine switch..........................[SUCCESS ] Check if all hosts have 2 CAs to different switches..............[ERROR ] Node db01 has 1 endpoints.(Should be 2) Port 2 of this node is not connected to any switch --------fattree End Point Cabling verification failed----- Leaf switch check:cardinality and even distribution..............[ERROR ] Internal QDR Switch 0x21283a87b8a0a0 has fewer than 4 compute nodes It has only 3 links belonging to compute nodes [SUCCESS ] Check if each rack has an valid internal ring...................[SUCCESS ]次の例は、スイッチおよびシステムに誤った接続がある場合の出力を示しています。
#./verify-topology [DB Machine Infiniband Cabling Topology Verification Tool ] Is every external switch connected to every internal switch......[SUCCESS ] Are any external switches connected to each other................[SUCCESS ] Are any hosts connected to spine switch..........................[SUCCESS ] Check if all hosts have 2 CAs to different switches..............[ERROR ] Node burxdb01 has 1 endpoints.(Should be 2) Port 2 of this node is not connected to any switch --------fattree End Point Cabling verifation failed----- Leaf switch check:cardinality and even distribution..............[ERROR ] Internal QDR Switch 0x21283a87b8a0a0 has fewer than 4 compute nodes It has only 3 links belonging to compute nodes...................[SUCCESS ] Check if each rack has an valid internal ring....................[ERROR ] Switches 0x21283a87cba0a0 0x21283a87b8a0a0 have 6 connections between them They should have at least 7 links between them