6.0 HP X9000 File Serving Software Installation (TA768-96041, October 2011)

/sys/class/net/ib0
"echo connected > /sys/class/net/ib0/mode"
"ifconfig ib0 mtu 65520"
NOTE: For Windows WinOF (OFFED) IB client connectivity, check Windows Sockets Direct
(wsd). This must be enabled for Windows.
Troubleshoot physical errors (logical, sim erros, and so on). Note the following:
• Use ibstat to check errors on InfiniBand nodes.
• Use ibclearcounters to watch for error counter increments.
• Check /sys/class/infiniband/mthca0/ports/1/counters.
• symbol_error and port_rcv_erros are physical hardware failures.
InfiniBand tests for end to end:
• On listener host, run ib_read_bw.
• On sender, run ib_read_bw <ip address>. You might need to specify a port number
with -i.
• Run ibnetdiscover. This is a Voltaire tool that does a LID crawl.
Troubleshoot switches:
• Run the Voltaire switch port_verify utility. This utility reports status for the ports and indicates
any problems. Also use port_verify -v.
• Verify that Link Aggregation is set up to optimize switch redundancy and network load
optimization:
lag-mode show
To set up Link Aggregation, use this command:
lag-mode set full
NOTE: If LAG is full on the InfiniBand switch, ensure that the connecting Ethernet switch
ports are also set up for aggregation.
Enabling client access
To enable client access to file systems, complete these steps:
• Export the file systems to NFS.
• On the client, mount the exported NFS shares over the InfiniBand network.
Setting up Voltaire InfiniBand
NOTE: The installation procedure of the third-party InfiniBand drivers could be different than
what is shown here. Refer to the third party documentation for the most accurate information or
contact your vendor's support.
76 Setting up InfiniBand couplets