Broadcom® NetXtreme® BCM57XX User Guide Last revised: January 2021 2CS57XX-CDUM518
NetXtreme User Guide Broadcom, the pulse logo, Connecting everything, Avago, Avago Technologies, and the A logo are among the trademarks of Broadcom and/or its affiliates in the United States, certain other countries and/or the EU. Copyright © 2021 by Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Limited and/or its subsidiaries. For more information, please visit www.broadcom.com.
NetXtreme User Guide Table of Contents Section 1: Installing the Hardware .................................................................................... 6 Safety Precautions ....................................................................................................................................... 6 Preinstallation Checklist ..............................................................................................................................7 Installing the Adapter ................
NetXtreme User Guide Unloading/Removing the Driver from an RPM Installation.................................................................... 19 Removing the Driver from a TAR Installation........................................................................................ 19 Driver Messages......................................................................................................................................... 20 Teaming with Channel Bonding.............................................
NetXtreme User Guide Canadian Regulatory Information (Canada Only).................................................................................... 35 Industry Canada, Class B...................................................................................................................... 35 Industry Canada, classe B..................................................................................................................... 35 MIC Notice (Republic of Korea Only) .............................
NetXtreme User Guide Installing the Hardware Section 1: Installing the Hardware • Safety Precautions • Preinstallation Checklist • Installing the Adapter • Connecting the Network Cables Note: This section applies only to add-in NIC models of Broadcom NetXtreme Gigabit Ethernet adapters. Safety Precautions Caution! The adapter is being installed in a system that operates with voltages that can be lethal.
NetXtreme User Guide Installing the Hardware Preinstallation Checklist 1. Verify that your server is using the latest BIOS. 2. If your system is booted to an operating system, gracefully power down the OS. 3. When system shutdown is complete, turn off the power and unplug the power cord. 4. Holding the adapter card by the edges, remove it from its shipping package and place it on an antistatic surface. 5. Check the adapter for visible signs of damage, particularly on the card edge connector.
NetXtreme User Guide Installing the Hardware Connecting the Network Cables Copper The Broadcom NetXtreme Gigabit Ethernet adapter has one or more RJ-45 connectors used for attaching the system to an Ethernet copper-wire segment. Note: The Broadcom NetXtreme Gigabit Ethernet adapter supports Automatic MDI Crossover (MDIX), which eliminates the need for crossover cables when connecting machines back-to-back.
NetXtreme User Guide Functionality and Features Section 2: Functionality and Features • Functional Description • Features • Supported Operating Environments • Network Link and Activity Indication Functional Description Broadcom NetXtreme Gigabit Ethernet adapters connect a PCI Express™ compliant system to a Gigabit Ethernet network.
NetXtreme User Guide Functionality and Features • Virtual LAN (VLAN) support— IEEE 802.1q VLAN tagging • TCP, IP, UDP checksum offload • Large Send Offload (LSO), TCP Segmentation Offload (TSO) • Hardware assist for IEEE 1588 and IEEE 802.1AS time synchronization implementations • IEEE 802.3x flow control • SMBus 2.0 Interface • Statistics for SNMP MIB II, Ethernet-like MIB and Ethernet MIB (IEEE 802.
NetXtreme User Guide Functionality and Features ASIC with Embedded RISC Processor The core control for Broadcom NetXtreme Gigabit Ethernet adapters resides in a tightly integrated, highperformance ASIC. The ASIC includes a RISC processor. This functionality provides the flexibility to add new features to the card and adapts it to future network requirements through software downloads.
NetXtreme User Guide Windows Driver and Management Application Installation S e c t i o n 3 : Wi n d o w s D r i v e r a n d Management Application Installation • Installing the Driver Software • Modifying the Driver Software • Repairing or Reinstalling the Driver Software • Removing the Device Drivers • Viewing or Changing the Properties of the Adapter • Setting Power Management Options Broadcom® October 2020 • 2CS57XX-CDUM518 Page 12
NetXtreme User Guide Windows Driver and Management Application Installation Installing the Driver Software Note: These instructions are based on the assumption that your Broadcom NetXtreme adapter was not factory installed. If your controller was installed at the factory, the driver software has been installed for you.
NetXtreme User Guide Windows Driver and Management Application Installation Using Silent Installation Refer to the readme.txt file in the installation folder for command line instructions. Notes: • All commands are case sensitive. • For detailed instructions and information about unattended installs, refer to the Silent.txt file in the Driver_Management_Apps_Installer folder. Note: The REINSTALL switch should only be used if the same installer is already installed on the system.
NetXtreme User Guide Windows Driver and Management Application Installation Repairing or Reinstalling the Driver Software To repair or reinstall the driver software 1. In Control Panel, double-click Add or Remove Programs. 2. Click Broadcom Drivers and Management Applications, and then click Change. 3. Click Next to continue. 4. Click Repair or Reinstall to repair errors or install drivers for new adapters. 5. Click Next to continue. 6. Click Install. 7. Click Finish to close the wizard. 8.
NetXtreme User Guide Windows Driver and Management Application Installation Viewing or Changing the Properties of the Adapter To view or change the properties of the Broadcom network adapter 1. In Control Panel, click Broadcom Control Suite 4. 2. Click the Advanced section of the Configurations tab. Setting Power Management Options You can set power management options to allow the operating system to turn off the controller to save power or to allow the controller to wake up the computer.
NetXtreme User Guide Linux Driver and Management Application Installation Section 4: Linux Driver and Management Application Installation • Packaging • Installing TG3 Driver Software • Network Installations • Unloading/Removing the TG3 Driver • Driver Messages • Teaming with Channel Bonding Packaging The Linux TG3 driver is released in the following packaging formats (file names): • Source RPM (tg3-version.3dkms.src.rpm) • Supplemental (tg3_sup-version.tar.
NetXtreme User Guide Linux Driver and Management Application Installation Installing TG3 Driver Software • Installing the Source RPM Package • Building the Driver from the Source TAR File Installing the Source RPM Package Prerequisites: • Linux kernel source • C compiler Procedure: 1. Install the source RPM package. rpm -ivh tg3-version.src.rpm 2. Change the directory to the RPM path and build the binary driver for your kernel (the RPM path is different for different Linux distributions).
NetXtreme User Guide Linux Driver and Management Application Installation Building the Driver from the Source TAR File 1. Create a directory (tg3-version) and extract the TAR files to the directory. tar xvzf tg3-version.tgz 2. Build the driver tg3.o as a loadable module for the running kernel. CD tg3-version make clean make; make install 3. Test the driver by loading it. rmmod tg3 modprobe tg3 No message should be returned if this command runs properly.
NetXtreme User Guide Linux Driver and Management Application Installation Driver Messages The following are the most common sample messages that may be logged in the /var/log/messages file. Use dmesg -nlevel to control the level at which messages appear on the console. Most systems are set to level 6 by default. Driver Sign on tg3.
NetXtreme User Guide VMware Driver Software Section 5: VMware Driver Software • Packaging • Drivers Packaging The VMware driver is released in the following packaging format. Table 3: VMware Driver Packaging Format Drivers VMware VIB vmware-esx-drivers-net-tg3-version.x86_64.vib Drivers Download, Install, and Update Drivers To download, install, or update the VMware ESX/ESXi driver for NetXtreme I GbE network adapters, see http:/ /www.vmware.com/support.
NetXtreme User Guide VMware Driver Software Note that the NIC # above does not correspond to the vmnic<#>. The NIC number is the system vmnic probe order number. Optimally, the number of NetQueues matches the number of CPUs on the machine. Driver Parameters Several optional parameters can be supplied as a command line argument to the vmkload_mod command. These parameters can also be set via the esxcfg-module command. See the man page for more information.
NetXtreme User Guide VMware Driver Software vmnic0#: Tigon3 [partno (BCM95xxx) rev 4202 PHY (57xx) (PCI Express) 10/100/1000BaseT Ethernet :00:xx:xx:xx:xx:xx vmnic0#: RXcsums [1] LinkChg REG [0] MIirq [0] ASF [0] Split [0] Wirespeed [1]TSOcap [1] vmnic0#: dma_rwctrl [76180000] ACPI : PCI interrupt 0000:02:02.0 [A] -> GSI 26 (level,low) -> IRQ 233 Link Up and Speed Indication tg3: vmnic0: Link is up at 1000 Mbps, full duplex. tg3: vmnic0: Flow control is on for TX and on for RX.
NetXtreme User Guide Specifications Section 6: Specifications • 10/100/1000BASE-T Cable Specifications • Performance Specifications 10/100/1000BASE-T Cable Specifications Table 5: 10/100/1000BASE-T Cable Specifications Port Type Connector Media Maximum Distance 10BASE-T RJ-45 Category 3, 4, or 5 unshielded twisted pairs (UTP) 100m (328 ft) 100/1000BASE-T1 RJ-45 Category 52 UTP 100m (328 ft) 1 1000BASE-T signaling requires 4 twisted pairs of Category 5 balanced cabling, as specified in ISO
NetXtreme User Guide Troubleshooting S e c t i o n 7 : Tr o u b l e s h o o t i n g • Troubleshooting Checklist • Checking for Network Link and Activity • Checking if Current Drivers Are Loaded • Running a Cable Length Test • Testing Network Connectivity • Broadcom Boot Agent • Kernel Debugging over Ethernet • Miscellaneous Broadcom® October 2020 • 2CS57XX-CDUM518 Page 25
NetXtreme User Guide Troubleshooting Troubleshooting Checklist Caution! Before you open the case of your system, review Safety Precautions. The following checklist provides recommended actions to take to resolve problems installing the Broadcom NetXtreme Gigabit Ethernet adapter or running it in your system. • Inspect all cables and connections. Verify that the cable connections at the network adapter and the switch are attached properly.
NetXtreme User Guide Troubleshooting Checking if Current Drivers Are Loaded Windows See Viewing Adapter Information to view useful information about the adapter, its link status, and network connectivity. Linux To verify that the TG3 Linux driver is loaded properly, run: lsmod | grep tg3 If the driver is loaded, a line similar to the one below is displayed, where size is the size of the driver in bytes, and n is the number of adapters configured.
NetXtreme User Guide Troubleshooting Testing Network Connectivity Note: When using forced link speeds, verify that both the adapter and the switch are forced to the same speed, or that both sides are configured for auto-negotiation. Windows Use the ping command to determine if the network connection is working. Note: Network connectivity can also be tested using the Testing the Network feature in Broadcom Advanced Control Suite 2. 1. Verify that the drivers are loaded and enabled. 2.
NetXtreme User Guide Troubleshooting Kernel Debugging over Ethernet Problem: When attempting to perform kernel debugging over an Ethernet network on a Windows 8.0 or Windows Server 2012 system, the system will not boot. This problem may occur with some adapters on systems where the Windows 8.0 or Windows Server 2012 OS is configured for UEFI mode. You may see a firmware error on screen, indicating that a Non Maskable Interrupt exception was encountered during the UEFI pre-boot environment.
NetXtreme User Guide Regulatory Information Section 8: Regulatory Information • FCC Class B Notice • VCCI Class B Notice • CE Notice • Canadian Regulatory Information (Canada Only) • MIC Notice (Republic of Korea Only) • BSMI FCC Class B Notice Broadcom NetXtreme Gigabit Ethernet Controller BCM95721A211 BCM95722A2202 The equipment complies with Part 15 of the FCC Rules.
NetXtreme User Guide Regulatory Information VCCI Class B Notice The equipment is a Class B product based on the standard of the Voluntary Control Council for Interference from Information Technology Equipment (VCCI). If used near a radio or television receiver in a domestic environment, it may cause radio interference. Install and use the equipment according to the instruction manual.
NetXtreme User Guide Broadcom® October 2020 • 2CS57XX-CDUM518 Regulatory Information Page 32
NetXtreme User Guide Broadcom® October 2020 • 2CS57XX-CDUM518 Regulatory Information Page 33
NetXtreme User Guide Broadcom® October 2020 • 2CS57XX-CDUM518 Regulatory Information Page 34
NetXtreme User Guide Regulatory Information Canadian Regulatory Information (Canada Only) Industry Canada, Class B This Class B digital apparatus complies with Canadian ICES-003. Notice: The Industry Canada regulations provide that changes or modifications not expressly approved by Broadcom could void your authority to operate this equipment. Industry Canada, classe B Cet appareil numérique de la classe B est conforme à la norme NMB-003 du Canada.
NetXtreme User Guide Regulatory Information MIC Notice (Republic of Korea Only) B CLASS Device Broadcom NetXtreme Gigabit Ethernet Controller BCM95721A211 BCM95722A2202 Note that this device has been approved for non-business purposes and may be used in any environment, including residential areas.
NetXtreme User Guide Regulatory Information BSMI Broadcom® October 2020 • 2CS57XX-CDUM518 Page 37