Dell Broadcom NetXtreme Family of Adapters User Manual

Dell Broadcom NetXtreme Family of Adapters User Manual

Broadcom netxtreme ii network adapter user guide
Hide thumbs Also See for Broadcom NetXtreme Family of Adapters:
Table of Contents

Quick Links

Broadcom NetXtreme II™ Network Adapter User Guide
Broadcom NetXtreme II™ Network Adapter User Guide
The information below is provided by the supplier of the referenced device without independent verification by Dell and is
subject to the
Restrictions and Disclaimers
Introduction
Functionality and Features
Teaming
Virtual LANs (VLANs)
Manageability
Installing the Hardware
Installing the Driver Software
Broadcom Boot Agent Driver Software
NDIS2 Driver Software
ODI Driver Software
Linux Driver Software
NetWare Driver Software
Solaris Driver Software
VMware Driver Software
Installing Windows Drivers and Management Applications
Using iSCSI
Configuring Teaming
NIC Partitioning
Fibre Channel Over Ethernet
Using Data Center Bridging
Using Broadcom Advanced Control Suite
User Diagnostics
Specifications
Regulatory Information
Troubleshooting
Information in this document is subject to change without notice.
© 2011 Broadcom Corporation. All rights reserved.
Trademarks used in this text: Broadcom, NetXtreme II, Ethernet@Wirespeed, LiveLink, and Smart Load Balancing are among
the trademarks of Broadcom Corporation and/or its affiliates in the United States, certain other countries, and/or the EU. Dell
and the DELL logo are trademarks of Dell Inc. Microsoft and Windows are trademarks of Microsoft Corporation. Linux is a
trademark of Linus Torvalds. NetWare is a trademark of Novell Corporation. Intel is a trademark of Intel Corporation. Magic
Packet is a trademark of Advanced Micro Devices, Inc. Red Hat is a trademark of Red Hat, Inc. PCI Express is a trademark of
PCI-SIG. Any other trademarks or trade names mentioned are the property of their respective owners.
Restrictions and Disclaimers
The information contained in this document, including all instructions, cautions, and regulatory approvals and certifications, is
provided by the supplier and has not been independently verified or tested by Dell, except where specifically noted. Dell
cannot be responsible for damage caused as a result of either following or failing to follow these instructions. All statements
or claims regarding the properties, capabilities, speeds or qualifications of the part referenced in this document are made by
file:///T|/htdocs/NETWORK/BroadCom/71921/NetXtremeII/en/index.htm[9/26/2012 3:28:25 PM]
noted below.
Table of Contents
loading

Summary of Contents for Dell Broadcom NetXtreme Family of Adapters

  • Page 1 Broadcom Corporation and/or its affiliates in the United States, certain other countries, and/or the EU. Dell and the DELL logo are trademarks of Dell Inc. Microsoft and Windows are trademarks of Microsoft Corporation. Linux is a trademark of Linus Torvalds. NetWare is a trademark of Novell Corporation. Intel is a trademark of Intel Corporation. Magic Packet is a trademark of Advanced Micro Devices, Inc.
  • Page 2 Broadcom NetXtreme II™ Network Adapter User Guide the supplier and not by Dell. Dell specifically disclaims knowledge of the accuracy, completeness or substantiation for any such statements. All questions or comments relating to such statements or claims should be directed to the supplier.
  • Page 3: Functional Description

    Functionality and Features: Broadcom NetXtreme II Network Adapter User Guide Back to Contents Page Functionality and Features: Broadcom NetXtreme II Network Adapter User Guide Functional Description Features Functional Description The Broadcom NetXtreme II adapter is a new class of Gigabit Ethernet (GbE) and 10 GbE converged network interface controller (C-NIC) that can simultaneously perform accelerated data networking and storage networking on a standard Ethernet network.
  • Page 4: Tcp Offload Engine (Toe)

    Functionality and Features: Broadcom NetXtreme II Network Adapter User Guide Full fast-path TCP offload Zero copy capable hardware Other performance features TCP, IP, UDP checksum TCP segmentation Adaptive interrupts Receive Side Scaling (RSS) Manageability Broadcom Advanced Control Suite diagnostic and configuration software suite Supports PXE 2.0 specification (Linux Red Hat PXE Server, SUSE Linux Enterprise Server, Windows Server 2008, Windows Server 2008 R2, Intel APITEST, DOS UNDI) Wake on LAN support...
  • Page 5: Internet Small Computer Systems Interface (Iscsi)

    Wake on LAN (WOL) should be connected to a switch capable of both 1000 and 10/100 Mbps speeds. NOTES: Dell supports WOL on only one adapter in the system at a time. For specific systems, see your system documentation for WOL support.
  • Page 6: Asic With Embedded Risc Processor

    Functionality and Features: Broadcom NetXtreme II Network Adapter User Guide throughput. When traffic is light, the adapter driver interrupts the host for each received packet, minimizing latency. When traffic is heavy, the adapter issues one host interrupt for multiple, back-to-back incoming packets, preserving host CPU cycles.
  • Page 7 Functionality and Features: Broadcom NetXtreme II Network Adapter User Guide Back to Contents Page file:///T|/htdocs/NETWORK/BroadCom/71921/NetXtremeII/en/features.htm[9/26/2012 3:28:28 PM]...
  • Page 8: Broadcom Advanced Server Program Overview

    BASP settings are configured by Broadcom Advanced Control Suite (BACS) utility. BASP provides heterogeneous support for adapter teaming to include all of the Broadcom NetXtreme and NetXtreme II adapters as well as Dell-shipping Intel NIC adapters/LOMs. BASP provides support for TOE teaming only for NetXtreme II adapters.
  • Page 9: Smart Load Balancing™ And Failover

    Configuring Teaming: Broadcom NetXtreme II Network Adapter User Guide Smart Load Balancing™ and Failover Smart Load Balancing™ and Failover is the Broadcom implementation of load balancing based on IP flow. This feature supports balancing IP traffic across multiple adapters (team members) in a bidirectional manner. In this type of team, all adapters in the team have separate MAC addresses.
  • Page 10 Configuring Teaming: Broadcom NetXtreme II Network Adapter User Guide of Teams Smart Load Balancing™ (SLB) is a protocol-specific scheme. The level of support for IP, IPX, and NetBEUI protocols is listed in Table Table 1: Smart Load Balancing Operating System Failover/Fallback —...
  • Page 11: Vlan Overview

    Virtual LANs: Broadcom NetXtreme II Network Adapter User Guide Back to Contents Page Virtual LANs: Broadcom NetXtreme II Network Adapter User Guide VLAN Overview Adding VLANs to Teams VLAN Overview Virtual LANs (VLANs) allow you to split your physical LAN into logical parts, to create logical segmentation of workgroups, and to enforce security policies for each logical segment.
  • Page 12: Adding Vlans To Teams

    Virtual LANs: Broadcom NetXtreme II Network Adapter User Guide separation between all of them. Accounting Available to VLAN #3 only. The Accounting Server is isolated from all traffic on VLANs #1 and #2. The switch Server port connected to the server has tagging turned off. Attached to a shared media hub that is then connected to the switch.
  • Page 13: Basp Subagent

    Manageability: Broadcom NetXtreme II Network Adapter User Guide Back to Contents Page Manageability: Broadcom NetXtreme II Network Adapter User Guide SNMP HBA API The Common Information Model (CIM) is an industry standard defined by the Distributed Management Task Force (DMTF). Microsoft implements CIM on Windows server platforms.
  • Page 14: Basp Extensible-Agent

    Manageability: Broadcom NetXtreme II Network Adapter User Guide The statistics include detailed information such as data packets transmitted and received for the physical/virtual/VLAN/team adapters. The alarm trap forwards information about the changes in configuration of the physical adapters participating in a team, such as physical adapter link up/down, and adapter installed/removed events.
  • Page 15: Operating System Requirements

    Installing the Hardware: Broadcom NetXtreme II Network Adapter User Guide Back to Contents Page Installing the Hardware: Broadcom NetXtreme II Network Adapter User Guide Overview System Requirements Safety Precautions Preinstallation Checklist Installation of the Add-In NIC Overview This section applies to Broadcom NetXtreme II add-in network interface cards. System Requirements Before you install a Broadcom NetXtreme II adapter, verify that your system meets the following hardware and operating system requirements:...
  • Page 16: Safety Precautions

    Requirements. 2. Verify that your system is using the latest BIOS. NOTE: If you acquired the adapter software on a disk or from the Dell support website (http://support.dell.com), verify the path to the adapter driver files. 3. If your system is active, shut it down.
  • Page 17: Connecting The Network Cables

    Installing the Hardware: Broadcom NetXtreme II Network Adapter User Guide Connecting the Network Cables The Broadcom NetXtreme II adapter has either an RJ-45 connector used for attaching the system to an Ethernet copper-wire segment or a fiber optic connector for attaching the system to an Ethernet fiber optic segment. NOTE: This section does not apply to blade servers.
  • Page 18: Setting Up Mba In A Client Environment

    To enable or disable the MBA driver: 1. Insert an MS-DOS 6.22 or Dell Real Mode Kernel bootable disk containing the uxdiag.exe file (for 10/100/1000-Mbps network adapters) or uediag.exe (for 10-Gbps network adapters) in the removable disk drive and power up your system.
  • Page 19: Setting Up Mba In A Server Environment

    Broadcom Boot Agent Driver Software: Broadcom NetXtreme II Network Adapter User Guide Configuring the MBA Driver This section pertains to configuring the MBA driver on add-in NIC models of the Broadcom network adapter. For configuring the MBA driver on LOM models of the Broadcom network adapter, check your system documentation. NOTE: You can use the MBA Configuration Menu to configure the MBA driver one adapter at a time as described below, or you can use the Broadcom NetXtreme II User Diagnostics...
  • Page 20 Broadcom Boot Agent Driver Software: Broadcom NetXtreme II Network Adapter User Guide Please read all Restrictions and Disclaimers. Back to Contents Page file:///T|/htdocs/NETWORK/BroadCom/71921/NetXtremeII/en/pxe.htm[9/26/2012 3:28:39 PM]...
  • Page 21: Pre-Installation Requirements

    NDIS2 Driver Software: Broadcom NetXtreme II Network Adapter User Guide Back to Contents Page NDIS2 Driver Software: Broadcom NetXtreme II Network Adapter User Guide Overview Preinstallation Requirements Installing the NDIS2 Driver Software for Use on MS-DOS Platforms Using Keywords for the Drivers Overview Two drivers are discussed in this section: BXND20X: Broadcom NetXtreme II Gigabit Ethernet driver...
  • Page 22: Modifying The Startup Disk

    NDIS2 Driver Software: Broadcom NetXtreme II Network Adapter User Guide 8. Follow the on-screen instructions to make the network startup disk (choose NE2000 Compatible from the list of adapters). Modifying the Startup Disk To modify the startup disk 1. Edit A:\Net\Protocol.ini with Notepad or a similar text editor. a.
  • Page 23: Installing The Dos Ndis2 Driver Software On The Hard Disk

    NDIS2 Driver Software: Broadcom NetXtreme II Network Adapter User Guide Example System.ini file [network] sizworkbuf=1498 filesharing=no printsharing=no autologon=yes computername=MYPC lanroot=A:\NET username=USER1 workgroup=WORKGROUP reconnect=yes dospophotkey=N lmlogon=0 logondomain= preferredredir=basic autostart=basic maxconnections=8 [network drivers] netcard=BXND20X.dos transport=ndishlp.sys,*netbeui devdir=A:\NET LoadRMDrivers=yes 3. Copy BXND20X.dos to A:\Net. 4.
  • Page 24: Using Keywords For The Drivers

    NDIS2 Driver Software: Broadcom NetXtreme II Network Adapter User Guide [NETBEUI_XIF] DriverName = netbeui$ BINDINGS = BXND20X [BXND20X] DriverName = "BXND20X$" 6. Restart the computer to complete the installation. NOTE: The driver loads during system configuration and displays the Broadcom banner, controller name, MAC address, IRQ number, detected line speed, and the controller BusNum and DevNum.
  • Page 25: Odi Client32

    ODI Driver Software: Broadcom NetXtreme II Network Adapter User Guide Back to Contents Page ODI Driver Software: Broadcom NetXtreme II Network Adapter User Guide Overview ODI Client32 DOS ODI Overview Three drivers are discussed in this section: BX2.LAN: Broadcom NetXtreme II Gigabit Ethernet 32-bit driver BX2.COM: Broadcom NetXtreme II Gigabit Ethernet 16-bit driver BNX2EV.COM: Broadcom NetXtreme II 10 Gigabit Ethernet 16-bit driver The examples used in the...
  • Page 26: Configuring The Driver Software

    ODI Driver Software: Broadcom NetXtreme II Network Adapter User Guide 14. Press ENTER. 15. Select Receive Buffers, type 32 for the value, and then press F10 to save and continue. NOTE: Do not change the default settings for any of the other items in the Installation Configuration Summary. 16.
  • Page 27 ODI Driver Software: Broadcom NetXtreme II Network Adapter User Guide LINK DRIVER BX2 LINESPEED 100 DUPLEX FULL DOS ODI The Open Data-Link Interface (ODI) driver software allows LAN drivers to work together irrespective of differences between the hardware and/or the protocol stacks of communicating computers. An intervening layer, called the link support layer (LSL), is responsible for routing different packet types between LAN drivers and protocol stacks.
  • Page 28: Configuring Parameters For The Bx2.Com/Bx2Ev.com Driver (In The Net.cfg File)

    ODI Driver Software: Broadcom NetXtreme II Network Adapter User Guide driver fails to load, an initialization fail message appears. Configuring Parameters for the BX2.com/BX2EV.COM Driver (in the Net.cfg file) The following are optional custom keywords used in the Net.cfg file: BUSNUM DEVNUM FUNNUM...
  • Page 29: Bnx2 Driver

    Linux Driver Software: Broadcom NetXtreme II Network Adapter User Guide Back to Contents Page Linux Driver Software: Broadcom NetXtreme II Network Adapter User Guide Introduction Limitations Packaging Installing Linux Driver Software Unloading/Removing the Linux Driver Patching PCI Files (Optional) Network Installations Setting Values for Optional Properties Driver Defaults Driver Messages...
  • Page 30: Bnx2X Driver

    Linux Driver Software: Broadcom NetXtreme II Network Adapter User Guide bnx2 driver reports support for Magic Packet WOL via ethtool. Enabling support via ethtool is mandatory to successfully wake the system. To determine the silicon revision of your Broadcom NetXtreme II device, use the lspci command, where "10" = revision B0, "11"...
  • Page 31: Building The Driver From The Source Tar File

    Linux Driver Software: Broadcom NetXtreme II Network Adapter User Guide 2. Change the directory to the RPM path and build the binary driver for your kernel (the RPM path is different for different Linux distributions): cd /usr/src/redhat,OpenLinux,turbo,packages,rpm ... rpmbuild -bb SPECS/netxtreme2.spec (for RPM version 4.x.x) NOTE: During your attempt to install a source RPM package, the following message may be displayed: error: cannot create %sourcedir /usr/src/redhat/SOURCES The most likely cause of the error is that the rpm-build package has not been installed.
  • Page 32: Load And Run Necessary Iscsi Software Components

    This is accomplished by creating a framework where a kernel-dependent module source can reside. To install the binary DKMS RPM driver package 1. Download the binary DKMS RPM (dkms-version.noarch.rpm) from http://linux.dell.com/dkms/. 2. Install the binary DKMS RPM package: rpm -ivh dkms-version.noarch.rpm 3.
  • Page 33: Unloading/Removing The Linux Driver

    Linux Driver Software: Broadcom NetXtreme II Network Adapter User Guide Manual: insmod bnx2i.ko modprobe bnx2i Unloading/Removing the Linux Driver Unloading/Removing the Driver from an RPM Installation Removing the Driver from a TAR Installation Unloading/Removing the Driver from an RPM Installation NOTES: The examples used in this procedure refer to the bnx2 driver, but also apply to the bnx2x driver.
  • Page 34: Setting Values For Optional Properties

    Linux Driver Software: Broadcom NetXtreme II Network Adapter User Guide drivers for other Linux versions can be compiled by modifying the Makefile and the make environment. Further information is available from the Red Hat website, http://www.redhat.com. Setting Values for Optional Properties Optional properties exist for the different drivers: bnx2 Driver bnx2x Driver...
  • Page 35 Linux Driver Software: Broadcom NetXtreme II Network Adapter User Guide modprobe bnx2x int_mode=2 Set the int_mode parameter to 3 to force using MSI-X mode on all NetXtreme II adapters in the system. dropless_fc The dropless_fc parameter can be used to enable a complementary flow control mechanism on BCM57711/BCM57712 adapters.
  • Page 36 Linux Driver Software: Broadcom NetXtreme II Network Adapter User Guide Set the multi_mode parameter to 2 as shown below to differentiate the traffic according to the VLAN PRI value. insmod bnx2x.ko multi_mode=2 pri_map=0x11110000 qs_per_cos=0x404 modprobe bnx2x multi_mode=2 pri_map=0x11110000 qs_per_cos=0x404 Set the multi_mode parameter to 4 as shown below to differentiate the traffic according to the IP DSCP value. insmod bnx2x.ko multi_mode=4 pri_map=0x22221100 qs_per_cos=0x10101 cos_min_rate=0x30201 modprobe bnx2x multi_mode=4 pri_map=0x22221100 qs_per_cos=0x10101 cos_min_rate=0x30201 bnx2i Driver...
  • Page 37: Driver Defaults

    Linux Driver Software: Broadcom NetXtreme II Network Adapter User Guide "Configure RQ size", used to choose the size of asynchronous buffer queue size per offloaded connections. RQ size is not required greater than 16 as it is used to place iSCSI ASYNC/NOP/REJECT messages and SCSI sense data. Defaults: 16 Range: 16 to 32 Note that Broadcom validation is limited to a power of 2;...
  • Page 38: Driver Messages

    Linux Driver Software: Broadcom NetXtreme II Network Adapter User Guide Coalesce TX Microseconds IRQ: 80 (range is 0–1023) Coalesce TX Frames: 20 (range is 0–255) Coalesce TX Frames IRQ: 20 (range is 0–255) Coalesce Statistics Microseconds: 999936 (approximately 1 second) (range is 0–16776960 in increments of 256) MSI: Enabled (if supported by the 2.6 kernel and the interrupt test passes) TSO: Enabled (on 2.6 kernels) WoL: Initial setting based on NVRAM's setting...
  • Page 39 Linux Driver Software: Broadcom NetXtreme II Network Adapter User Guide bnx2: eth# NIC Link is Up, 1000 Mbps full duplex Link Down Indication bnx2: eth# NIC Link is Down MSI enabled successfully (bnx2 only) bnx2: eth0: using MSI MSI-X enabled successfully (bnx2x only) bnx2x: eth0: using MSI-X bnx2i Driver BNX2I Driver signon...
  • Page 40: Teaming With Channel Bonding

    Linux Driver Software: Broadcom NetXtreme II Network Adapter User Guide bnx2i: iscsi_error - ERL0, UO bnx2i: iscsi_error - ERL0, U1 bnx2i: iscsi_error - ERL0, U2 bnx2i: iscsi_error - ERL0, U3 bnx2i: iscsi_error - ERL0, U4 bnx2i: iscsi_error - ERL0, U5 bnx2i: iscsi_error - ERL0, U bnx2i: iscsi_error - invalid resi len bnx2i: iscsi_error - MRDSL violation...
  • Page 41: Linux Iscsi Offload

    Linux Driver Software: Broadcom NetXtreme II Network Adapter User Guide Detailed statistics and configuration information can be viewed using the ethtool utility. See the ethtool man page for more information. Linux iSCSI Offload User Application - brcm_iscsiuio Open iSCSI User Applications Bind iSCSI Target to Broadcom NX2 iSCSI Transport Name Making Connections to iSCSI Targets Maximize Offload iSCSI Connections...
  • Page 42: Making Connections To Iscsi Targets

    Linux Driver Software: Broadcom NetXtreme II Network Adapter User Guide iface.transport_name = bnx2i Ensure that the iface.hwaddress is in lower case format. If you wish to switch back to use the software initiator, use the following: iscsiadm --mode node --targetname iqn.2004-06.com.broadcom:tg1 \ --portal 192.168.1.100 --op=update --name=iface_file_name where the iface file includes the following information:...
  • Page 43 Linux Driver Software: Broadcom NetXtreme II Network Adapter User Guide Back to Contents Page file:///T|/htdocs/NETWORK/BroadCom/71921/NetXtremeII/en/linux.htm[9/26/2012 3:28:46 PM]...
  • Page 44: Installing Netware Server 6.5 Driver Software

    NetWare Driver Software: Broadcom NetXtreme II Network Adapter User Guide Back to Contents Page NetWare Driver Software: Broadcom NetXtreme II Network Adapter User Guide Overview Preinstallation Requirements Installing NetWare Server 6.5 Driver Software Viewing or Modifying Adapter Properties Removing Drivers from Autoexec.ncf Overview This section discusses three NetWare drivers: BX2.LAN: Broadcom NetXtreme II Gigabit Ethernet 32-bit driver...
  • Page 45: Viewing Or Modifying Adapter Properties

    NetWare Driver Software: Broadcom NetXtreme II Network Adapter User Guide the CD, and NetWare\Driver is the directory of the specific files on the CD needed for this installation. 9. Press DOWN ARROW or TAB to switch back to Additional Driver Options. 10.
  • Page 46 NetWare Driver Software: Broadcom NetXtreme II Network Adapter User Guide RxTicks= Enables the use of batching receives within a specific time period. Min = 0 (Disabled) Max = 5000000 (5 seconds) Units are in microseconds, The default value is 300. TxTicks= Enables the use of a transmit tick threshold interrupt within a specific time period.
  • Page 47 NetWare Driver Software: Broadcom NetXtreme II Network Adapter User Guide The default setting is OFF. NODE= A Novell NetWare keyword that allows an input Ethernet node address to replace the adapter factory-programmed Ethernet node address until a subsequent reboot. NODE=nnnnnnnnnnnn FRAME= A Novell NetWare keyword for specifying the frame type.
  • Page 48 NetWare Driver Software: Broadcom NetXtreme II Network Adapter User Guide operating system. This is a common feature supported in NetWare. The poll mode may increase driver performance in some environments. Poll = 1 (on) Poll = 0 (off) The default value is 0 (Poll mode is off). Wirespeed= This feature provides adapter link and data integrity even if the adapter is attached to a questionable cable and/or switch.
  • Page 49: Removing Drivers From Autoexec.ncf

    NetWare Driver Software: Broadcom NetXtreme II Network Adapter User Guide LOAD BX2 SLOT=2 FRAME=Ethernet_II NAME=BX2_1_EII BIND IPX BX2_1_EII NET=C3C8F2E4 BIND IP BX2_1_EII ADDR=172.16.1.1 MASK=ff.ff.ff.0 mount all SEARCH ADD SYS:\JAVA\BIN SEARCH ADD SYS:\JAVA\NWGFX Removing Drivers from Autoexec.ncf To remove the drivers from the Autoexec.ncf file, locate the load and bind command lines associated with the Broadcom driver and remark them out by inserting the # symbol at the beginning of each command line, or by deleting the statement.
  • Page 50: Installing The Driver

    Solaris Driver Software: Broadcom NetXtreme II Network Adapter User Guide Back to Contents Page Solaris Driver Software: Broadcom NetXtreme II Network Adapter User Guide Overview Installing the Driver Upgrading the Driver Uninstalling Driver Configuring the Driver Memory Usage Interrupt Management FCoE Support Overview This file describes how to install the Solaris driver for Broadcom's NetXtreme II 10 Gigabit Ethernet network adapters.
  • Page 51: Uninstalling Driver

    Solaris Driver Software: Broadcom NetXtreme II Network Adapter User Guide To upgrade the Broadcom driver package to the current version, you must first uninstall the previous driver version from the system. See Uninstalling Driver. Once the previous driver has been removed, you can follow any of the installation methods in this document to install the new driver version.
  • Page 52: Interrupt Management

    Solaris Driver Software: Broadcom NetXtreme II Network Adapter User Guide memory a single interface would consume is: Single Function Mode RX: 2048 DMA handles and 5M (MTU=1500) or 21M (MTU=9216) of memory TX: 20480 DMA handles and 5M (MTU=1500) or 21M (MTU=9216) of memory Total: 22528 DMA handles and 10M (MTU=1500) or 42M (MTU=9216) of memory Multifunction Mode (#descs / 4) RX: 512 DMA handles and 1M (MTU=1500) or 5M (MTU=9216) of memory...
  • Page 53 Solaris Driver Software: Broadcom NetXtreme II Network Adapter User Guide Support does not exist for NPIV in the Solaris 10 Update 9. Some of the fcinfo(1M) options, which are available in Solaris 11, are not be available in Solaris 10, Update 9. For more information, read the man page fcinfo(1M).
  • Page 54: Networking Support

    VMware Driver Software: Broadcom NetXtreme II Network Adapter User Guide Back to Contents Page VMware Driver Software: Broadcom NetXtreme II Network Adapter User Guide Packaging Networking Support Drivers FCoE Support Packaging The VMware driver is released in the packaging formats shown in Table Table 1: VMware Driver Packaging Format...
  • Page 55 VMware Driver Software: Broadcom NetXtreme II Network Adapter User Guide vmkload_mod bnx2x.ko disable_tpa=1 Use ethtool to disable TPA (LRO) for a specific network adapter. num_rx_queues The optional parameter num_rx_queues may be used to set the number of Rx queues on kernels starting from 2.6.24 when multi_mode is set to 1 and interrupt mode is MSI-X.
  • Page 56 VMware Driver Software: Broadcom NetXtreme II Network Adapter User Guide Rx Ring Size: 4078 (range 0–4078) Tx Ring Size: 4078 (range (MAX_SKB_FRAGS+4) - 4078). MAX_SKB_FRAGS varies on different kernels and different architectures. On a 2.6 kernel for x86, MAX_SKB_FRAGS is 18. Coalesce RX Microseconds: 25 (range 0–3000) Coalesce TX Microseconds: 50 (range 0–12288) MSI-X: Enabled (if supported by 2.6 kernel)
  • Page 57: Fcoe Support

    VMware Driver Software: Broadcom NetXtreme II Network Adapter User Guide queues will be set to 1, discarding the value of this parameter. If you would like the use of more then 1 queue, force the number of NetQueues to use via the following command: esxcfg-module -s "multi_mode=1 num_queues="...
  • Page 58: Installation Check

    VMware Driver Software: Broadcom NetXtreme II Network Adapter User Guide Physical NIC: vmnic7 User Priority: 3 VLAN id: 2008 The output of this command should show valid: FCF MAC, VNPort MAC, Priority, and VLAN id for the Fabric that is connected to the C-NIC. The following command can also be used to verify that the interface is working properly: #esxcfg-scsidevs -a Output example:...
  • Page 59: Installing The Driver Software

    A network device driver must be physically installed before the Broadcom NetXtreme II Controller can be used with your Windows operating system. Drivers are located on the driver source media as well as at the Dell website at http://support.dell.com.
  • Page 60: Using Silent Installation

    To install the Broadcom NetXtreme II drivers and management applications 1. When the Found New Hardware Wizard appears, click Cancel. 2. Insert the Dell-provided CD into the CD or DVD drive or download the software driver package from the Dell website at http://support.dell.com/.
  • Page 61 Windows Driver and Application Installation: Broadcom NetXtreme II Network Adapter User Guide Type the following: setup /s /v/qn To perform a silent upgrade from within the installer source folder Type the following: setup /s /v/qn To perform a silent reinstall of the same installer Type the following: setup /s /v"/qn REINSTALL=ALL"...
  • Page 62: Removing The Device Drivers

    Windows Driver and Application Installation: Broadcom NetXtreme II Network Adapter User Guide Repairing or Reinstalling the Driver Software To repair or reinstall the driver software 1. In Control Panel, double-click Add or Remove Programs. 2. Click Broadcom Drivers and Management Applications, and then click Change. 3.
  • Page 63: Inserting The Netxtreme Ii Monolithic Driver In A Winpe 2.0 Image

    Windows Driver and Application Installation: Broadcom NetXtreme II Network Adapter User Guide 1. Locate [Manufacturer] header within the file. 2. Review the line below it which reads: %brcm% = broadcom, ntx86, ntamd64, ntia64 or equivalent. 3. Modify that line to read: %brcm% = broadcom.ntx86, ntamd64, ntia64. The change made replaces the comma and space after "broadcom"...
  • Page 64: Configuring The Speed/Duplex Setting For The Netxtreme Ii Monolithic Driver

    Windows Driver and Application Installation: Broadcom NetXtreme II Network Adapter User Guide 3. Repeat steps 1 and 2 for each additional device driver. 4. Unmount the image after modifying it. dism /unmount-wim /Mountdir:c:\winpe_x86\mount /commit 5. After unmounting the image, burn it to the designated media. To create a bootable CD-ROM 1.
  • Page 65: Setting Power Management Options

    Windows Driver and Application Installation: Broadcom NetXtreme II Network Adapter User Guide Setting Power Management Options You can set power management options to allow the operating system to turn off the controller to save power or to allow the controller to wake up the computer. If the device is busy doing something (servicing a call, for example) however, the operating system will not shut down the device.
  • Page 66: Supported Operating Systems For Iscsi Boot

    iSCSI Protocol: Broadcom NetXtreme II Network Adapter User Guide Back to Contents Page iSCSI Protocol: Broadcom NetXtreme II Network Adapter User Guide iSCSI Boot iSCSI Crash Dump iSCSI Offload iSCSI Boot Broadcom NetXtreme II Gigabit Ethernet adapters support iSCSI boot to enable network boot of operating systems to diskless systems.
  • Page 67: Configuring Iscsi Boot Parameters

    iSCSI Protocol: Broadcom NetXtreme II Network Adapter User Guide 10. Target LUN 11. Initiator IQN 12. CHAP ID and secret Configuring iSCSI Boot Parameters Configure the Broadcom iSCSI boot software for either static or dynamic configuration. Refer to Table 1 for configuration options available from the General Parameters screen.
  • Page 68: Iscsi Boot Configuration

    Boot to iSCSI target: Disabled DHCP Vendor ID: BRCM ISAN Link Up Delay Time: 0 Use TCP Timestamp: Enabled (for some targets such as the Dell/EMC AX100i, it is necessary to enable Use TCP Timestamp) Target as First HDD: Disabled LUN Busy Retry Count: 0 IP Version: IPv6.
  • Page 69 Boot to iSCSI target: Disabled DHCP Vendor ID: BRCM ISAN Link Up Delay Time: 0 Use TCP Timestamp: Enabled (for some targets such as the Dell/EMC AX100i, it is necessary to enable Use TCP Timestamp) Target as First HDD: Disabled LUN Busy Retry Count: 0 IP Version: IPv6.
  • Page 70 iSCSI Protocol: Broadcom NetXtreme II Network Adapter User Guide NOTE: Information on the Initiator Parameters and 1st Target Parameters screens are ignored and do not need to be cleared. 3. A second iSCSI boot adapter can be configured for redundancy in the event the primary adapter fails to boot. To configure the secondary device parameters, select Secondary Device Parameters from the Main menu (see Configure Parameters for a Secondary Adapter).
  • Page 71 iSCSI Protocol: Broadcom NetXtreme II Network Adapter User Guide The DHCP protocol includes a number of options that provide configuration information to the DHCP client. For iSCSI boot, Broadcom adapters support the following DHCP configurations: DHCP Option 17, Root Path DHCP Option 43, Vendor-Specific Information DHCP Option 17, Root Path Option 17 is used to pass the iSCSI target information to the iSCSI client.
  • Page 72: Configuring The Dhcp Server

    iSCSI Protocol: Broadcom NetXtreme II Network Adapter User Guide DHCPv6 Option 16, Vendor Class Option DHCPv6 Option 17, Vendor-Specific Information NOTE: The DHCPv6 standard Root Path option is not yet available. Broadcom suggests using Option 16 or Option 17 for dynamic iSCSI Boot IPv6 support. DHCPv6 Option 16, Vendor Class Option DHCPv6 Option 16 (vendor class option) must be present and must contain a string that matches your configured DHCP Vendor ID parameter.
  • Page 73 iSCSI Protocol: Broadcom NetXtreme II Network Adapter User Guide Bindview.exe (see KB976042) Procedure: 1. Remove any local hard drives on the SUT. 2. Load the latest Broadcom MBA and iSCSI boot images onto NVRAM of the AUT. 3. Configure SUT's BIOS to have the Broadcom MBA as the first bootable device, and the CDROM as the second device. 4.
  • Page 74 iSCSI Protocol: Broadcom NetXtreme II Network Adapter User Guide 8. Configure one port of network adapter to connect to iSCSI Target (see how to setup iSCSI target in corresponding section). 9. Connect to iSCSI Target. 10. Use DD command to copy local hard drive to iSCSI Target. 11.
  • Page 75 iSCSI Protocol: Broadcom NetXtreme II Network Adapter User Guide 16. Make sure all runlevels of network service are on. 17. Make sure 2,3 and 5 runlevels of iscsi service are on. 18. For Red Hat 6.0, make sure Network Manager service is stopped and disabled. 19.
  • Page 76: Other Iscsi Boot Considerations

    iSCSI Protocol: Broadcom NetXtreme II Network Adapter User Guide # We only need to start this for root on iSCSI if ! grep -q iscsi_tcp /proc/modules ; then if ! grep -q bnx2i /proc/modules ; then rc_failed 6 rc_exit case "$1" in start) echo -n "Starting iSCSI initiator for the root device: "...
  • Page 77 iSCSI Protocol: Broadcom NetXtreme II Network Adapter User Guide Problem: A system blue screen occurs when installing the Broadcom drivers through Windows Plug-and-Play (PnP). Solution: Install the drivers through the Setup installer. Problem: For static IP configuration when switching from Layer 2 iSCSI boot to Broadcom iSCSI HBA, then you will receive an IP address conflict.
  • Page 78: Iscsi Crash Dump

    iSCSI Protocol: Broadcom NetXtreme II Network Adapter User Guide Note: The above command is a single continuous command. 1. Burn the Win2008R2Mod.iso file to a DVD. 2. Perform the installation by using the new DVD and provide the network controller drivers during installation. You will receive the iSCSI LUN to complete the installation.
  • Page 79: Configure Microsoft Initiator To Use Broadcom's Iscsi Offload

    iSCSI Protocol: Broadcom NetXtreme II Network Adapter User Guide The Broadcom Advanced Control Suite (BACS) is used to manage all of Broadcom's network adapters and advanced features. For more information, see Using Broadcom Advanced Control Suite 1. Open BACS. 2. Select the Broadcom NetXtreme II C-NIC iSCSI adapter. If the C-NIC iSCSI adapter is not present, then select the VBD device and enable iSCSI offload by selecting iSCSI Offload Engine from the Resource Reservations area of the Configuration tab.
  • Page 80 iSCSI Protocol: Broadcom NetXtreme II Network Adapter User Guide 4. Select the Discovery tab and click Add to add a target portal. 5. Enter the IP address of the target and click Advanced. file:///T|/htdocs/NETWORK/BroadCom/71921/NetXtremeII/en/iscsi.htm[9/26/2012 3:29:03 PM]...
  • Page 81 iSCSI Protocol: Broadcom NetXtreme II Network Adapter User Guide 6. From the General tab, select Broadcom NetXtreme II C-NIC iSCSI Adapter from Local adapter. 7. Select the IP address for the adapter from Source IP. file:///T|/htdocs/NETWORK/BroadCom/71921/NetXtremeII/en/iscsi.htm[9/26/2012 3:29:03 PM]...
  • Page 82 iSCSI Protocol: Broadcom NetXtreme II Network Adapter User Guide 8. Click OK to close Advanced setting and then OK to add the target portal. file:///T|/htdocs/NETWORK/BroadCom/71921/NetXtremeII/en/iscsi.htm[9/26/2012 3:29:03 PM]...
  • Page 83 iSCSI Protocol: Broadcom NetXtreme II Network Adapter User Guide 9. From the Targets tab, select the target and click Log On to log into your iSCSI target using the Broadcom iSCSI adapter. file:///T|/htdocs/NETWORK/BroadCom/71921/NetXtremeII/en/iscsi.htm[9/26/2012 3:29:03 PM]...
  • Page 84 iSCSI Protocol: Broadcom NetXtreme II Network Adapter User Guide 10. Click on Advanced. 11. On the General tab, select the Broadcom NetXtreme Ii C-NIC iSCSI adapter from Local adapter. 12. Click OK to close Advanced settings. file:///T|/htdocs/NETWORK/BroadCom/71921/NetXtremeII/en/iscsi.htm[9/26/2012 3:29:03 PM]...
  • Page 85: Iscsi Offload Faqs

    iSCSI Protocol: Broadcom NetXtreme II Network Adapter User Guide 13. Click OK to close the Microsoft Initiator. 14. To format your iSCSI partition, use Disk Manager. NOTES: No teaming support for iSCSI-enabled adapters is available at this point. MPIO handles all failover and link aggregation for iSCSI traffic.
  • Page 86 iSCSI Protocol: Broadcom NetXtreme II Network Adapter User Guide Q: Why does the install fail when attempting to complete an iSCSI offload install using Windows Server 2008 R2 for BCM5709 (1 GbE) adapters? A: There is a conflict with the internal inbox driver. Event Log Messages Table 5 lists the offload iSCSI driver event log messages.
  • Page 87 iSCSI Protocol: Broadcom NetXtreme II Network Adapter User Guide Error Target rejected an iSCSI PDU sent by the initiator. Dump data contains the rejected PDU. Error Initiator could not allocate a work item for processing a request. Error Initiator could not allocate resource for processing a request. Information Initiator received an asynchronous logout message.
  • Page 88 iSCSI Protocol: Broadcom NetXtreme II Network Adapter User Guide Error occurred when processing iSCSI logon request. The request was not retried. Error status is Error given in the dump data. Initiator did not start a session recovery upon receiving the request. Dump data contains the error Information status.
  • Page 89: Executive Summary

    This section describes the technology and implementation considerations when working with the network teaming services offered by the Broadcom software shipped with Dell's servers and storage products. The goal of Broadcom teaming services is to provide fault tolerance and link aggregation across a team of two or more adapters. The information in this document is provided to assist IT professionals during the deployment and troubleshooting of system applications that require network fault tolerance and load balancing.
  • Page 90: Teaming Concepts

    Storage devices use RAID technology to group individual hard drives. Switch ports can be grouped together using technologies such as Cisco Gigabit EtherChannel, IEEE 802.3ad Link Aggregation, Bay Network Multilink Trunking, and Extreme Network Load Sharing. Network interfaces on Dell servers can be grouped together into a team of physical ports called a virtual adapter.
  • Page 91 Broadcom Teaming Services: Broadcom NetXtreme II Network Adapter User Guide Ethernet devices communicate with other Ethernet devices using the MAC address, not the IP address. However, most applications work with a host name that is translated to an IP address by a Naming Service such as WINS and DNS. Therefore, a method of identifying the MAC address assigned to the IP address is required.
  • Page 92 Broadcom Teaming Services: Broadcom NetXtreme II Network Adapter User Guide balancing, and only failover when configured for fault tolerance. This type of team works with any Ethernet switch and requires no trunking configuration on the switch. The team advertises multiple MAC addresses and one or more IP addresses (when using secondary IP addresses).
  • Page 93: Toe Teaming

    Broadcom Teaming Services: Broadcom NetXtreme II Network Adapter User Guide protocol stack responds to ARP Requests. In addition, each physical adapter in the team uses the same team MAC address when transmitting frames. This is possible since the switch at the other end of the link is aware of the teaming mode and will handle the use of a single MAC address by every port in the team.
  • Page 94: Software Components

    Broadcom Teaming Services: Broadcom NetXtreme II Network Adapter User Guide information for that TCP connection. BASP can simultaneously use TCP offload in conjunction with the SLB modes of teaming. Other teaming modes (Generic Trunking or Link Aggregation) can still be used on TOE capable devices, but if those other modes are enabled the TOE feature is disabled.
  • Page 95: Teaming Support By Processor

    Table 4 provides a feature comparison across the team types supported by Dell. Use this table to determine the best type of team for your application. The teaming software supports up to eight ports in a single team and up to four teams in a single system.
  • Page 96: Selecting A Team Type

    Broadcom Teaming Services: Broadcom NetXtreme II Network Adapter User Guide Independent Fault Load Switch-Dependent Dynamic Link Type of Team Tolerance Balancing Static Trunking Aggregation (IEEE 802.3ad) SLB with Link Function Generic Trunking Aggregation Standby Number of ports per team (same broadcast domain) 2–8 2–8 2–8...
  • Page 97: Teaming Mechanisms

    Broadcom Teaming Services: Broadcom NetXtreme II Network Adapter User Guide Teaming Mechanisms Architecture Types of Teams Attributes of the Features Associated with Each Type of Team Speeds Supported for Each Type of Team Architecture The Broadcom Advanced Server Program is implemented as an NDIS intermediate driver (see Figure 2).
  • Page 98: Outbound Traffic Flow

    Broadcom Teaming Services: Broadcom NetXtreme II Network Adapter User Guide assigned to a different port. Figure 2: Intermediate Driver Outbound Traffic Flow The Broadcom Intermediate Driver manages the outbound traffic flow for all teaming modes. For outbound traffic, every packet is first classified into a flow, and then distributed to the selected physical adapter for transmission. The flow classification involves an efficient hash computation over known protocol fields.
  • Page 99: Inbound Traffic Flow (Slb Only)

    Broadcom Teaming Services: Broadcom NetXtreme II Network Adapter User Guide performs load balancing on a TCP session basis and not on a packet-by-packet basis. In the Outbound Flow Hash Entries, statistics counters are also updated after classification. The load-balancing engine uses these counters to periodically distribute the flows across teamed ports.
  • Page 100 Broadcom Teaming Services: Broadcom NetXtreme II Network Adapter User Guide TCP------> PhysAdapter2 ------> 10.0.0.1 UDP------> PhysAdatper3 ------> 10.0.0.1 The actual assignment between adapters may change over time, but any protocol that is not TCP/UDP based goes over the same physical adapter because only the IP address is used in the hash. Performance Modern network interface cards provide many hardware features that reduce CPU utilization by offloading certain CPU intensive operations (see...
  • Page 101 Broadcom Teaming Services: Broadcom NetXtreme II Network Adapter User Guide This mode supports a variety of environments where the adapter link partners are statically configured to support a proprietary trunking mechanism. This mode could be used to support Lucent's Open Trunk, Cisco's Fast EtherChannel (FEC), and Cisco's Gigabit EtherChannel (GEC).
  • Page 102: Attributes Of The Features Associated With Each Type Of Team

    Broadcom Teaming Services: Broadcom NetXtreme II Network Adapter User Guide Dynamic trunking works with switches that support IEEE 802.3ad Link Aggregation dynamic mode using LACP. Inbound load balancing is switch dependent. In general, the switch traffic is load balanced based on L2 addresses. In this case, all network protocols such as IP, IPX, and NetBEUI are load balanced.
  • Page 103: Speeds Supported For Each Type Of Team

    Broadcom Teaming Services: Broadcom NetXtreme II Network Adapter User Guide Link speed support Different speeds Frame protocol Incoming packet management Switch Outgoing packet management BASP Failover event Loss of link only Failover time <500 ms Fallback time 1.5 s (approximate) MAC address Same for all adapters Multivendor teaming...
  • Page 104: Checksum Offload

    Broadcom Teaming Services: Broadcom NetXtreme II Network Adapter User Guide IEEE 802.1Q VLANs Wake On LAN Preboot Execution Environment Before creating a team, adding or removing team members, or changing advanced settings of a team member, make sure each team member has been configured similarly. Settings to check include VLANs and QoS Packet Tagging, Jumbo Frames, and the various offloads.
  • Page 105: General Network Considerations

    Broadcom Teaming Services: Broadcom NetXtreme II Network Adapter User Guide file transfer. Without the TCP Offload Engine, the TCP/IP protocol suite runs on the host CPU, consuming a very high percentage of its resources and leaving little resources for the applications. With the use of the Broadcom NetXtreme II adapter, the TCP/IP processing can be moved to hardware, freeing the CPU for more important tasks such as application processing.
  • Page 106: Teaming With Microsoft Virtual Server 2005

    Broadcom Teaming Services: Broadcom NetXtreme II Network Adapter User Guide Teaming with Microsoft NLB Teaming with Microsoft Virtual Server 2005 The only supported BASP team configuration when using Microsoft Virtual Server 2005 is with a Smart Load Balancing (TM) team-type consisting of a single primary Broadcom adapter and a standby Broadcom adapter. Make sure to unbind or deselect "Virtual Machine Network Services"...
  • Page 107 Broadcom Teaming Services: Broadcom NetXtreme II Network Adapter User Guide The addition of a link between the switches allows traffic from/to Blue and Gray to reach each other without any problems. Note the additional entries in the CAM table for both switches. The link interconnect is critical for the proper operation of the team.
  • Page 108: Spanning Tree Algorithm

    Broadcom Teaming Services: Broadcom NetXtreme II Network Adapter User Guide Figure 5 represents a failover event in which the cable is unplugged on the Top Switch port 4. This is a successful failover with all stations pinging each other without loss of connectivity. Figure 5: Failover Event Spanning Tree Algorithm Topology Change Notice (TCN)
  • Page 109: Layer 3 Routing/Switching

    Broadcom Teaming Services: Broadcom NetXtreme II Network Adapter User Guide that has a lost link on one of its physical adapters. If the physical adapter were to be reconnected (also known as fallback), the intermediate driver would detect that the link has been reestablished and would begin to pass traffic through the port. Traffic would be lost if the port was temporarily blocked by the Spanning Tree Protocol.
  • Page 110: Generic And Dynamic Trunking (Fec/Gec/Ieee 802.3Ad)

    Broadcom Teaming Services: Broadcom NetXtreme II Network Adapter User Guide SLB Teams SLB teams are the only teaming type not dependant on switch configuration. The server intermediate driver handles the load balancing and fault tolerance mechanisms with no assistance from the switch. These elements of SLB make it the only team type that maintains failover and fallback characteristics when team ports are connected directly to a hub.
  • Page 111: Teaming And Clustering

    Oracle Microsoft Cluster Software Dell Server cluster solutions integrate Microsoft Cluster Services (MSCS) with PowerVault SCSI or Dell/EMC Fibre-Channel based storage, Dell servers, storage adapters, storage switches and network adapters to provide high-availability (HA) solutions. HA clustering supports all adapters qualified on a supported Dell server.
  • Page 112: High-Performance Computing Cluster

    Broadcom Teaming Services: Broadcom NetXtreme II Network Adapter User Guide NOTE: Microsoft Network Load Balancing is not supported with Microsoft Cluster Software. High-Performance Computing Cluster Gigabit Ethernet is typically used for the following three purposes in high-performance computing cluster (HPCC) applications: Inter-Process Communications (IPC): For applications that do not require low-latency, high-bandwidth interconnects (such as Myrinet, InfiniBand), Gigabit Ethernet can be used for communication between the compute nodes.
  • Page 113: Teaming And Network Backup

    Broadcom Teaming Services: Broadcom NetXtreme II Network Adapter User Guide Advanced Features PXE is used extensively for the deployment of the cluster (installation and recovery of compute nodes). Teaming is typically not used on the host side and it is not a part of our standard offering. Link aggregation is commonly used between switches, especially for large configurations.
  • Page 114: Load Balancing And Failover

    Broadcom Teaming Services: Broadcom NetXtreme II Network Adapter User Guide Fault Tolerance When you perform network backups in a nonteamed environment, overall throughput on a backup server adapter can be easily impacted due to excessive traffic and adapter overloading. Depending on the number of backup servers, data streams, and tape drive speed, backup traffic can easily consume a high percentage of the network link bandwidth, thus impacting production data and tape backup performance.
  • Page 115: Fault Tolerance

    Broadcom Teaming Services: Broadcom NetXtreme II Network Adapter User Guide infrastructure must implement teaming such as load balancing and fault tolerance. Data centers will incorporate redundant switches, link aggregation, and trunking as part of their fault tolerant solution. Although teaming device drivers will manipulate the way data flows through teamed interfaces and failover paths, this is transparent to tape backup applications and does not interrupt any tape backup process when backing up remote systems over the network.
  • Page 116: Troubleshooting Teaming Problems

    1. Although mixed-speed SLB teaming is supported by Dell, it is recommended that all adapters in a team be the same speed (either all Gigabit Ethernet or all Fast Ethernet). For speeds of 10 Gbps, it is highly recommended that all adapters in a team be the same speed.
  • Page 117: Frequently Asked Questions

    11. Verify the base (Miniport) and team (intermediate) drivers are from the same release package. Dell does not test or support mixing base and teaming drivers from different releases.
  • Page 118 Broadcom Teaming Services: Broadcom NetXtreme II Network Adapter User Guide Question: Which protocols are load balanced with SLB and which ones are not? Answer: Only IP/TCP/UDP protocols are load balanced in both directions: send and receive. IPX is load balanced on the transmit traffic only.
  • Page 119: Appendix A: Event Log Messages

    Answer: No. SLB can only detect the loss of link between the teamed port and its immediate link partner. SLB cannot detect link failures on other ports. Question: Where can I get the latest supported drivers? Answer: Go to Dell support at http://support.dell.com for driver package updates or support documents.
  • Page 120 Broadcom Teaming Services: Broadcom NetXtreme II Network Adapter User Guide usage. The driver cannot allocate Failed to allocate map Unload other drivers that may allocate map Error map registers from the registers. registers. operating system. Failed to access The driver cannot access PCI For add-in adapters: reseat the adapter in configuration Error...
  • Page 121: Intermediate Driver (Virtual Adapter/Team)

    Broadcom Teaming Services: Broadcom NetXtreme II Network Adapter User Guide This driver does not support this device. The driver does not recognize Upgrade to a driver version that supports Error Upgrade to the latest the installed adapter. this adapter. driver. Reinstall the driver, update to a newer Driver initialization Unspecified failure during...
  • Page 122 Broadcom Teaming Services: Broadcom NetXtreme II Network Adapter User Guide The physical adapter is Network adapter is Informational connected to the network (it No action is required. connected. has established link). Broadcom Advanced Program Features Driver is The driver does not support Consult the driver release notes and Error not designed to run on this...
  • Page 123 Broadcom Teaming Services: Broadcom NetXtreme II Network Adapter User Guide manually configured for Informational configured for 10Mb No action is required. the selected line speed full-duplex link. and duplex settings. The adapter has been Network controller manually configured for Informational configured for 100Mb No action is required.
  • Page 124: Supported Operating Systems For Nic Partitioning

    NIC Partitioning: Broadcom NetXtreme II Network Adapter User Guide Back to Contents Page NIC Partitioning: Broadcom NetXtreme II Network Adapter User Guide Overview Configuring for NIC Partitioning Overview NIC partitioning (NPAR) divides a Broadcom NetXtreme II 10 Gigabit Ethernet NIC into multiple virtual NICs by having multiple PCI physical functions per port.
  • Page 125: Function Description

    NIC Partitioning: Broadcom NetXtreme II Network Adapter User Guide TX Flow Control Flow Control Configures the Flow Control mode for this port. RX Flow Control TX/RX Flow Control None PF#0, PF#2, PF#4, Displays the physical function (PF) information regarding the partition(s) Table 2 PF#6 on port 0.
  • Page 126: Supported Operating Systems

    Fibre Channel Over Ethernet: Broadcom NetXtreme II Network Adapter User Guide Back to Contents Page Fibre Channel Over Ethernet: Broadcom NetXtreme II Network Adapter User Guide Overview FCoE Boot from SAN Configuring FCoE Overview In today's data center, multiple networks, including network attached storage (NAS), management, IPC, and storage, are used to achieve the desired performance and versatility.
  • Page 127 On supported Dell platforms (Dell M710HD and Dell M915), the boot protocol must be configured through system BIOS (accessible through F2 at POST). For supported Dell platforms, modifications to the boot protocol made through CCM will not be persistent and are overwritten by the system BIOS setting upon each reboot.
  • Page 128 Fibre Channel Over Ethernet: Broadcom NetXtreme II Network Adapter User Guide Prepare Broadcom Multiple Boot Agent for FCoE Boot 1. During POST, press CTRL+S at the Broadcom NetXtreme Ethernet Boot Agent banner to invoke the CCM utility. 2. Select the device through which boot is to be configured. NOTE: IMPORTANT: When running in NIC Partitioning (NPAR) mode, FCoE boot is only supported when the first function on each port is assigned an FCoE personality.
  • Page 129 DCB/DCBX must be enabled, and the directly attached link peer must also be DCBX capable with parameters that allow for full DCBX synchronization. 4. For Dell 57712 NDC-based systems (for example, M710HD, M915), set the boot protocol through system BIOS configuration in the integrated devices pane as described above.
  • Page 130 Fibre Channel Over Ethernet: Broadcom NetXtreme II Network Adapter User Guide 1. Configure the desired boot target and LUN. From the Target Information Menu, select the first available path. 2. Enable the Connect field. Enter the target WWPN and Boot LUN information for the target to be used for boot. file:///T|/htdocs/NETWORK/BroadCom/71921/NetXtremeII/en/fcoe.htm[9/26/2012 3:29:33 PM]...
  • Page 131 Fibre Channel Over Ethernet: Broadcom NetXtreme II Network Adapter User Guide 3. Press ESC until prompted to exit and save changes. 4. Proceed to OS installation once storage access has been provisioned in the SAN. Provisioning Storage Access in the SAN Storage access consists of zone provisioning and storage selective LUN presentation, each of which is commonly provisioned per initiator WWPN.
  • Page 132 20:00:00:10:18:11:22:33. NOTE: The default WWPN is 20:00: + . The default WWNN is 10:00: + . NOTE: In Dell FlexAddress configurations, the SAN/FIP MAC may be overridden by the blade chassis management system. CTRL+R Method The CTRL+R method allows you to use the boot initiator to bring up the link and login into all available fabrics and targets.
  • Page 133 Fibre Channel Over Ethernet: Broadcom NetXtreme II Network Adapter User Guide Windows 2008 R2 and Windows 2008 SP2 Installation Since Broadcom FCoE drivers are not inbox for Windows 2008 R2 SP1 or Windows 2008 SP2, the EVBD and OFC drivers need to be loaded during installation.
  • Page 134 Fibre Channel Over Ethernet: Broadcom NetXtreme II Network Adapter User Guide 3. Select the boot LUN to be installed: 4. Continue with the rest of the installation. After installation is complete and booted to SAN, execute the provided Windows driver installer and reboot. Installation is now complete. NOTE: The boot initiator must be configured to point at the desired installation LUN, and the boot initiator must have successfully logged and determined the readiness of the LUN prior to starting installation.
  • Page 135: Linux Installation

    Fibre Channel Over Ethernet: Broadcom NetXtreme II Network Adapter User Guide are not met, the devices will still show up in the drive list above, but upon proceeding with installation Read/Write errors will occur. Linux Installation The Linux Boot from SAN procedure is indirect and requires the OS to be first installed locally and then imaged to the target LUN.
  • Page 136 Fibre Channel Over Ethernet: Broadcom NetXtreme II Network Adapter User Guide 10. Modify /etc/fstab to point to the same device paths for the root (/) and swap mount points. file:///T|/htdocs/NETWORK/BroadCom/71921/NetXtremeII/en/fcoe.htm[9/26/2012 3:29:33 PM]...
  • Page 137 Fibre Channel Over Ethernet: Broadcom NetXtreme II Network Adapter User Guide 11. Now that the local drive is reconfigured to support FCoE boot. Copy the entire local hard drive contents to the SAN LUN via dd: # dd if= of= bs=1MB where ...
  • Page 138: Configuring Fcoe

    Fibre Channel Over Ethernet: Broadcom NetXtreme II Network Adapter User Guide Configuring FCoE By default, DCB is enabled on Broadcom NetXtreme II FCoE-, DCB-compatible C-NICs. To enable/disable FCoE and DCB and to optimize DCB support for the various fabrics on the network, customize the ETS, PFC, FCoE, and DCBX parameters. For Windows operating systems, use either Broadcom Advanced Control Suite (BACS) or Broadcom's Comprehensive Configuration Management (CCM) utility to configure the DCB parameters.
  • Page 139: Priority Flow Control (Pfc)

    Using Data Center Bridging (DCB): Broadcom NetXtreme II Network Adapter User Guide Back to Contents Page Using Data Center Bridging (DCB): Broadcom NetXtreme II Network Adapter User Guide Overview DCB Capabilities DCB Conditions Overview Data Center Bridging (DCB) is a collection of IEEE specified standard extensions to Ethernet to provide lossless data delivery, low latency, and standards-based bandwidth sharing of data center physical links.
  • Page 140 Using Data Center Bridging (DCB): Broadcom NetXtreme II Network Adapter User Guide switch acknowledges the C-NIC's willingness, then the switch will send the C-NIC the recommended ETS and PFC parameter settings. The DCBX protocol uses the Link Level Discovery Protocol (LLDP) to exchange PFC and ETS configurations between link partners.
  • Page 141: Broadcom Advanced Control Suite Overview

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide Back to Contents Page Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide Broadcom Advanced Control Suite Overview Starting Broadcom Advanced Control Suite Configuring Teaming Configuring With the Command Line Interface Utility Broadcom Advanced Control Suite Overview...
  • Page 142: Explorer View Pane

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide Explorer View Pane You can dock and pin the Explorer View pane on the left side, right side, top, or bottom of the main window. The Explorer View pane lists the objects that can be viewed, analyzed, tested, or configured by BACS. When an item is selected in the Explorer View pane, the tabs showing the information and options that are available for the item appear in the Context View pane.
  • Page 143: Context View Pane

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide NDIS view iSCSI view FCoE view iSCSI Target view FCoE Target view Context View Pane The Context View pane displays all the parameters that you can view for the object selected in the Explorer View pane. The parameters are grouped by tabs and categories, depending on the parameter type.
  • Page 144: Description Pane

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide The Manage iSNS Servers window is available from the iSCSI menu. From this window, you can add or remove Internet Storage Name Service (iSNS) servers. Manage Discovery Portals The Manage Discovery Portals window is available from the iSCSI menu.
  • Page 145: Managing The Host

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide options for Linux are CimXML, WinRM, or Try All. The Try All option forces the GUI client to try all options. 4. Select the HTTP scheme, or the HTTPS scheme for added security. 5.
  • Page 146: Information Tab: Iscsi Initiator

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide Displays the hardware architecture platform (for example, 32-bit or 64-bit) Information Tab: iSCSI Initiator The iSCSI Initiator section of the Information tab is available if iSCSI is enabled on the host. Name Displays the iSCSI initiator name in IQN format.
  • Page 147: Viewing Adapter Information

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide The installed network adapters appear one level below the host in the hierarchical tree in the Explorer View pane. At the adapter level, you can view information and configure parameters from the following tabs: Information Configuration Viewing Adapter Information...
  • Page 148: Viewing Hardware Information

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide The clock speed on PCI-E bus. This information is only available for Broadcom NetXtreme II adapters. Slot Number The slot number on the system board occupied by the adapter. This item is not available for PCI Express type adapters. Bus Speed The bus clock signal frequency used by the adapter.
  • Page 149: Configuring Adapter Parameters

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide Management Firmware The firmware version installed on the system. Vendor ID The vendor ID. Device ID The adapter ID. Subsystem Vendor ID The subsystem vendor ID. Subsystem ID The subsystem ID.
  • Page 150: Managing Ethernet Controller (Port)

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide The possible values are from 0 to 100. The value is the percentage of the maximum link speed allowed for the function. For example, if 50 is configured, then the bandwidth usage of the function is restricted to 50% of the 10 Gbps, which is 5Gbps. Minimum Bandwidth The possible values are from 0 to 100.
  • Page 151 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide MAC Address A physical MAC (media access control) address that is assigned to the adapter by the manufacturer. The physical address is never all Permanent MAC Address The unique hardware address assigned to the network adapter.
  • Page 152: Viewing Nic Partitioning Information

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide IPv6 Flow Info The non-zero Flow Info is used to classify traffic flows. If Flow Info equals zero, then the packets are not a part of any flow. Default Gateway The default gateway value is the network address of the gateway that will be used by the management firmware for packets destined for hosts external to the local network segment.
  • Page 153: Testing The Network

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide Number of Partitions The number of partitions for the port. Each port can have from one to four partitions with each partition behaving as if it is an independent NIC port.
  • Page 154 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide The Diagnostic Tests option on the Diagnostics tab lets you check the state of the physical components on a Broadcom network adapter. You can trigger the tests manually, or choose to have BACS continuously perform them. If the test are performed continuously, then the number of passes and fails in the Result field for each test increments every time the tests are performed.
  • Page 155: Analyzing Cables

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide EEPROM This test verifies the content of the electrically erasable programmable read-only memory (EEPROM) by reading a portion of the EEPROM and computing the checksum. The test fails if the computed checksum is different from the checksum stored in the EEPROM. An EEPROM image upgrade does not require a code change for this test.
  • Page 156 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide Distance The valid cable length in meters (except when the Noise result is returned). Status The result of the analysis for the indicated pair. Good. Good cable/PCB signal paths, but no gigabit link. Crossed.
  • Page 157: Managing The Lan Device

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide Cable quality. Category 3, 4, 5, and 6 may affect the test results. Electrical interference. The testing environment may affect the test results. Managing the LAN Device The LAN function represents the Ethernet (NDIS) functionality available under the PCI Function.
  • Page 158: Configuring The Ndis Driver

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide Driver Status The status of the adapter driver. Loaded. Normal operating mode. The adapter driver has been loaded by Windows and is functioning. Not Loaded. The driver associated with the adapter has not been loaded by Windows. Information Not Available.
  • Page 159 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide You must have administrator privileges to change the values for a property. The list of available properties for your particular adapter may be different. Some properties may not be available for all Broadcom network adapters. If an adapter is included as a member of a team and you change any advanced property, then you must rebuild the team to ensure that the team's advanced properties are properly set.
  • Page 160 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide Tx Enabled. Transmit PAUSE frame is enabled. IPv4 Checksum Offload Normally, the checksum function is computed by the protocol stack. When you select one of the Checksum Offload property values (other than None), the checksum can be computed by the network adapter.
  • Page 161 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide LSO Off, Jumbo 7500. Frame size of 7500 bytes and LSO off. LSO Off, Jumbo 9000. Frame size of 9000 bytes and LSO off. Locally Administered Address The Locally Administered Address is a user-defined MAC address that is used in place of the MAC address originally assigned to the network adapter.
  • Page 162 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide 1 Gb copper ports cannot be forced to 1 Gb. Speed & Duplex (SerDes) 1 Gb Full. Forces the speed to 1 Gb Full based on a matching setting for its link partner. Auto (default).
  • Page 163 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide Also unlike BASP, the NDIS 6.0 driver only provides VLAN tagging of the outbound packet, but does not provide filtering of incoming packets based on VLAN ID membership. This is the default behavior of all miniport drivers. While the lack of filtering packets based on VLAN membership may present a security issue, the following provides a risk assessment based on this driver limitation for an IPv4 network: A properly configured network that has multiple VLANs should maintain separate IP segments for each VLAN.
  • Page 164: Viewing Resource Information

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide Enables and disables TOE offload when using the IPv4 protocol. The default is Enabled. TCP Connection Offload (IPv6) Enables and disables TOE offload when using the IPv6 protocol. The default is Enabled. Pause on Exhausted Host Ring For BCM57711 and BCM57712 network adapters, there are two possible scenarios that can trigger pause frames to be generated: a host ring buffer is exhausted or the on-chip buffers are depleted.
  • Page 165: Viewing Statistics

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide Viewing Statistics The information provided on the Statistics tab allows you to view traffic statistics for both Broadcom network adapters and network adapters made by others. Statistical information and coverage are more comprehensive for Broadcom adapters. To view Statistics information for any installed network adapter, click the name of the adapter listed in the Explorer View pane, then click the Statistics tab.
  • Page 166 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide Directed Frames Tx A count of directed data frames that were successfully transmitted. Multicast Frames Tx A count of frames that were successfully transmitted (as indicated by the status value Transmit OK) to a group destination address other than a broadcast address.
  • Page 167 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide The number of logout commands issued by the initiator for reasons other than to remove a connection from a session or to close a session. Local Initiator login failures The number of login failures likely caused by the initiator.
  • Page 168 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide The number of connection timeout errors for the named session. Format errors The number of errors due to inconsistent fields, reserved fields not 0, non-existent LUN, etc. for the named session. IEEE 802.3 Statistics Frames Rx with Alignment Error A count of the frames that were not an integral number of octets in length and do not pass the FCS check.
  • Page 169: Configuring The Ip Address For Iscsi Offload

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide Viewing and Configuring Resource Reservations NOTES: Resource Reservation information is only available for Broadcom NetXtreme II adapters and VBD drivers. Not all offload technologies are available with all adapters. The Resource Reservations section shows the number of connections allocated to an offload technology: TOE and iSCSI.
  • Page 170: Viewing Licenses

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide 1. Click the name of the Broadcom NetXtreme II iSCSI device in the SCSI controller section of the Explorer View pane. 2. Depending on the protocol you will be using, for IPv4 DHCP or IPv6 DHCP, select Enable (not available for iSCSI booted adapters) to set the IP address dynamically using a DHCP server.
  • Page 171: Standby Team Member And Auto-Fallback Disable Mode

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide SLB (Auto-Fallback Disable) – The Auto-Fallback Disable feature is configured for Smart Load Balance and Failover type teams in the Teaming Wizard. NOTE: NetXtreme II network adapters with iSCSI enabled is supported only in an SLB team type. Smart Load Balance and Failover In this type of team, a standby member handles the traffic if all of the load balance members fail (a failover event).
  • Page 172 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide NOTE: If you prefer to work without the wizard for now, click Expert Mode. If you want to always use Expert Mode to create a team, select Default to Expert Mode on next start. See Using Expert Mode.
  • Page 173 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide 4. Select the type of team you want to create. If the team type is an SLB type team, click Next. If the team type is not an SLB type team, then a dialog box appears.
  • Page 174 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide 5. From the Available Adapters list, click the adapter you want to add to the team and then click Add. Remove team members from the Team Members list by clicking the adapter and then clicking Remove. Click Next. NOTE: There must be at least one Broadcom network adapter assigned to the team.
  • Page 175 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide 6. If you want to designate one of the adapters as a standby member (optional), select Use the following member as a standby member, then choose the standby member from the list of adapters. 7.
  • Page 176 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide 8. If you want to configure LiveLink, select Yes, otherwise select No, then click Next. 9. Select the probe interval (the number of seconds between each retransmission of a link packet to the probe target) and the maximum number of probe retries (the number of consecutively missed responses from a probe target before a failover is triggered).
  • Page 177 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide 14. Type the VLAN name and then click Next. NOTE: The team name cannot exceed 39 characters, cannot begin with spaces, and cannot contain any of the following characters: &...
  • Page 178 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide add additional VLANs (see Step 17. of this procedure). 16. Type the VLAN tag value and then click Next. The value must be between 1 and 4094. 17.
  • Page 179 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide additional VLANs. NOTE: You can define up to 64 VLANs per team (63 VLANs that are tagged and 1 VLAN that is not tagged). Adding several VLANS may slow down the reaction time of the Windows interface due to memory and processor time usage for each VLAN. The degree to which Windows performance may suffer depends on system configuration.
  • Page 180 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide NOTE: At any point in the Broadcom Teaming Wizard procedure, click Preview to get a visual representation of what the team will look like before committing any changes. 19.
  • Page 181: Using Expert Mode

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide Using Expert Mode Use Expert Mode to create a team, modify a team, add a VLAN, and configure LiveLink for a Smart Load Balance and Failover and SLB (Auto-Fallback Disable) team.
  • Page 182 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide NOTE: The Create Team tab appears only if there are teamable adapters available. 4. Click the Team Name field to enter a team name. 5. Click the Team Type field to select a team type. 6.
  • Page 183 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide 12. Click Yes when the message is displayed indicating that the network connection will be temporarily interrupted. NOTES: The team name cannot exceed 39 characters, cannot begin with spaces, and cannot contain any of the following characters: &...
  • Page 184 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide 4. Make the desired changes, and then click Update. The changes have not yet been applied; click the Preview tab to view the updated team structure before applying the changes. 5.
  • Page 185 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide 8. Click Yes when the message is displayed indicating that the network connection will be temporarily interrupted. NOTE: To maintain optimum adapter performance, your system should have 64 MB of system memory for each of the eight VLANs created per adapter.
  • Page 186: Viewing Basp Statistics

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II Network Adapter User Guide A probe target must be on the same subnet as the team, have a valid (not a broadcast, multicast, or unicast), statically-assigned IP address, and be highly available (always on). To ensure network connectivity to the probe target, ping the probe target from the team.
  • Page 187: Configuring With The Command Line Interface Utility

    BACSCLI also allows you the ability to team network adapters together for load balancing and failover. For a complete list of available commands and examples, see the BACSCLI ReadMe text file on the Dell-provided CD. Supported Operating Systems...
  • Page 188: Performing Diagnostics

    User Diagnostics: Broadcom NetXtreme II Network Adapter User Guide Back to Contents Page User Diagnostics: Broadcom NetXtreme II Network Adapter User Guide Introduction System Requirements Performing Diagnostics Diagnostic Test Descriptions Introduction Broadcom NetXtreme II User Diagnostics is an MS-DOS based application that runs a series of diagnostic tests (see Table on the Broadcom NetXtreme II network adapters in your system.
  • Page 189 User Diagnostics: Broadcom NetXtreme II Network Adapter User Guide Specifies the bin file to update the NCSI firmware. uxdiag -fnvm Programs the raw image into NVM. uxdiag -fump Specifies the bin file to update UMP firmware. uxdiag -help Displays the Broadcom NetXtreme II User Diagnostics (uxdiag) command options.
  • Page 190: Diagnostic Test Descriptions

    User Diagnostics: Broadcom NetXtreme II Network Adapter User Guide uediag -fib Specifies the bin file for iSCSI boot. uediag -fibc Programs iSCSI configuration block 0. Used only with -fib . uediag -fibc2 Programs iSCSI configuration block 1. Used only with -fib . uediag -fibp Programs iSCSI configuration software.
  • Page 191 User Diagnostics: Broadcom NetXtreme II Network Adapter User Guide Generates a PCI interrupt and verifies that the system receives the interrupt and invokes the correct Interrupt ISR. A negative test is also performed to verify that a masked interrupt does not invoke the ISR. Verifies that a Message Signaled Interrupt (MSI) causes an MSI message to be DMA'd to host memory.
  • Page 192 User Diagnostics: Broadcom NetXtreme II Network Adapter User Guide NVM Access Verifies non-volatile memory (NVM) accesses (both read and write) initiated by one of the internal and Reset- CPUs. It tests for appropriate access arbitration among multiple entities (CPUs). It also checks for Corruption possible NVM corruption by issuing a chip reset while the NVM block is servicing data.
  • Page 193: Interface Specifications

    Specifications: Broadcom NetXtreme II Network Adapter User Guide Back to Contents Page Specifications: Broadcom NetXtreme II Network Adapter User Guide 10/100/1000BASE-T and 10GBASE-T Cable Specifications Interface Specifications NIC Physical Characteristics NIC Power Requirements Wake On LAN Power Requirements Environmental Specifications 10/100/1000BASE-T and 10GBASE-T Cable Specifications Table 1: 10/100/1000BASE-T Cable Specifications Port Type...
  • Page 194: Nic Power Requirements

    Specifications: Broadcom NetXtreme II Network Adapter User Guide BCM5709 PCI Express x4 low-profile 11.9 cm (4.7 inches) 6.9 cm (2.7 inches) BCM57710/BCM57711/BCM57712 PCI Express x8 low profile 16.8 cm (6.6 inches) 5.1 cm (2.0 inches) NIC Power Requirements Table 6 shows the power requirements for the BCM5708C add-in NIC.
  • Page 195: Environmental Specifications

    Specifications: Broadcom NetXtreme II Network Adapter User Guide Environmental Specifications Table 11: BCM5708 Environmental Specifications Condition Operating Specification Storage Specification Temperature 0°C to 55°C (+32°F to +131°F) –40°C to +85°C (–40°F to +185°F) 5% to 85% (noncondensing) 5% to 95% (noncondensing) Relative humidity 40°C, 16 hour dwells at extremes 10°C/hour...
  • Page 196: Fcc Notice

    Regulatory Information: Broadcom NetXtreme II Network Adapter User Guide Back to Contents Page Regulatory Information: Broadcom NetXtreme II Network Adapter User Guide FCC Notice VCCI Notice CE Notice Canadian Regulatory Information (Canada Only) Korea Communications Commission (KCC) Notice (Republic of Korea Only) BSMI Certifications for BCM95709SA0908G, BCM957710A1023G, E02D001, and BCM957711A1123G (E03D001) FCC Notice...
  • Page 197: Vcci Notice

    Regulatory Information: Broadcom NetXtreme II Network Adapter User Guide Broadcom NetXtreme II 10 Gigabit Ethernet Controller BCM957710A1022G BCM957710A1021G BCM957711A1113G BCM957711A1102G Broadcom Corporation 190 Mathilda Place Sunnyvale, California 94086 USA This device complies with Part 15 of the FCC Rules. Operations is subject to the following two conditions: 1) This device may not cause harmful interference, and 2) This device must accept any interference received, including interference that may cause undesired operation.
  • Page 198: Vcci Class A Statement (Japan)

    Regulatory Information: Broadcom NetXtreme II Network Adapter User Guide Class A Broadcom NetXtreme II Gigabit Ethernet Controller BCM95709A0916G Broadcom NetXtreme II 10 Gigabit Ethernet Controller BCM957710A1022G BCM957710A1021G BCM957711A1113G BCM957711A1102G Broadcom Corporation 190 Mathilda Place Sunnyvale, California 94086 USA This equipment is a Class A product based on the standard of the Voluntary Control Council for interference by Information Technology Equipment (VCCI).
  • Page 199 Regulatory Information: Broadcom NetXtreme II Network Adapter User Guide file:///T|/htdocs/NETWORK/BroadCom/71921/NetXtremeII/en/regs.htm[9/26/2012 3:30:12 PM]...
  • Page 200 Regulatory Information: Broadcom NetXtreme II Network Adapter User Guide file:///T|/htdocs/NETWORK/BroadCom/71921/NetXtremeII/en/regs.htm[9/26/2012 3:30:12 PM]...
  • Page 201 Regulatory Information: Broadcom NetXtreme II Network Adapter User Guide file:///T|/htdocs/NETWORK/BroadCom/71921/NetXtremeII/en/regs.htm[9/26/2012 3:30:12 PM]...
  • Page 202 Regulatory Information: Broadcom NetXtreme II Network Adapter User Guide file:///T|/htdocs/NETWORK/BroadCom/71921/NetXtremeII/en/regs.htm[9/26/2012 3:30:12 PM]...
  • Page 203: Canadian Regulatory Information (Canada Only)

    Regulatory Information: Broadcom NetXtreme II Network Adapter User Guide Canadian Regulatory Information (Canada Only) Industry Canada, Class B Broadcom NetXtreme II Gigabit Ethernet Controller BCM95708A0804F BCM95709A0907G BCM95709A0906G Broadcom Corporation 190 Mathilda Place Sunnyvale, California 94086 USA This Class B digital apparatus complies with Canadian ICES-003. Notice: The Industry Canada regulations provide that changes or modifications not expressly approved by Broadcom could void your authority to operate this equipment.
  • Page 204: Industry Canada, Classe B

    Regulatory Information: Broadcom NetXtreme II Network Adapter User Guide Sunnyvale, California 94086 USA This Class A digital apparatus complies with Canadian ICES-003. Notice: The Industry Canada regulations provide that changes or modifications not expressly approved by Broadcom could void your authority to operate this equipment. Industry Canada, classe B Broadcom NetXtreme II Gigabit Ethernet Controller BCM95708A0804F...
  • Page 205: A Class Device

    Regulatory Information: Broadcom NetXtreme II Network Adapter User Guide BCM95709A0906G Broadcom Corporation 190 Mathilda Place Sunnyvale, California 94086 USA Note that this device has been approved for non-business purposes and may be used in any environment, including residential areas. A Class Device Broadcom NetXtreme II Gigabit Ethernet Controller BCM95709A0916G Broadcom NetXtreme II 10 Gigabit Ethernet Controller...
  • Page 206 Regulatory Information: Broadcom NetXtreme II Network Adapter User Guide BSMI file:///T|/htdocs/NETWORK/BroadCom/71921/NetXtremeII/en/regs.htm[9/26/2012 3:30:12 PM]...
  • Page 207 Certifications for BCM95709SA0908G, BCM957710A1023G, E02D001, and BCM957711A1123G (E03D001) This section is included on behalf of Dell, and Broadcom is not responsible for the validity or accuracy of the information. The BCM95709SA0908G Broadcom NetXtreme II Gigabit Ethernet Controller and the BCM957710A1023G, E02D001, and...
  • Page 208 Plug the system into a different outlet so that the system and receiver are on different branch circuits. Do not make mechanical or electrical modifications to the equipment. NOTE: If the device is changed or modified without permission of Dell Inc., the user may void his or her authority to operate the equipment.
  • Page 209 Broadcom NetXtreme II Gigabit Ethernet Controller BCM95709SA0908G Broadcom NetXtreme II 10 Gigabit Ethernet Controller BCM957710A1023G BCM957711A1123G (E03D001) E02D001 Dell Inc. Worldwide Regulatory Compliance, Engineering and Environmental Affairs One Dell Way PS4-30 Round Rock, Texas 78682, USA 512-338-4400 file:///T|/htdocs/NETWORK/BroadCom/71921/NetXtremeII/en/regs.htm[9/26/2012 3:30:12 PM]...
  • Page 210 Regulatory Information: Broadcom NetXtreme II Network Adapter User Guide file:///T|/htdocs/NETWORK/BroadCom/71921/NetXtremeII/en/regs.htm[9/26/2012 3:30:12 PM]...
  • Page 211 Regulatory Information: Broadcom NetXtreme II Network Adapter User Guide file:///T|/htdocs/NETWORK/BroadCom/71921/NetXtremeII/en/regs.htm[9/26/2012 3:30:12 PM]...
  • Page 212 Regulatory Information: Broadcom NetXtreme II Network Adapter User Guide file:///T|/htdocs/NETWORK/BroadCom/71921/NetXtremeII/en/regs.htm[9/26/2012 3:30:12 PM]...
  • Page 213 Round Rock, Texas 78682, USA 512-338-4400 This Class A digital apparatus complies with Canadian ICES-003. Notice: The Industry Canada regulations provide that changes or modifications not expressly approved by Dell Inc. could void your authority to operate this equipment. Industry Canada, classe A...
  • Page 214 Avis : Dans le cadre des réglementations d'Industry Canada, vos droits d'utilisation de cet équipement peuvent être annulés si des changements ou modifications non expressément approuvés par Dell Inc. y sont apportés. Korea Communications Commission (KCC) Notice (Republic of Korea Only)
  • Page 215 Regulatory Information: Broadcom NetXtreme II Network Adapter User Guide End of Dell-provided certification information. The remainder of this document conforms to the general Restrictions and Disclaimers listed at the beginning of this user guide. Please read all Restrictions and Disclaimers.
  • Page 216: Hardware Diagnostics

    Troubleshooting: Broadcom NetXtreme II Network Adapter User Guide Back to Contents Page Troubleshooting: Broadcom NetXtreme II Network Adapter User Guide Hardware Diagnostics Checking Port LEDs Troubleshooting Checklist Checking if Current Drivers are Loaded Running a Cable Length Test Testing Network Connectivity Microsoft Virtualization with Hyper-V Removing the Broadcom NetXtreme II Device Drivers Upgrading Windows Operating Systems...
  • Page 217: Checking Port Leds

    Troubleshooting: Broadcom NetXtreme II Network Adapter User Guide 5. Remove and re-install the diagnostic software. 6. Contact your hardware vendor. BACS Network Test Failures Typically, the BACS Testing the Network failures are the result of a configuration problem on the network or with the IP addresses.
  • Page 218: Running A Cable Length Test

    Troubleshooting: Broadcom NetXtreme II Network Adapter User Guide Broadcom NetXtreme II Gigabit Ethernet Adapter Version: Hardware Setting: Node Address: Frame Type: Board Name: LAN Protocol: ARP (see note) LAN Protocol: IP Addr: (see note) NOTE: The LAN protocol status is displayed after an IP address is assigned to the adapter. Linux To verify that the bnx2.o driver is loaded properly, run: lsmod...
  • Page 219: Microsoft Virtualization With Hyper-V

    Troubleshooting: Broadcom NetXtreme II Network Adapter User Guide Ping an IP host on the network to verify connection has been established. From the command line, type ping IP address, and then press ENTER. The ping statistics that are displayed indicate whether or not the network connection is working. Microsoft Virtualization with Hyper-V Microsoft Virtualization is a hypervisor virtualization system for Windows Server 2008 and Windows Server 2008 R2.
  • Page 220: Windows Server 2008 R2

    Troubleshooting: Broadcom NetXtreme II Network Adapter User Guide LSO as an offload capability in BACS; however, CO and LSO will not work. This is a limitation of Hyper-V. Hyper-V does not support CO and LSO in an IPv6 network. Windows Server 2008 R2 When configuring a NetXtreme II network adapter on a Hyper-V system, be aware of the following: An adapter that is to be bound to a virtual network should not be configured for VLAN tagging through the driver's advanced properties.
  • Page 221: Removing The Broadcom Netxtreme Ii Device Drivers

    Troubleshooting: Broadcom NetXtreme II Network Adapter User Guide Create a team only with an adapter that is not already assigned to a Hyper-V virtual network. A TOE-enabled team that is bound to a Hyper-V virtual network will report TOE as an offload capability in BACS; however, TOE will not work.
  • Page 222: Broadcom Advanced Server Program (Basp)

    Troubleshooting: Broadcom NetXtreme II Network Adapter User Guide is enabled on the port to which the PXE client is connected. For instance, set spantree portfast 4/12 enable. Broadcom Advanced Server Program (BASP) Problem: After deleting a team that uses IPv6 addresses and then re-creating the team, the IPv6 addresses from the old team are used for the re-created team.
  • Page 223 Troubleshooting: Broadcom NetXtreme II Network Adapter User Guide Problem: Routing does not work for NetXtreme II 10 GbE network adapters installed in Linux systems. Solution: For NetXtreme II 10 GbE network adapters installed in systems with Linux kernels older than 2.6.26, disable TPA with either ethtool (if available) or with the driver parameter (see disable_tpa).
  • Page 224 Solution: The network adapter has shut down and an error message appears indicating that the fan on the network adapter has failed. Problem: The network adapter was shut down to prevent permanent damage. Contact Dell Support for assistance. Please read all Restrictions and Disclaimers.

This manual is also suitable for:

Broadcom netxtreme ii

Table of Contents