Force10 Networks CC-C-BLNK-LC manual

Dell Force10 MXL 10/40GbE Switch IO Module Getting Started Guide June 2012 Regulatory Model: DF10MXL[...]

Notes, Cautions, and W arnings NOTE: A NOTE indicates important information that helps you make b etter use of your device. CAUTION: A CAUTION indicates potential damage to hardware or loss of data if instructions are not followed. WAR NI NG : A WARNING indicates a potential for property damage, personal injury , or death. ______________ ______ Inf[...]

Contents 3 Contents 1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . 5 2 Product Description . . . . . . . . . . . . . . . . . 5 3 Hardware Overview . . . . . . . . . . . . . . . . . . 6 Internal Port s . . . . . . . . . . . . . . . . . . . . . . . . 6 Front Panel . . . . . . . . . . . . . . . . . . . . . . . . . 6 Base Module . . . .[...]

4 Contents Invoking the X-Loader and U-Boot CLIs . . . . . . . . . 19 Performing the Init ial Configuration . . . . . . . . . . . 19 5 Assembling a Switch Stack . . . . . . . . . . 25 Configuring and Bringing Up a Stack . . . . . . . . . . 26 Managing a Stack . . . . . . . . . . . . . . . . . . . . 28 6 Splitting 40GbE QSFP+ Ports into 10GbE SFP+ P[...]

Introduction 5 Introduction This document provides basic inform ation about the Dell F orce10 MXL 10/40GbE Switch IO Module, including ho w to install the switch in the Dell P owerEd ge M1000e Enclosure and pe rform the initial config uration. F or more detailed information about a ny of the basic installation s teps , r efer to the Dell P owerEdge[...]

6 Hardware Overview Hardware Overview This section contains info rmation about device chara cteristics and modular ha rdw are c on fi gu ra tio ns fo r th e M XL 10/ 40 Gb E S wit ch . Internal Ports The MXL 10/40GbE Swit ch provides 32 1/10-Gigabit Ethernet internal ports. The internal ports ar e conn ected to server blades th rough the M1000e cha[...]

Hardware Overview 7 Base Module The MXL 10/40GbE Switch provides two nati ve 40-Gigabit Ethernet fixed ports on the base module f or uplink connections. Y ou can use these p orts with 4x10G break out cables to operate as 10GbE uplink ports. In addition, you can configur e the native 40GbE ports as stacking ports. Y ou can connect up to six MX L 10/[...]

8 Hardware Overview Then save the con figuration and reload the switch. FTOS# write memory FTOS# reload Figure 1-2. MXL 10/40GbE Switch: Plug-in Modules NOTE: Y ou can only ho t-swap plug-in modules of the same type without requiring a reboot. For example, you can replace a 2-Port 40GbE QSFP+ module only with another 2-Port 40GbE QSFP+ mo dule. On [...]

Hardware Overview 9 Port Numbering When installed in a P owerEdge M10 00e Enclosur e, the MXL 10/40GbE Switch ports are number ed 33 to 56 from the bottom to the top of the switch: • 40GbE base-module ports: • In 40GbE mode of operation, th e ports ar e numbered 33 and 37. • In 4x10GbE mode of operation, the ports are number ed 33 to 36 and 3[...]

10 Hardware Overview USB Ports Figure 1-3. USB Ports on Front Panel Use the lower USB console port to co nfigur e the switch through an RS-232 serial interface (F igur e 1-3). This po rt provides a dir ect connection to the switch and allows you to access the command line interface (CLI) from a console terminal connected to the port through the pro[...]

Hardware Overview 11 System and Port LEDs The front panel of the MXL 10/40GbE Sw itch contains ligh t emitting diodes (LEDs) that provide information about the status of the switch (F igure 1-4). Figure 1-4. System LEDs on Front Panel T able 1-1 describes system LED condition s. T able 1- 1. System LEDs System LED Color Meaning Po w e r Green P owe[...]

12 Hardware Overview Each plug-in module also contains LE Ds that provide information about the link status and traffic acti vity on a port (F igure 1-5). Figure 1-5. Port LEDs on Modules T able 1-2 describes the LED status of the 10GbE BASE- T , 10GbE SFP+, and 40GbE QSFP+ ports. T able 1 -2. Port LED Status Port LED Color Meaning Link Status Off [...]

Hardware Overview 13 T able 1-3 describes the LED status of a 40GbE QSFP+ port that is split into four 10GbE SFP+ ports using a 4x10G break out cable . Installation Site Preparation Before inst alling the switch or switches, mak e sure that the chosen installation location meets th e following site r equirements: • Clearance — There is adequate[...]

14 Installing and Configuring the Switch Unpacking the Switch Package Contents When unpacking each switch, make sur e that the following items ar e included: • O ne Dell F orce10 MXL 10/40GbE Switch IO Module • O ne USB type A-to-DB-9 female cable • Getting Started Guide • Safety and Regulatory Information • W arranty and Support Infor ma[...]

Installing and Configuring the Switch 15 Figure 1-6. MXL 10/40GbE Switch: Inst allation and Configuration Flow Cha rt Insert Switch Blade and Power On Connect Console Load Image from Flash to RAM X-Loader CLI Run Memory Tests/ Configure Switch Settings Reboot Yes Enter Wizard? Yes No No Do not press a key Jumpstart waits for DHCP Offer with FTOS Im[...]

16 Installing and Configuring the Switch Installing the Switch Blade in a PowerEdge M1000e After you unpack the switch blade, slide it into one of the open I/O module slots in the back of a P owerEdge M1000e. The M1000e is a 10U rack-mountable blade chassis that holds: • S erver blades: Eight full -height or 16 half -height, or 32 quarter -height[...]

Installing and Configuring the Switch 17 Figure 1-8. PowerEdge M1000e: Back View with Six MXL 10/40GbE Switch Blades After you slide the MXL 10/40GbE Switch in so that the connectors on the back of the blade touch the chassis midp lane, the switch receives power f rom the chassis and autom atically powers on . The chassis manage ment controller (CM[...]

18 Installing and Configuring the Switch Connecting a Console T erminal After the MXL 10/40GbE Switch powers on, complete all e xternal cabling connections and connect a terminal to the blade to configure the switch. NOTE: If you are installing a stack of MXL 10/40GbE Switches , connect the terminal to the console port on the Master Switch. If you [...]

Installing and Configuring the Switch 19 Connect the USB connector on the cable directly to the switch console port. The console port on the MXL 10/40GbE Switch is located below the fix ed 40GbE ports (F igure 1-3). Invoking the X-Loader and U-Boot CLIs During the boot process, you can pe rform various config uration tasks by accessing the X -Loade[...]

20 Installing and Configuring the Switch Before you start, t o perform the initial switch config uration, you must obtain the following information from your network administrator : • T he IP addr ess to be assigned to the out-of -band (OOB) interface for device management. • T he IP subnet mask for the OOB interface. • T he IP addr ess of th[...]

Installing and Configuring the Switch 21 Sample Setup Wizard Session This section describes an Easy S etup W iz ar d session. The following values ar e used in the e xample session: •S N M P i s e n a b l e d . • The default user na me "root" and password "calvin" are used. The W izard does not display the password as it is [...]

22 Installing and Configuring the Switch . set up the initial SNMP version 2 account now. . return later and set up other SNMP accounts. (For more information on setting up an SNMP version 1 or 3 account, see the user documentation). Would you like to set up the SNMP management interface now? [Y/N] y To set up the SNMP management account you must s[...]

Installing and Configuring the Switch 23 Next, IP addresses are set up on the OOB (Out-Of-Band) Interface and/or the VLAN1 routing interface. You can use these IP addresses to acces s the CLI, Web interface, or SNMP interface of the switch. To access the switch through any Management Interface you can . set up the IP address for the Management Inte[...]

24 Installing and Configuring the Switch This is the configuration information that has been collected: SNMP Interface = "mxl1"@1.1.1.1 User Account setup = root Password = ****** Out-of-band IP address = 192.168.2.1 255.255.255.0 VLAN1 Router Interface IP = 2.2.2.80 255.255.255.0 Default Gateway = 192.168.2.0 If the information is correc[...]

Assembling a Switch Stack 25 Assembling a Switch Stack After you complete the initial switch configu ration, th e MXL 10/4 0GbE Switch is power ed up and operational. Stacking is supported on the 40GbE ports on the base module or a 2-P o rt 40GbE QSFP+ m odule to connect up to six MXL 10/40GbE Swit ches in a si ngle stack. F igur e 1-9 shows an e x[...]

26 Assembling a Switch Stack Use only QSFP transceivers and QSF P cables (s eparately purchased) to connect stacking ports as follows: 1 Insert a QSFP cable in the bottom stac king port on the rightmost switch. 2 Connect the upper stacking port on the next switch to the left. 3 Continue connecting each sw itch to the next in this way until you reac[...]

Assembling a Switch Stack 27 lower 40GbE base-module port and stack-group 1 defines the stack group for the upper 40GbE base-m odule port. T o display the ports in each stack group, enter the show system stack-unit unit-number stack-group command. 2 Save the stacking config uration on the 40GbE ports: FTOS# write memory 3 Repeat Steps 1 and 2 on ea[...]

28 Assembling a Switch Stack management if the Master Switch fails. For example: FTOS> enable FTOS# configure FTOS(conf)# stack-unit 0 priority 14 The no form of the stack-unit unit-number priority number command reverts the management priority of a stack unit to the default value of 0. Managing a Stack Master and Member Swi tches Y ou can manag[...]

Assembling a Switch Stack 29 Auto Stack Number Assignment During the stack formation process, a uni que stack-unit number is assigned if the same number is assigned to more than one switch. After assignm ent is complete, each switch saves its stac k-unit number . T o view stack-unit numbers, enter the show system command. FTOS V ersion Checking F o[...]

30 Splitting 40GbE QSFP+ Port s into 10GbE SFP+ Ports upgrading all switches in the stack, save the configuration (using the write memory command) and reload the stack to activat e the new FTOS version (using the reload command). System Initialization The Master Switch initializes the stack using the last saved syste m configuration file. If you ch[...]

Switch Configuration 31 stack-unit unit-number : Enter the number of the stack unit t o be res et. Range: 0-5. T o d isplay the stack-unit number , enter the show system brief command. port port-num ber : Enter the port number of the 40GbE QSFP+ port to be split. V alid values on base module: 33 or 37; slot 0: 41 or 45; slot 1: 49 or 53. portmode q[...]

32 Switch Configuration DCB Support DCB enhancements for data center ne tworks ar e supported to eliminate packet loss and provision links with requir ed bandwidth. On the MXL 10/40GbE Switch, you must manually configur e DCBX port roles to enable the switch to auto-configure its DCB settings to match the DCB configuration in the T oR switches to w[...]

Next Steps 33 Next Steps If you installed the MXL 10/40GbE Switch in a stack, you can configure additional settings for switch stacking. F or information about how to cr eate diffe rent stacking scenarios, r efer to the Ethernet Stacking white paper on the Dell Support and Dell Networking White P apers websites at: http://suppo rt.dell.com/manuals [...]

34 T echnical Specifications T echnical Specifications The MXL 10/40GbE Switch is an I/O modu le and installed with Server (model: P o werEdge M1000e) for communication. The product should be operated at an amb ient temperature of 50°C. CAUTION: Lithium Battery Caution: There is a danger of explosion if the battery is incorrectly replaced. Replace[...]

T echnical Specifications 35 Power Requirements IEEE Standards The MXL 10/40GbE Switch complies with the following IEEE standards: • 802.1AB LLDP • 802.1ag Connectivity fault Management • 802.1D Bridging, STP • 802.1p L2 P rioritization • 802.1Q VLAN T agging, Double VLAN T agging, GVRP • 802.1s MSTP • 802.1w RSTP • 802.3ab Gigabit [...]

36 T echnical Specifications[...]

[...]

www .dell.com | support.dell .com Printed in the U.S.A.[...]