Dell MCQH29-XDR manual

www .mellanox.com Dell and the Dell logo are trademarks of Dell Inc. ConnectX ® -2 Dual Port I/O Card for Dell C6100 User Manual MCQH29-XDR Rev 1.0[...]

Mellanox T echnologies 350 Oakmead Parkwa y Suite 1 00 Sunnyvale, CA 94085 U.S.A. www .mellanox.com T el: (408) 970-3400 Fax: (408) 970-34 03 Mellanox T echnologies, Ltd. PO Box 586 Hermon Building Y okneam 20692 Israel T el: +972-4-909-7200 Fax: +972-4-959-3245 © Copyright 2010. Mellanox Technologi es, Inc. All Ri ghts Reserved. Mellanox®, Conne[...]

ConnectX®-2 Dual Port VPI I/O Card for Dell C6100 Rev 1.0 Mellanox Technologies 3 Table of Contents Chapter 1 Overview 8 1.1 I/O Card 8 1.2 Finding the GUID/MAC and Serial Number on the Adapter Cards 9 Chapter 2 I/O Card Interfaces 10 2.1 I/O Interfaces 10 2.1.1 InfiniBan d Interface 10 2.1.2 Ethernet Interface 10 2.2 LED Assignment 11 2.3 PCI Exp[...]

Rev 1.0 Mellanox Technologies 4 List of Figures Figure 1: Card Product Labels 9 Figure 2: PCI Connection 10 Figure 3: Front Panel 11 Figure 4: Flash Jumper 12 Figure 5: Installation Kit Parts 16 Figure 6: Removing Fro m the Server 17 Figure 7: Top View 17 Figure 8: Install the Plas tic Leg onto the Board 18 Figure 9: Installing the Connector Board [...]

ConnectX®-2 Dual Port VPI I/O Card for Dell C6100 Rev 1.0 Mellanox Technologies 5 List of Tables Table 1: Revision History Table 6 Table 2: Documents List 7 Table 3: ConnectX-2 I/O Card Details 8 Table 4: VPI Support 10 Table 5: Jumper Configuration 12 Table 6: MCQH29-XDR VPD 12 Table 7: Hardware and So ftware Requirements 15 Table 8: ConnectX® D[...]

Rev 1.0 Mellanox Technologies 6 Revision History This document was first printed on 5/6/10. T able 1 - Revision History T able Date Rev Comments/Changes April 2010 1.0 Initial release[...]

ConnectX®-2 Dual Port VPI I/O Card for Dell C6100 Rev 1.0 Mellanox Technologies 7 About this Manual This User Manual describes ConnectX-2 Dual Port VP I I/O cards for the Dell C6100 chassis. It provides details as to the inte rfaces of the board, specifications , required software and firmware for operating the cards, in stallation instructions, a[...]

Overview Rev 1.0 Mellanox Technologies 8 1 Overview This document is a User Manual for the Mellanox Conn ectX-2 20 and 40 Gb/s InfiniBand / 10GigE Ethernet dual port QSFP I/ O cards for the Dell C6100 chassis. The cards describ ed in this manu al have the following main features: •1 μ s MPI ping latency • Selectable 10, 20, or 40Gb/s InfiniBan[...]

ConnectX®-2 Dual Port VPI I/O Card for Dell C6100 Rev 1.0 Mellanox Technologies 9 1.2 Finding the GUID/MAC and Serial Number on the Adapter Cards All cards have a label on the printed side of the ca rd that has the card serial number , the card MAC for Ethernet protocol, and the card GUID for In finiBand protocol. VPI Cards have both a MAC and a G[...]

I/O Card Interf aces Rev 1.0 Mellanox Technologies 10 2 I/O Card Interfaces Figure 2: PCI Connect ion 2.1 I/O Interfaces The ConnectX-2 I/O card is VPI-capab le, supporting InfiniBand or Ethernet on either port. The following table shows the supported co nfigurations. T able 4 - VPI Support 2.1.1 InfiniBand Interface The ConnectX -2 VPI adapter ca [...]

ConnectX®-2 Dual Port VPI I/O Card for Dell C6100 Rev 1.0 Mellanox Technologies 11 2.2 LED Assignment 2.3 PCI Express Interface The I/O card attaches to the blade's PCI Express interface through a press fit connector . The PCI Express x8 interface is version 2.0 compliant an d compatible with base 1. 1 chipsets. The device can be either a mas[...]

I/O Card Interf aces Rev 1.0 Mellanox Technologies 12 2.4.2 EEPROM The I/O card incorporates an EEPROM that is acc essi ble through the I2C- compatible interface. The EEPROM is used for storing the V ital Produc t Data (VPD). The VPD format adheres to the PCI Local Bus Specification Rev 2.3 VPD definition. The EEPROM capacity is 4Kb. 2.4.3 Flash Th[...]

ConnectX®-2 Dual Port VPI I/O Card for Dell C6100 Rev 1.0 Mellanox Technologies 13 36 Data ”A00” 39 VPD Keyword “SN” Alphanumeric Serial Number 41 Length 0x14 42 Data “OO059MP7MM MMMYMDSS SS ” according to the board label 62 VPD Keyword “V0” Misc Information 64 Length 0x16 65 Data "DELL PE C6100 MEZZ IB QDR" 87 VPD Keywor[...]

Driver Software and Firmware Rev 1.0 Mellanox Technologies 14 3 Driver Sof tware and Firmware 3.1 Driver Sof tware 3.1.1 Linux For Linux, download and install the latest Open Fabrics Enterprise Distribution (OFED) software package available via the Mellanox W eb site at: http://www .mellanox.com => Dow nloads => InfiniBand/VPI SW /Drivers. Fo[...]

ConnectX®-2 Dual Port VPI I/O Card for Dell C6100 Rev 1.0 Mellanox Technologies 15 4 I/O Card Inst allation 4.1 Hardware and Sof tware Requirements Before installing the VPI I/O card, please make sure that the system meets the hardware and soft- ware requirements listed in T able 8, “H ardw are and Software Requirements”. 4.2 Inst allation Kit[...]

I/O Card Installation Rev 1.0 Mellanox Technologies 16 The kit includes: Figure 5: Installation Kit Parts 4.3 Inst allation Instructions Remove the server from the chassis. 1. Connect an ESD strap to y our wrist and to a valid ESD ground. 2. Push the latch and pull on the handle. T able 9 - C onnectX® Dual-Port In finiBand I /O Card Inst allation [...]

ConnectX®-2 Dual Port VPI I/O Card for Dell C6100 Rev 1.0 Mellanox Technologies 17 Figure 6: Removing Fr om the Server 3. Remove the serv er and place on a work benc h. 4. Above the handle are screws holding on the faceplate. 5. Remove these screws and discard. 6. Remove the two screws on the top side of the server and discard. Figure 7: Top V ie [...]

I/O Card Installation Rev 1.0 Mellanox Technologies 18 Figure 8: Install the Plastic Leg onto the Board 9. Push the Connector board into the card. The co nnector board must be installed as seen in Figure 9 , directed toward the back of the server . Figure 9: Instal ling the Connector Board into the HCA Card 10. Put the card into place in the server[...]

ConnectX®-2 Dual Port VPI I/O Card for Dell C6100 Rev 1.0 Mellanox Technologies 19 12. Screw in three panhead sc rews into the front panel. Figure 1 1: Front Panel 13. Screw in two flathead screws on th e top of the server into the HCA card. Figure 12: T op V iew 14. Slide the server in the chassis. 4.4 Safety W arnings 1. Installation Instruction[...]

I/O Card Installation Rev 1.0 Mellanox Technologies 20 2. Over T emperature 3. Lightening – Electrical Hazard 4. Installation of Equipment 5. Disposal of Equipment 6. Compliance with Local and National Codes This equipment should not be operated in an area with an ambient te mperature exceeding the maximum recommended: 55°C (1 31 °F ). T o guar[...]

ConnectX®-2 Dual Port VPI I/O Card for Dell C6100 Rev 1.0 Mellanox Technologies 21 5 Cables and Modules These cards support passive copper cables a nd active optical cables, both dire ct attach and through a transceiver module, at up to QDR data rates. See www .mellanox.com => Products => Cables fo r cable type, model, module, and length rec[...]

Cables and Modules Rev 1.0 Mellanox Technologies 22 Figure 13: Connecto r Orientation 5.1.2 Removing a Cable from the Card 1. Pull on the latch release mechanism thereby un latching the co nnector and pull the connector out of the cage. 2. Do not apply torqu e to the connec tor when removing it from the card. 3. Remove any cable supports that were [...]

ConnectX®-2 Dual Port VPI I/O Card for Dell C6100 Rev 1.0 Mellanox Technologies 23 Appendix A: Specifications A.1 Board Mechanical Drawing and Dimensions The ConnectX-2 I/O card mechanical drawing is depicted in Figure 14. Figure 14: Mechanical Drawing Note: All dimensions are in millimeters. J1 is the flash jumper . J2 is the I2C Connector . J2 J[...]

Rev 1.0 Mellanox Technologies 24 A.2 EMC Certification S tatements A.2.1 FCC S tatements (USA) Class A S tatements: § 15.21 Statement Warning! Changes or modifications to this equi pment not expressly approved by the party responsible for compliance (Mellanox T echnologies ) could void the user's authority to oper ate the equipment. §15.105([...]

ConnectX®-2 Dual Port VPI I/O Card for Dell C6100 Rev 1.0 Mellanox Technologies 25 (T ranslation - "This is a Class A product based on the standard of the V oluntary Control Council for Interference by Information T echnology Equi pment (VCCI). If this equipment is used in a domestic environment, radio interference may occur , in which case t[...]

Rev 1.0 Mellanox Technologies 26 A.3 Specifications T able 10 - ConnectX-2 MCQH29-XDR Specifications Physical Power and Envir onmental Size: Air Flow: QSFP 40Gb/s Connector: 79.30mm X 1 1 1.90 mm 200LFM @55°C InfiniBand (Copper and optical) Max power per port 3.5 W . V oltage: Ty p P o w e r : Maximum Power: T emperature: 12V , 3.3V 8.74W Passive [...]

ConnectX®-2 Dual Port VPI I/O Card for Dell C6100 Rev 1.0 Mellanox Technologies 27 Appendix B: QSFP Interface GND Rx2n GND 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 Rx1n Rx2p Rx1p GND GND GND GND GND GND Tx2n Tx1n Tx2p Tx1p Tx4n Tx3n Tx4p Tx3p GND GND Rx4n Rx3n Rx4p Rx3p GND GND SDA SC[...]

Rev 1.0 Mellanox Technologies 28 Figure 15: QSF P Connector Male and Fema le V i ews 18.35 8.50 Top ResetL SDA SCL ModSelL RX3p TX2n GND VccRx 1 2 3 4 5 6 7 8 9 1 0 1 2 3 4 5 6 7 8 9 TX2p GND TX4n TX4p GND 1 1 1 1 1 1 1 1 1 1 20 GND GND GND RX3n RX1p RX1n 30 1 2 3 4 5 6 7 8 9 2 2 2 2 2 2 2 2 2 1 2 3 4 5 6 7 8 3 3 3 3 3 3 3 3 RX4p GND GND GND RX4n R[...]

ConnectX®-2 Dual Port VPI I/O Card for Dell C6100 Rev 1.0 Mellanox Technologies 29 Appendix C: A vertissement s de sécurité d’inst alla - tion (French) 1. Instructions d’installation 2. T empérature excessive 3. Orages – dangers électr ique s 4. Installation du matériel 5. Elimination du matériel 6. Codes électriques locaux et nationa[...]

Rev 1.0 Mellanox Technologies 30 Appendix D: Inst allation - Sicherheit shinweise (German) 1. Installationsanleitungen 2. Übertemperatur 3. Bei Gewitter - Elektrische Gefahr 4. Geräteinstallation 5. Geräteentsorgung 6. Regionale und nationale elektrische Bestimmungen Lesen Sie alle Installation sanleitungen, bevor Sie das Gerät an die S tromve [...]