Cisco Systems SFS 7008 manual

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108

Go to page of

A good user manual

The rules should oblige the seller to give the purchaser an operating instrucion of Cisco Systems SFS 7008, along with an item. The lack of an instruction or false information given to customer shall constitute grounds to apply for a complaint because of nonconformity of goods with the contract. In accordance with the law, a customer can receive an instruction in non-paper form; lately graphic and electronic forms of the manuals, as well as instructional videos have been majorly used. A necessary precondition for this is the unmistakable, legible character of an instruction.

What is an instruction?

The term originates from the Latin word „instructio”, which means organizing. Therefore, in an instruction of Cisco Systems SFS 7008 one could find a process description. An instruction's purpose is to teach, to ease the start-up and an item's use or performance of certain activities. An instruction is a compilation of information about an item/a service, it is a clue.

Unfortunately, only a few customers devote their time to read an instruction of Cisco Systems SFS 7008. A good user manual introduces us to a number of additional functionalities of the purchased item, and also helps us to avoid the formation of most of the defects.

What should a perfect user manual contain?

First and foremost, an user manual of Cisco Systems SFS 7008 should contain:
- informations concerning technical data of Cisco Systems SFS 7008
- name of the manufacturer and a year of construction of the Cisco Systems SFS 7008 item
- rules of operation, control and maintenance of the Cisco Systems SFS 7008 item
- safety signs and mark certificates which confirm compatibility with appropriate standards

Why don't we read the manuals?

Usually it results from the lack of time and certainty about functionalities of purchased items. Unfortunately, networking and start-up of Cisco Systems SFS 7008 alone are not enough. An instruction contains a number of clues concerning respective functionalities, safety rules, maintenance methods (what means should be used), eventual defects of Cisco Systems SFS 7008, and methods of problem resolution. Eventually, when one still can't find the answer to his problems, he will be directed to the Cisco Systems service. Lately animated manuals and instructional videos are quite popular among customers. These kinds of user manuals are effective; they assure that a customer will familiarize himself with the whole material, and won't skip complicated, technical information of Cisco Systems SFS 7008.

Why one should read the manuals?

It is mostly in the manuals where we will find the details concerning construction and possibility of the Cisco Systems SFS 7008 item, and its use of respective accessory, as well as information concerning all the functions and facilities.

After a successful purchase of an item one should find a moment and get to know with every part of an instruction. Currently the manuals are carefully prearranged and translated, so they could be fully understood by its users. The manuals will serve as an informational aid.

Table of contents for the manual

  • Page 1

    Part N u m ber: OL-7725-01 Cisco SFS 7008 InfiniBand Server Switch Hardware Guide ( Topspin 270 Hardware Guide) Release 2.2.0 Update 1 Product ID: 140265[...]

  • Page 2

    Copyright © 2 004 - 2005 T opspin Communi cations, Inc. All rights reserved. The T opspin Switched Computing Syst em, T opspin Host Channel Adapter, T opspin Element Manager, and collateral software programs and documentation are subject to and ma de available o nly pursuant to the license agreement signed by you and T opspin, Communication s, Inc[...]

  • Page 3

    iii Regulatory Notices ........................................ vii FCC Statement .................................................................................................................. ........................ vii Safety Inform ation ....... ................................................................................................[...]

  • Page 4

    iv Connect Management Devices ..................................................................................................... ............. 26 Attach a Serial Console Cable to a PC or Terminal ..................................................................... 26 Connect an Ethernet Cable to the Ethernet Manageme nt Port ...................[...]

  • Page 5

    v Upgrading a Topspin 270 with Element Manager ........................................................................ 54 Upgrading an Individua l Controller Card ........................................................................................ ..........56 Upgrading a Controller Card with the CLI ...........................................[...]

  • Page 6

    vi 7: Specifications and Compliance Certifications 103 Chassis and Management Interface ............................................................................................ 10 3 Electrical Spec ifications ...................................................................................................... ....... 104 EMC/Immunity .........[...]

  • Page 7

    vii Regulatory Notices FCC S t atement This equipment has been tested and found to comply wit h the limits for a Class A digital device, pursuant to Part 15 of the FCC Rules. Th ese limits are designed to provide reasonabl e protection against harmful interference when the equi pment is operated in a commerci al environment. This equipment generate[...]

  • Page 8

    viii CAUTION: Grounding is supplied by the gro und-prong on the 3-prong power cable. Do not attach a separate ground cable. Do not use adapter plugs. Do not remov e the ground prong from the cable. Ensure the ground connection on the power supply is correct and functioning before applying power to the T op spin system. CAUTION: Always ground yourse[...]

  • Page 9

    ix CAUTION: Never place your hand inside an empty card or module bay . Y ou should never have cause to place a hand anywhere inside the T opspin chassis. Unused card and module bays should always have a T opspi n cover over the bay to ensure proper safet y , ventilation, and cooling. General Cautions CAUTION: No user is authorized to remove the T o[...]

  • Page 10

    x[...]

  • Page 11

    11 1 Features Overview The T op spin 270 Switched Computing System provide s data center managers with a high-performan ce, low-latency interconnect. • “System Architecture” on page 1 1 . • “About the T opspin 270 Chassis” on page 13 . • “Administrative Features” on page 20 . System Architecture Hot S t andby On the T opspin 270, [...]

  • Page 12

    12 Example The oper code field of the command out put id entifies the controller card as the active card (normal) or the hot standb y card (standby). By d efault, when you power on a T opspin 270, the card in slot 1 1 becomes active and the card in slot 12 becomes the standby . The master and standby controllers automatically synchronize state and [...]

  • Page 13

    13 Fabric For redundancy , InfiniBand Host Channel Adapters (HCAs) can be dual-connected to a redund ant pair of T o pspin 270s. In an InfiniBand fabric that includes more th an one T opsp in 270: if the subnet manager on the T opspin 270 that is acting as the master fails, another su bnet man ager will take over within seconds. All necessary state[...]

  • Page 14

    14 Figure 1-2: Back Chassis V iew[...]

  • Page 15

    15 Chassis Slot Numbering Slot numbers are p rinted on the chassis for easy identificatio n. Figure 1-3: Chassis Slot Numbering in Fr ont (Non-port Side ) Power Supply ID 1 Power Supply ID 2 Fan ID 2 Slot # 9 Slot # 10 Slot # 1 1 Slot # 12 Slot # 13 Slot # 14 Fan ID 1[...]

  • Page 16

    16 Figure 1-4: Chassis Slot Numbering in Back (Service Side) Dimensions • Height : 6U unit • Wid t h : 17.04” • Depth : 8” - 23.7” • We i g h t : maximum 106 pounds (full chassis configurat ion with 4x copper Li ne Interface Modules) Connections • 96 ports of 10 Gbps 4X Copper InfiniBand. • T wo 10/100 Ethern et RJ-45 Management-E[...]

  • Page 17

    17 • The power supplies are 1U, 48V , 1200W • The supplies provide regulated +48V DC to all other modules in the system. • Each power supply has self contained fans for cooli ng. Fan T rays Refer to “Installing a Fan Module” on page 41 for installation instru ctions. The fan trays are redundant, hot-swappable cooling units. • Only one f[...]

  • Page 18

    18 Understanding the Core Slot to Mgmt Interface Module Connection Each Core slot in the chassis (refer to “The Core Slot” on page 18 ) is connected to 1 port on the Management Interface mo dule. The controller (fabri c interface module inserted in the core slot) selects the Management Interface module to which it will connect. The pairing of M[...]

  • Page 19

    19 • At least one Fabric Controller module must be inst alled in the Core slot for the chassis to boot. • When a module is installed in a Co re slot, it acts as either the master or standby controller for the chassis, with all modules in the system being slaves to the master controller . • The subnet manager runs on the fabri c module install[...]

  • Page 20

    20 Administrative Features Real-T ime Clock The T opspi n 270 maintains correct time regardless of power conditions or con nectivity . Latency The T opspi n 270 has port to port latency of less than 600ns. Non-V olatile Memory The memory supports up to: • three stored system images ( not including recovery imag e) • one week of log files at nor[...]

  • Page 21

    21 2 Inst alling the T op spin 270 System This chapter describes how to install and m anage the T op spin 270 system hardware. • “Prepare the Site” on page 21 • “Configure Basic Connectivity ” on page 28 • “Mount the T opspin 270 Chassis in a Rack” on page 22 • “Connect Network Dev ices” on page 30 • “Manage the System?[...]

  • Page 22

    22 Mount the T op spin 270 Chassis in a Rack This section describes how to install the T opspin 270 chassis in an equipment rack. The followi ng procedure is the standard installa tion, using your own rack shelf. T op spin also has an optional shelf that is appropriat e for pre-racking and shippi ng a unit in the rack. If you have purchased this sh[...]

  • Page 23

    23 4. Determine the direction that the sw itch will be inst alled and justified in the rack . The direction that the switch will be justified will determine which set of rack ears that need to be rem oved. 5. Use a #2 phillips screwdriver to remove one set of rack ears: • If you have determined that th e switch will be ju stified toward the front[...]

  • Page 24

    24 7. Use 2 - 3 people to lift the switch into the rack. Figure 2-3: Chassis Set onto Shelf 8. Push the chassis into the rack until the ra ck ear s are flush with rails. Figure 2-4: Rack Ears Flush with Rails[...]

  • Page 25

    25 9. Use screws that fit your rack to attach both rack ears to the rack rails. Figure 2-5: Use Appropriate Screws to Attach Rack Ears to Rails Inst all Optional HA Component s If you have purchased a High-A vailability (HA) package, install the follo wing components: • Redundant Power Supply . Refer to “Power Supply Modules” on page 35 . •[...]

  • Page 26

    26 Connect Management Devices T o connect the management ports, use either a serial cable and/or an Ethernet cable. Figure 2-6: Serial and Ether net Management Ports Att ach a Serial Console Cable to a PC or Te r m i n a l 1. Attach the RJ-45 consol e cables from the cable kit that is provided. See Figure 2-7 . a. Connect the cables to the InfiniBa[...]

  • Page 27

    27 Connect an Ethernet Cable to the Ethernet Management Port 3. Connect an Ethernet cable to the Ethernet port of the left Management Interface module (slot number 15). See Figure 2-7 . a. If you have two Management Interface modules, you may als o want to connect an Ethernet cable to the standby module (slot 16) t o maintain Ethernet connectivity [...]

  • Page 28

    28 5. Inspect the power cord and determin e if i t provides the proper plug and is appropriately certified for use with your electri cal system. Discard the cord if it is in appropriate for your national electrical system and obtain the proper cord, as required by your national electrical codes or ordinances. Grounding is supplied by the ground-pro[...]

  • Page 29

    29 Assigning an Address S t atically Refer to the static example below: a. When the system has completed booting, press < Enter > several times to display the CLI prompt. b. Enter the user name and password. The default u ser name is super , and t he default password is super . c. Enter the enable command. d. Enter the configure command. e. E[...]

  • Page 30

    30 b. Enter the user name and password. The default u ser name is super , and t he default password is super . c. Enter the enable command. d. Enter the configure command. e. Enter the interface mgmt-ethernet command. f. Enter the option dhcp command. The chosen method will be persisten t across module reboots. g. Enable the manageme nt port by en [...]

  • Page 31

    31 Connecting InfiniBand Devices Attaching the IB Cable to the IB Port T o conn ect using InfiniBand to other workstations or switches, standard 4X InfiniBand cabl es are required. InfiniBand cables can be used to connect an y two InfiniBan d devices, whether switch or host. 1. Plug InfiniBand cables into the InfiniBand swit ch ports. T o plug in a[...]

  • Page 32

    32 • Chassis Manager (GUI) - A web-based graphic user interface. • Element Manager (GUI) - An optio nally available graphic interface installed on a workstation, and accessible over IP . Refer to the InfiniBand User Guide , the CLI Reference Guide or the Chassis Manager User Guide for more information about managin g the InfiniBand systems. (Op[...]

  • Page 33

    33 2. T yp e the Management IP address of your Server Switch in the address field of your browser and press Enter . (Y ou configured the IP address in Ste p f. ) Figure 2-10: W eb Browser W indow A log-in window opens. Figure 2-11 displays the log-in window . Figure 2-1 1: Chassis Manager Log-In Window 3. Enter your Server Switch user name and pa s[...]

  • Page 34

    34 (Optional) Inst all th e Element Manager GUI For more information regarding th e Element Manager tasks, refer to the InfiniBand User Guide . 1. Check that you have sufficient system resources. Y o u will need: • 32 MB free RAM • 50 MB disk space + 50MB additional temporary space during installation • 300 Mhz processor • 800x600 screen re[...]

  • Page 35

    35 3 Managing Individual Component s This chapter describes how to install the Field Re placeable Units (FRUs) in the T opspin 270 system. About the Field Replaceable Unit s The following Field Replaceable Units (FRUs) are a part of the T opspin 270 chassis: • “Power Supply Modules” on page 35 • “Fan T r ay Modules” on page 39 • “Fa[...]

  • Page 36

    36 In most cases, vital information can be recovered fr om the failed module. If you have the appropriate support agreement, you may want to return the unit for diagnosis. Refer to “V ital Product Data Storage” on page 20 . Locating the Power Supply Module Both power supply units are l ocated on the front of th e chassis. When facing the front [...]

  • Page 37

    37 7. Pull the power cord from the chassis. Figure 3-1: Diagram of Power Supply to the Associate d Power Cord 8. Use a #1 phillips screwdriver to unscrew the fasteners that hold the power supply module in place. Figure 3-2: Loosening Captive Screws Power Cord (back) Power Supply (front)[...]

  • Page 38

    38 9. Use the handle to pull the power supply mo dule from the bay . Figure 3-3: Pulling the Power Supp ly Module from the Bay 10. Install the blanking panel in pl ace of the power supply module. The device should never be run without either a blanking panel or module in any bay , as overheating may occur . or Install a new Pow er Supply module. R [...]

  • Page 39

    39 7. Insert the new power supply unit into the open slot until it is fully seated. Y ou may need to push the unit with your thumbs to get it completely into the bay . Figure 3-4: Inserting Power Supply Module 8. Secure the captive screws wi th a #1 phillips screwd river . 9. Check the LEDs on the power supply to verify the status of the module. Re[...]

  • Page 40

    40 4. Use a #1 phillips screw driver to unscrew the captive screws. Figure 3-5: Loosening Captive Screws 5. Carefully begin to pull the fan tray 1” out of the bay . Do not pull the fan tray completely from the bay . CAUTION: The fan tray does not hav e guards over the blades. Y ou must wait until the fan b lades have stopped moving before complet[...]

  • Page 41

    41 or Install a new fan modul e. Refer to “Installing a Fan Module” on page 41 if you are installing a n ew fan module. Inst alling a Fan Module 1. Remove the new fan module from the package. 2. Ground yourself approp riately . 3. Remove the bezel cover from the front of th e switch, if you have not already done so. 4. Refer to “Removing a Fa[...]

  • Page 42

    42 9. Check the LEDs on the fan module to verify the status. Refer to “Fan LEDs” on page 69 . Fabric Controllers About the Fabric Controllers Refer to “Fabric Controller Modul es” on page 18 for more specifi c inform ation about t his module. About a Failed Fabric Controller If you believe a fabric co ntroller modul e has failed, contact te[...]

  • Page 43

    43 5. Use a #1 phillips screwdriv er to unscrew the captive screws from bo th ends of the Fabric Controller card. Figure 3-9: Loosen Ca ptive Screws Before Removing 6. Pull the levers on both sides of the card toward you. The card will be released. Figure 3-10: Opening Fabric C ard Levers 7. Use the levers to pull the card toward you and remove it [...]

  • Page 44

    44 Inst alling a Fabric Controller 1. Remove the new Fabric Controller module from the packag ing. 2. Ground yourself approp riately . 3. Remove the bezel cover , if you have not already done so. 4. Refer to “Removing a Fabric Controller” on page 42 , if a Fabric Controller module is still in stalled. 5. Remove the blanking panel, if no fabr ic[...]

  • Page 45

    45 Upgrade the Image with the CLI T o upgrade the image of the Controller card with the Command Line Interface, refer to “Upgrading a Controller Card with the CLI” on page 57 and the following document: • CLI Refer ence Guide Upgrade the Image with the Chassis Manager T o upgrade the system image with the Chassis Ma nager web GUI, refer to th[...]

  • Page 46

    46 3. Remove the InfiniBand cables from the ports. a. T o remove a cable with a pinch connector , pinc h both sides of the back of the connector and pull the connector aw ay from the port . Figure 3-12: Removing a Pinch-T ype Connector b. T o remo ve a cable with a pull connector, grasp the connector with one hand and push it toward the port, then [...]

  • Page 47

    47 4. Use a #1 phillips screwdriver to unscrew the captive screws on bot h sides of the LIM card. Figure 3-14: Loose n the Captive Screws 5. Release the LIM module by pulli ng both levers towa rd you, then to ward the outside of the chassi s. Figure 3-15: Relea sing the LIM Module Levers 6. Use the levers to pull the module from the bay . Figure 3-[...]

  • Page 48

    48 7. Install a blanking panel in pl ace of the LIM module, or refer to “Installing a LIM Module” on page 48 for instruction s on replacing the LIM module. Inst alling a LIM Module 1. Remove the new LIM module from the package. 2. Refer to “Removing a LIM Card” on page 45 , if a LIM module is still in place. 3. Ground yourself approp riatel[...]

  • Page 49

    49 9. Connect the InfiniBand cables to the ports. a. T o plug in an InfiniBand cab le, push the connector into th e interface until you hear/feel a click.Check the InfiniBand port LEDs to de termine the status of the port. Refer to “InfiniBand Port LEDs” on page 75 . Management Interface Modules About Management Interface Modules Refer to “Ma[...]

  • Page 50

    50 7. If the Master Management Interface module wa s removed, the standby module becomes active. The “Master” led becomes green. 8. Install a blanking panel in th e empty bay , or refer to “Installing a Management Interface Module” on page 50 to replace the Management Interface module. Inst alling a Management Interface Module 1. Remove the[...]

  • Page 51

    51 3. Use a #1 phillips screwdriver to loosen and remov e the screws from the left and right side of the Chassis ID module. Figure 3-20: Loose n the Captive Screws 4. Pull the Chassi s ID mod ule from the bay . Figure 3-21: Remove the Chassis ID Module 5. Do not allow the bay to rema in empty , as overheating may occur . The T opspin 270 should nev[...]

  • Page 52

    52 Inst alling a Replacement Chassis ID Module 1. Remove the new Chassis ID module from the package. 2. Ground yourself approp riately . 3. Remove the old Chassis ID module, if you have not already don e so. Refer to “Removing a Chassis ID Module” on page 50 if a Chassis ID module is still in pl ace. 4. Align the chassis ID module with the sl o[...]

  • Page 53

    53 4 Administrative T asks This chapter describes administrative tasks that may be performed on the T opspin 270 system. • “Upgrade all Cards in a Chassis” on page 53 • “Upgrading an Individual Controller Card” on page 56 • “Upgrading Individual Node Cards” on page 59 Upgrade all Cards in a Chassis These procedures assumes you are[...]

  • Page 54

    54 Upgrading a T op spin 270 with Element Manager The following procedure describes the upgrade procedure using the Element Manag er GUI. This procedure also assumes you are upgrading all fabric controllers in the chassis. 1. Launch Element Manager for the server switch. 2. Delete any old .img files to make room for the new image. a. Select Mainten[...]

  • Page 55

    55 Note : all cards in the chassis must have an oper -status of “ up ” for the upgrade to be ef fective on all components. a. Select Maintenance > File Manageme nt b. Click the new .img file and click the Install butto n. c. Click Ye s when prompted. d. Repeat for all Server Switches you wish to upgrade. Figure 4-2: W atching the File Copy P[...]

  • Page 56

    56 6. Select Maintenance > Reboot to reboot the controller cards and activate the image. Click Ye s at the prompt. 7. V iew the new image on the cards: a. Select Vi e w > Device Front V iew . b. Right-cl ick one of the cards and select Properties . c. Click the Inventory tab and view the version name in the Current Image Source field. Figure [...]

  • Page 57

    57 Upgrading a Controller Card with the CLI For the commands needed to upgrade a single Controller card using the CLI, refer to the CLI Refer ence Guide . 1. Check the version of your Controller card with the show card-inventory command. In the example below , only the Controller card in slot 12 needs to b e upgraded. Example Topspin-270# show card[...]

  • Page 58

    58 2. Show the standby Controller card. Example 3. Check to see if you alread y have a .img file that can be installed. (Delete the .img file, if it not the one you need to install. Use the delete [ slot-number : ] imag e: file-name command.) Example 4. Copy the image to the switch, if you do not have the correct .img file. copy ftp: //< r e mot[...]

  • Page 59

    59 5. Activate the image. After download ing the image file to the chassis controller , it must be installed to become active. The install command installs the specified image file into the system. a. In the privileged-execute mode, enter install image: image-file-name .img Example 6. Specify the new boot image to be used. a. Find the name of your [...]

  • Page 60

    60 Upgrading a Node Card with Element Manager The following procedure describes the upgrade procedure for indiv idual node cards using the Element Manager GUI. This procedure assumes you are upgra ding only one or more node cards, and not the Controller cards. 1. Launch Element Manager for the server switch. 2. Delete any old .img files to make roo[...]

  • Page 61

    61 Note : all node cards in the must have an oper - status of “ up ” for the upgrade to be ef fective. a. Select Maintenance > File Manageme nt b. Click the new .img file and click the Install butto n. c. Click Ye s when prompted. Figure 4-6: W atching the File Copy Progress d. Click Ok when the Image Install Comp leted Successfully message [...]

  • Page 62

    62 6. Activate the image on the node card(s) by enabli ng and disabling each node car d. Do not reboot the chassis as this will not result in the image being applied to the node card(s). a. Right-click a node card and select Pr operties . b. Click the down radio button and select the Apply but ton. Figure 4-8: Disable and Enable the Node Card(s) c.[...]

  • Page 63

    63 Upgrading Node Card(s) with the Chassis Manager For the procedure needed to upgrade node cards using the Chassis Manager GUI, refer to the Chassis Manager User Guide .[...]

  • Page 64

    64[...]

  • Page 65

    65 5 Monitoring the T op spin 270 System This chapter describes how to install and m anage the T op spin 270 system hardware. • “Interpret ing the Front Panel L EDs” on page 65 • “Interpreting the Back Panel LED s” on page 71 • “Monitoring the System with Chassis M anager” on page 76 • “Monitoring the System wit h Element Mana[...]

  • Page 66

    66 Figure 5-1: Front Pan el LEDs System-Wide S t atus LED Locating the System-Wide S tatus LED The system-wide status LED is located on the front of the chassis, and is visible whether the bezel cover is on or off. This LED indicates the over all health of all mo dules in the system. If you are facing the front of the chassis, the system -wide stat[...]

  • Page 67

    67 Power Supply LEDs Locating the Power Supply LEDs The Power Supply LEDs are located in the outside of each Power Supp ly module, if you are facing the front of the chassis with the bezel cover removed. Figure 5-2: Power Supply LEDs Y ellow blinking System identify . This state is initiated by the user . This LED can be initiated manually by using[...]

  • Page 68

    68 In addition, a Power Sup ply Identify LED is locat ed on the outside of th e chassis, next to the corresponding power supply . This LED allow s the us er to initiate a comman d that causes the Identify LED to blink, which assists in locating a particular Field Repl aceable Unit. Figure 5-3: Power Supply Identify LED Replicas of the Power Supply [...]

  • Page 69

    69 Fan LEDs Location The Fan LEDs are located at the top of each Fan tray module. Refer to “Front Pan el LEDs” on page 66 . In addition, replicas of the Fa n T ray LEDs are positio ned on the back of the chassis. Refer to “Management Interface Module LEDs” on page 71 . Interpreting the Fan LEDs T able 5-3: Interpretin g the Power Supply Ide[...]

  • Page 70

    70 Fabric Controller LEDs Each Fabric Module has two sets of LED indicators. • The two LEDs (green or yellow) are the module status indicators ( Ta b l e 5 - 5 ). • The single LED (green only) indicates whether of n ot the module is th e active system master ( Ta b l e 5 - 6 ). Location Refer to Figure 5-1 to view the front panel of the chassis[...]

  • Page 71

    71 Interpreting the Back Panel LEDs The back of the T o pspin 270 chassis has the following types of LED indicato rs: • “Management Interface Module LEDs” on page 71 • “Chassis ID LEDs” on page 74 • “LIM Status LEDs ” on page 75 • “InfiniBan d Port LEDs” on page 75 Figure 5-5: Back Panel LEDs Management Interface Module LEDs[...]

  • Page 72

    72 Location The Management Interface modules are located at the top of back the chassis. Refer to Figure 5-5 to view the chassis diagram. Figure 5-6: Managem ent Interface Module LEDs Interpreting the Manag ement Interface LEDs System S tatu s LEDs Management Interf ace S tatus LEDs T able 5-7: Interpretin g the Management Interf ac e Module System[...]

  • Page 73

    73 Fan T ray Mo dule S tatus LEDs Power Supply Module S tatus LEDs Green off No power to the Manageme nt Interface module, LED failure, or yellow LED is ON. Y ellow solid on Failure of the Mana gement Interface module. Operator attention required. The “ ! ” label indicates a failure. Y ellow blinking Identify a Management Interface module. Assi[...]

  • Page 74

    74 Master Management Connection S tatus LED The Master Management Connection Status LED is a single LED that indicates wh ether that particular Management Interface module is connected to the syste m 's active master controller . Refer to Figure 5-5 to view the location of this LED. Ethernet Management Po rt RJ-45 connector LEDs Refer to Figur[...]

  • Page 75

    75 LIM S t atus LEDs Location The LIM Status LED is located at the far left of each LIM card (if you are facing the back of the chassis). Refer to Figure 5-5 for a complete diagram of th e back panel of the chassis. Figure 5-8: LIM S tatus Indicat or LEDs Interpreting the LIM S tatus LEDs InfiniBand Port LEDs The InfiniBand LED represents the logi [...]

  • Page 76

    76 Location The InfiniBand port LEDs are located to the right of each InfiniBand port (i f you are facing the LIM card) in the back of the chassis. Figure 5-9: InfiniBand Port LEDs Interpreting the InfiniBand Port LEDs Monitoring the System with Chassis Manager For information regarding launching the Chassis Manager GU I, refer to the T opspin 270 [...]

  • Page 77

    77 3. The Device Rear V iew and the Device Front V iew appear . Figure 5-10: Chassis Ma nager 270 Device Rear View[...]

  • Page 78

    78 Figure 5-1 1: Chassis Manager 270 Device Front View 4. V iew the information at the top of the window to quickly check the status color and the number of modules installed . • The numbers associated with the Card field indicate the slot numbers where modules are installed. • The numbers associated with the Power Supplies and Fans fields indi[...]

  • Page 79

    79 • In the case of the fabric controller cards, th e card that is currently on standby (not the master) will be grey . The master fabric controller will be green. • A red LED indicates that an error has been detected. Monitor the Cards 1. Launch the Chassis Manager by entering the IP address of the InfiniB and switch into your web browser . 2.[...]

  • Page 80

    80 normal bootFailed tooHot booting checkingBootImage wrongBootImage rebooting standby recoveryImage 9. Click the radio button next to the card that you want to monitor . 10. Click the Properties button to view details about the card, or to reset the card. Reset a card to return it to the default state. The cards cannot be shut down because they ar[...]

  • Page 81

    81 7. V iew the Admin S tatus and the Oper S tatus of the ports. The Admin Status refers to the state that the admin has chosen the port to be. The Oper S t atus refers to the actua l state of the port. For example, an admin may have selected a state of “U p” for a po rt, but the Oper Status would display “down” if a cable had not b een con[...]

  • Page 82

    82 The Power Supplies view appears. Figure 5-15: Chassis Ma nager Power Supplies Window Monitor the Fans 1. Launch the Chassis Manager by entering the IP address of the InfiniB and switch into your web browser . 2. Log into the chassis. 3. The Device Rear V iew and the Device Front V iew appear . 4. V iew the Fan status at the top of the wind ow to[...]

  • Page 83

    83 Monitor the T emperature 1. Launch the Chassis Manager by entering the IP address of the InfiniB and switch into your web browser . 2. Press the Enter key . 3. The Device Rear V iew and the Device Front V iew appear . 4. Click open the Chassis file in the left-navigation tree. The individual components app ear beneath the Chassis menu. Click Sen[...]

  • Page 84

    84 Monitoring the System with Element Manager For information regarding installi ng the optionally licensed Element Manager GUI, refer to the InfiniBand User Guide . 1. Launch the Element Manager . 2. Select Health > St a t u s . The Health S tatus window opens. Figure 5-18: Element Manager Summary T ab Interpreting the Summary T ab 3. Use the S[...]

  • Page 85

    85 Interpreting the Power Supplies T ab Use the Health > St a t u s > Power Supplies tab to view the operating st atus of the power supplies. Figure 5-19: Element M anager Power Supplies T ab Interpreting the Fans T ab Use the Health > St a t u s > Fans tab to view the operating status of the fans. Figure 5-20: Element Manager Fans T ab[...]

  • Page 86

    86 Figure 5-21: Element M anager Sensors T ab 6. Note the OperS tatus field. A status of “up” indicates th at t he sensor is functioning prop erly . 7. Note the T emperature field. Each slot has an individua l temperature sensor . The Alarm and Shutdown temperatures vary by slot type. Monitor the System With the CLI For a complete list of CLI c[...]

  • Page 87

    87 Note the Speed field. The integer in this field represents a percentage. The percentage changes based on the ambient temperature of the unit, and will increase as the temperature rises . Example Monitor the Sensors •s h o w s e n s o r Example Note the T emperature field. The temperature is displaye d in Celsius. The system’ s maximum extern[...]

  • Page 88

    88[...]

  • Page 89

    89 6 Hardware Diagnostic T est s This chapter describes how to run diagnostic tests on th e T opspin 270 system hardware. • “About Diagnostic T ests” on page 89 • “Displaying Hardware Errors” on page 99 About Diagnostic T est s Hardware diagnostic tests can be performed through the CLI or the Element Manager GUI. Refer to the Element Ma[...]

  • Page 90

    90 Run Card T est s References to “Cards” refers to fabric controllers , management I/O modules, no de cards and the chassis ID module. Fans and power supplies are not included in the Card test s; they can be tested through the standard chassis test ( page 93 ), or as indiv idual components. The following tests are available to locate a nd diag[...]

  • Page 91

    91 Example of comp leted test Topspin-270(config-diag-card-11)# exit Topspin-270(config)# exit Topspin-270# show diagnostic card 11 ================================= =============================================== Diagno stic Tests For Cards ================================= =============================================== test : self- test slot-id [...]

  • Page 92

    92 3. Use the more file-system : file-n ame command to displ ay the log file and view the detailed results of the diag test . Example of l og resu lts 4. Enter reload to reboot the switch after the test is complete. If you do not reboot the switch after running the self-test, the switch will remain in an unknown state. Run Chassis T est s The follo[...]

  • Page 93

    93 • Standard page 93 • Extended • Extended Memory Run a Chassis S t andard T est The chassis standard diag test runs a diag nostic test on all cards in the chassis. 1. Enter the diag chassis test standard and start commands to initiate the test. Example 2. Enter the show diag chassis command to show the status of the diag test. Example Topsp[...]

  • Page 94

    94 3. Enter the show diag post command to show any errors on indivi dual components. Example Run Fan T est s The following tests are available to locate and diagnose fan m odules: •L E D •S e l f - T e s t page 94 Run a Self-T est on a Fan 1. Identify the numb er of the fan you want to diagnose, if you do not already know the nu mber . a. Enter[...]

  • Page 95

    95 2. Enter the diag fan < id > command. Example 3. Use the show diag fan command to show the progress of the test. Example Topspin-270# config Topspin-270(config)# diag fan 1 Topspin-270(config-diag-fan-1)# t est self-test Topspin-270(config-diag-fan-1)# s tart Topspin-270(config-diag-fan-1)# e xit Topspin-270(config)# exit Topspin-270# show[...]

  • Page 96

    96 4. Use the show diag fru-error command to display any errors th at appear in the result-string . Example 5. Reboot the chassis when the self-test is complete. Example Run Power Supply T est s The following tests are available to locate and diagnose fan m odules: •L E D page 96 •S e l f - T e s t page 97 Run a LED T est on the Power Supply Us[...]

  • Page 97

    97 Run a Self-T est on a Power Supply 1. Show the ID of the power supply that you wan t to diagnose, if you do not already know the number . a. Enter the show power -supply comma nd. Example 2. Enter the diag power-supply < id > command and specify the type of test (self-test is chosen by default). Example 3. S tart the test. Example 4. Use t[...]

  • Page 98

    98 5. Use the show diag fru-error command to display any errors th at appear in the result-string . Example 6. Reboot the chassis when the self-test is complete. Example Topspin-270# show diag fru-error ================================= =============================== Fru-Error ================================= =============================== fru-s[...]

  • Page 99

    99 Displaying Hardware Errors T o di splay POST results, non-fatal errors th at can are recovered, inform ational logging (such as firmware updates), and hardware errors: 1. Use the more syslog:hwif_log command to locate the: /topspin/log/hwif_lo g Example of output without errors Y o u can also view POST error codes with the show diagnostic post c[...]

  • Page 100

    100 T o view FRU errors on y our T opspin 270, enter the show diagnostic fru-error command. Example Error T ypes The following types o f hardware errors are logged for the T opspin 270 baseboard: The following types o f hardware errors are logged for the T opspin 270 power supply: Topspin-270# show diagnostic fru-error =============================[...]

  • Page 101

    101 2 Power Supply Fan Fail Error 3 Power Supply I2C Communication Error T able 6-2: T opspin 270 Power Supply Errors Error Number Description[...]

  • Page 102

    102[...]

  • Page 103

    103 7 S pecifications and Compliance Certifications This chapter details the T opspin 270 sp ecifications and compliance certifications. Chassis and Management Interface T able 7-1: Chassis and Management General S pecifications Operating T emperature Ranges 0 to 40C Operating T emperature 0 to 42C Non-Operating T emperature -40 to 70C Operating T [...]

  • Page 104

    104 Electrical S pecifications EMC/Immunity Safety Acoustics Non-Operating V ibration, random 2.09Grms, 3-axis, bottom /top, left/right, front/back Max. Operating Inclination 15 degrees T able 7-2: Electrical S pecific ations Category Specification AC Input Auto-ranging 90-264V AC , 47-63Hz. Maximum Power consumption <600 W atts T able 7-3: EMC/[...]

  • Page 105

    105 Product Markings • UL, FCC S tatement, VCCI, CE, ICES[...]

  • Page 106

    106[...]

  • Page 107

    Index A active controller card 11 admin status 81 C card operational state 79 reset 80 card reset 80 chassis ID about 19 LEDs 74 chassis manager launching 32 LEDs 78 controller card identify active 11 upgrade 59 controllerFabric12x 79 core slot about 18 D diag card 90 diag chassis test standard 93 diag power-supply 97 F fabric controller LEDs gener[...]

  • Page 108

    R rack-locator 89 reload 92 reset card 80 reset controller card 59 S safety information vii setup 32 show card 11 show diag chassis 93 show diag fru-error 96, 98 show diag post 94 show power-supply 97 slot numbers 15 speed port 81 starting Chassis Manager 32 switch configuration 32 switch fabric end-nodes about the fabric controller module 18 switc[...]