NEC A1160 manual

E XPRESS 5800/A1 160                                                                                   ?[...]

Proprietary Notice and Liability Disclaimer The information disclosed in this document, including all designs and related materials, is the valuable property of NEC Corporation of America, Inc. and/or its licensors. NEC Corporation of America and/or its licensors, as appropriate, reserve all patent, copyright and other proprietary rights to this do[...]

iii Contents Section 1 Introduction .................................................................. 1-1 Documentation Updates .................................................................................. 1-1 Scalable Symmetric Multiprocessing Servers .................................................. 1-1 Operating Systems ..................[...]

Contents iv System Components ........................................................................................ 4-1 Network Components ...................................................................................... 4-2 Management Architecture ................................................................................ 4-4 Manageme[...]

Figures v Figures Figure 1-1 Express5800/A1 160 Cell ............................................................................. 1-1 Figure 2-1 Basic Cell ..................................................................................................... 2-2 Figure 2-2 Processor Socket Location on Processor Board ...............................[...]

[...]

T ables vii Tables T able 2-1 DIMM Cap acity and Cell Memory ................................................................. 2-7 T able 2-2 D evice Names on the EXPRESSSCOPE® Monitor LCD ........................... 2-18 T able 3-1 R elation of Interconnect Port and Cable End to Cell ID ................................ 3-3 T able 3-2 Minimum and [...]

[...]

Using This Guide ix Using This Guide This guide contains information how to operate and administrate Express5800/A1160 server. Who Should Use This Guide This guide is intended for system administrators and operation personnel who are using Express5800/A1160 server. Symbols and Conventions This guide uses the following text conventions and graphic s[...]

Related Documents x The NECCare Guide contains information about NEC’s warranty and server registration.[...]

Safety Notices xi Safety Notices WARNING To avoid a risk of injuries, maintenance procedures require trained technical personnel. In maintenance procedures with voltages of 42.4V peak or 60Vdc or more, take safety measures, such as wearing insulated rubber gloves. Performing work without these measures may cause electric shock. In an emergency, suc[...]

Safety Notices xii temperature of 89.6°F.  Reduced air Flow – Installation of the equipment in a rack sh ould be such that the amount of air flow required for safe operation of the equipment is not compromised.  To prevent fires, and damage to rack equipment and supply wiring, make sure that the rated load of the power branch circuit is no[...]

xiii WARNING Take care not to short live components with conductive tools, such as an adjustable wrench. To prevent shock, take care not to drop or leave conductive parts, such as a screw, in the server when servicing the system. Be careful when accessing a fan or rotating parts to avoid cutting your hand or fingers.  Safety inspections – When[...]

[...]

1-1 Section 1 Introduction This overview provides a detailed intr oduction to Express5800/A1160 systems and the technologies on which they are based. It descr ibes features that might be available to customers in a series of hardware and so ftware releases. For information about the availability of any feature, contact your sales representative. Do[...]

Operating Systems 1-2 dual inline memory module (DIMM) sockets that su pport 2-GB or 4-GB fully buffered DIMMs, and all the other components it needs to function as a self-contained computer system. Modular Expansion The cell-based building-block design allows Express5800/A1160 systems to grow as business needs evolve. By connecting cells together,[...]

Virtual Machine Monitors 1-3 y Windows Server 2008, Enterprise x64 Edition y Windows Server 2008, Datacenter x64 Edition Note: Partitions running Windows Server 2003, 32-bit Enterprise Edition, or Windows Server 2003, 32-bit Datacenter Ed ition, are restricted to a maximum of two cells. Linux Operating Systems Express5800/A1160 systems support the [...]

[...]

2-1 Section 2 Cell Component Express5800/A1160 Cell In Express5800/A1160 systems, hardware components are organized into cells. The main components of a cell are • Main logic module that hosts the proce ssors, processor voltage regulator modules, and node controller. (The node controller interconnects the components of a cell and provides the con[...]

Processors 2-2 Figure 2-1 Basic Cell Processors Within each cell, the processor board in t he main logic module hosts the processors. The processor board contains the proce ssor sockets, processor voltage regulator modules, node controller, and the scalability ports, which are the ports that enable you t o connect up to four cells. Processor Socket[...]

Processors 2-3 Figure 2-2 shows the location of the processor sockets (along with the processor number) on the processor board. Figure 2-2 Processor Socket Location on Processor Board Supported Processors Express5800/A1160 systems support the follo wing Intel Xeon processor 7400 series (Dunnington) processors: • Model E7440 (2.4 GHz with 2 x 3-MB[...]

Processors 2-4 steppings. A stepping is a version of the processor that is as sociated with a set of fixes and errata. When mixing processors or processor steppings, observe the following rules: • Each processor board (or each cell) supports only one processor family. • All processors in a partition must be the same frequency and have the same [...]

Memory 2-5 Figure 2-3 Node Controller Memory Express5800/A1160 systems use a director y-based cache-coherent memory system. The directory-based memory tracks ownership of data. The cache coherency protocols force the processor cache components and main storage components to y Keep track of all copies of a cache line. y Determine which processor has[...]

Memory 2-6 Each channel pair operates in lockstep; that is, a single cache line is stored across two DIMMs with each DIMM on a differ ent channel of the lockstep pair. y Eight fully buffered DIMM slots for each channel. A cell with two memory boards contains 32 DIMM slots. y Double Data Rate 2 533-MHz and 667-MHz fu lly buffered DIMMs (single, dual[...]

Memory 2-7 Figure 2-5 DIMM Numbering DIMM Capacity and Cell Memory Table 2-1 lists the minimum and maximum memo ry in the cell if DIMMs of a specific capacity are used. T able 2-1 DIMM Capacity and Cell Memory DIMM Capacity Minimum Memory in Cell Maximum Memory in Cell 2 GB 4 GB 64 GB 4 GB 8 GB 128 GB Check with your sales re presentative for the a[...]

I/O Subsystem 2-8 Indicators on the Memory Board The memory board contains a green LED to i ndicate that the board is in service and an amber LED to indicate that the board needs a ttention. Do not remove a memory board while the green LED is lit. Dynamic DIMM Sparing Dynamic DIMM sparing automatically subs titutes a spare DIMM in place of an opera[...]

I/O Subsystem 2-9 Each slot has its own power an d attention indicators (LEDs). y Internal slot for PCIe Serial Attached SCSI (SAS) RAID controller Figure 2-6 shows the I/O riser board. Figure 2-6 I/O Riser Board PCIe Card Carrier The PCIe card carrier enables an administrato r or technician to insert or remove the PCIe cards from the rear of the c[...]

I/O Subsystem 2-10 Figure 2-7 PCIe Card Carrier Figure 2-8 shows the location of the external card slots on the back of the cell. Figure 2-8 External Card Slots Ports A cell includes the following ports: y Partition video port[...]

I/O Subsystem 2-1 1 y Partition universal serial bus (USB) ports — Two USB 2.0 ports on the front and two USB 2.0 ports on the back of the cell y Partition serial port y Partition LAN ports — Two 1- Gigabit Ethernet (LAN) ports In addition, the cell includes the fo llowing ports on the management board: y Maintenance LAN port (10/100 Ethernet p[...]

Power 2-12 Power Each cell is independently powered. The pow er system is fully di stributed and consists of the following components. AC Connections The AC input for each cell is two 15-ampere line cords. The line cords are connected to the power strips mounted in the rear of the cell. AC/DC Power Supplies The AC/DC power supplies take the AC inpu[...]

Cooling 2-13 The main logic module contains the single master power controller for the cell. The master power controller y Controls and monitors the power suppl ies, and monitors the voltages on all cell components y Responds when someone presses the power button (to turn the power on or off) y Monitors and c ontrols the fans y Monitors thermal sen[...]

Cooling 2-14 Cooling Each cell is cooled by two fan modules. Each fan module contains two 12-volt high-performance fans that pr ovide the airflow required to cool the cell components and processors. The fan modules are mo unted in the front of the cell. Note: The power supplies within the cell are self-cooled. The fans have four speeds. The system [...]

Peripherals 2-15 Figure 2-1 1 Fan Modules Peripherals The cell supports the following peripherals through the drive tray: y Six 2.5-inch Serial Attached SCSI (SAS ) disk drives with one of the following capacities: y 73 GB (15000 RPM) y 146 GB (10000 RPM) y DVD drive (DVD-RW) The drive tray also hosts the two USB ports on the front of the cell. Fig[...]

Peripherals 2-16 Figure 2-12 Peripherals on the Drive T ray Floppy disk drive support, if required, can be supplied through a floppy disk drive attached to the USB port. The BIOS also s upports booting the system from any device attached to the USB port. A keyboard and mouse can also be attached to the USB ports. In a system with multiple partition[...]

System Clocks 2-17 System Clocks A clock synthesizer on the main logic module is the master clo ck source. This source provides a number of output clocks that are further distributed to the system components as needed. The clock distribution system is self-contained within each cell. Systems with multiple cells do not provide redundant system clock[...]

Fault Messages on the EXPRESSSCOPE® Monitor LCD 2-18 Figure 2-13 EXPRESSSCOPE® Monitor Fault Messages on the EXPRESSSCOPE® Monitor LCD If a hardware problem occurs, a message is displayed on the EXPRESSSCOPE® Monitor LCD on the front of the cell. The disp lay identifies the failed unit, sometimes with abbreviated language. The following table g[...]

Fault Messages on the EXPRESSSCOPE® Monitor LCD 2-19 Full Name EXPRESSSCOPE® Monitor LCD Name Additional Displa y Details Unit Type (FRU/CRU) fan module Fan_Mod x x = 0 (left module) 1 (right module) CRU interconnect cable Intercon_Cable x x = 0 (right) 1 (middle) 2 (left) FRU I/O riser board IOR_Brd FRU PCI expansion card IO_Slot x _ y _ z x = c[...]

Inbuilt Virtua lization 2-20 Full Name EXPRESSSCOPE® Monitor LCD Name Additional Displa y Details Unit Type (FRU/CRU) PCIe carrier n/a CRU Inbuilt Virtualization Inbuilt virtualization is an optional capability for Expr ess5800/A1160 systems. This capability enables a partition to boot with VMware Infrastructu re 3. The partition contains a USB dr[...]

3-1 Section 3 System Configuration This section describes the packaging of Express5800/A1160 systems and the different configuration options. Cell Interconnect and Multiple Cell Systems A four-processor socket cell is capable of cont aining all the hardware it needs to boot as a server. To create a larger system, a cell can be connected together wi[...]

Cell Interconnect and Multiple Cell Systems 3-2 A cell can be connected together with up to th ree other cells to create a multiple-cell system. > shows a system made up o f two cell s (eight processo r sockets). The two cells are connected together with two interconnect c ables. > shows a system made up of four cells (16 processor sockets). [...]

Cell Identification 3-3 Cell Identification Each cell in a system has a unique physical cell identifier - cell 0, cell 1, cell 2, or cell 3. The management firmware uses the cell identifier to enable t he cells within the system to communicate with each other. The cell identifier is established by the in terconnect cables. The ce ll identifier is b[...]

Cabinets 3-4 Figure 3-4 System Serial Number Label Cabinets Express5800/A1160 systems can be installed in any standard 19-inch-wide cabinet. You can either order a cabinet from NEC or provide your own. See the System Planning Guide for the requirements for customer-provided cabinets. Optionally, each system can have a directly connected keyboard, m[...]

Partitions 3-5 Figure 3-5 Cabinet Configuration Partitions You can configure one or more cells as a partition to support an instance of an operating system or a virtual machine monitor. A partiti on is a logical computer in the system. You use partitions to run user app lications that perform work to support your business. Each cell in the system c[...]

Redundant Configurations 3-6 hardware resources among cluster nodes in response to planne d and unplanned events. This reallocation is virtually impossible to accomplish in a traditional cluster. Clustering Software Express5800 systems support various clus tering paradigms, including shared disk clusters, and shared nothing (onl y inter connected) [...]

Express5800/A1 160 Configuration Summary 3-7 See the User's Guide for additional information on the customer-replaceable components. Express5800/A1160 Configuration Summary T able 3-2 summarizes the configuration opti ons for Express5800/A1160 systems. T able 3-2 Minimum and Maximum Configurations Component One Cell Minimum One Cell Maximum Fo[...]

[...]

4-1 Section 4 Server Management This section provides an overview of the hardware and software components used to manage Express5800/A1160 systems. System Components The following illustration shows how the com ponents are connected in a typical system environment. Your system can include the following components.[...]

Components on the Front of a Cell 4-2 Cells A cell contains the physical resources of t he system: instructio n processors, memory, input/output devices, peripher al storage devices, managem ent board, fans, power supplies, EXPRESSSCOPE® Monitor, and so on. Each system comp rises one to four cells. Maintenance LAN (MLAN) The maintenance LAN (MLAN)[...]

Network Components 4-3 Windows Domain Controller The domain controller typically acts as the Domain Name System (DNS), Windows Internet Name Service (WINS), and Dynamic Host Configuration Protocol (DHCP) server. Note: DNS and WINS servers must be made secure in accordance with local security policy guidelines. Microsoft recommends that production a[...]

Components on the Front of a Cell 4-4 operate the partition. Management Architecture Management of Express5800/A1160 systems is based on a modul ar, distributed, and scalable architecture. This ar chitecture distributes the processing load among various processing engines and grows as the size of the system increases. Intelligent Platform Ma nageme[...]

Management Board 4-5 Figure 4-1 Management Architecture Management Board The management board in each cell is t he main hardware component of server management. Figure 4-2 illustrates the management board.[...]

Components on the Front of a Cell 4-6 Figure 4-2 Management Board The following paragraphs describe the main components on the management board in more detail. Service Processor The Service Processor is a management cont roller. For Express5800/A1160 systems, the Service Processor y Executes the management firmware to provide the management and mai[...]

Remote Console Interfaces 4-7 The firmware hubs in each cell store the BIOS. The firmware hub and the TPM are attached to the low pin count (LPC) bus, an internal bus that connects low-bandwidth devices to the CPU. Trusted Platform Module (TPM) "Trusted Platform Module (TPM)" in Section 2 describes the TPM. Ports The management board cont[...]

Components on the Front of a Cell 4-8 See the User's Guide for more information about t he remote console interfaces. BIOS The BIOS is bootstrapping software that initializes and confi gures the hardware (processors, memory, I/O, and so on) in the par tition. Running in the partition, the BIOS provides many configuration, setup, diagnostic, an[...]

Management Software Component s 4-9 Figure 4-3 Server Manageme nt Hardware Component s Management Software Components The Server Management software includes the following components. ESMPRO Manager and Agent Server Management software includes ESMPRO Manager and ESMPRO Agent software. ESMPRO Manager enables a system administr ator to manage a netw[...]

Components on the Front of a Cell 4-10 long-term and short-term performance, moni tor usage, create graphs to record trends, and check failure rates. System administrat ors can use the information collected to create more efficient data routing procedures and optimize server and partition usage. ESMPRO Manager is installed on the managem ent server[...]

A-1 Appendix A Cell Components The following text identifies the main com ponents, ports, and connectors that are visible on the front and back of a cell. Components on the Front of a Cell Figure A-1 identifies the components that are visible on the front of the cell. T able A-1 describes each component in more detail. Figure A-1 Front of the Cell [...]

Components on the Front of a Cell A-2 Component Description EXPRESSSCOPE® Monitor A contro l and display interface for the cell and the partition containing the cell. LED fan status indicators Provide fan stat us with one LED light on each fan module. A green light indicates normal o perations. LCD Displays status information and provi des a m enu[...]

Components on the Rear of a Cell A-3 Figure A-1 Rear of the Cell T able A-2 Component on the Rear of the Cell Component Description PCIe carrier/cards Six hot-plug switched PCIe 8x card slots. Slot s 1 and 4 can support full-length cards. Each PCIe card is hous ed in an individual carrier. Cell ID An LED that is lit when the ID button on the EXPRES[...]

Components on the Front of a Cell A-4 Component Description LED status indicators Provides status fo r the cell. The top light indicates power status. The bottom light indi cates cell status. See the EXPRESSSCOPE® Monitor LCD or the remote console interface for additional information on the po wer or cell status. Power supplies Two power supplies [...]

Note: Consumers are cautioned that Product performanc e is affected by system configuration, software, the application, Customer data, and operator control of the system, among other factors. While NEC Corporation of America pr oducts is considered to be compatible with many systems, the specific functional implem entation by the Customers of the p[...]

                                                                                       ?[...]