Q-Logic FC0054607-00 A manual

FC0054607-00 A Fibre Channel and Converged Network Adapters for VMware ESX/ESXi 4.0 User ’ s Guide[...]

ii FC0054607-00 A Fibre Channel and Conver ged Network Adapters for VMware ESX/ESXi 4.0 User ’s Guide Information fu rnished in this manual is believed to be accurate and reliable. However , QLogic Corporation assumes no responsibility for its use, nor for any infringements of patent s or other right s of third part ies which may result from its [...]

FC0054607-00 A iii T able of Content s Preface Intended Audience . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vii Related Materials . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vii What’s in This Guide . . . . . . . . . . . . . . . . . . . . . . . . . . . . . [...]

iv FC0054607-00 A Fibre Channel and Conver ged Network Adapters for VMware ESX/ESXi 4.0 User ’s Guide Using the QLogic Fast! UTIL BIOS Utility . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-5 V erifying That the Driver is Loaded . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-6 Configuring the Driver Parameters . . . . . [...]

FC0054607-00 A v Fibre Channel and Converged Network Adapters for VMware ESX/ESXi 4.0 User’s Guid e A-6 Common Driver Log Messages . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . A-6 A-7 Proc Output . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . A-9 A-8[...]

vi FC0054607-00 A Fibre Channel and Conver ged Network Adapters for VMware ESX/ESXi 4.0 User ’s Guide Notes[...]

FC0054607-00 A vii Preface QLogic provides a port folio of Fibre Channel Adapters, Intelligent Ethern et Adapters, and Converged Network Ada pters on the VMware ® ESX/ESXi 4.0 platform:  QLogic Fibre Channel Adapters include 2Gb, 4Gb, and 8Gb adapter offerings on VMware ESX/ESXi 4.0 in PCI-X™, PCI Express ® , and PCI Express ExpressModule™[...]

viii FC0054607-00 A  SANsurfer FC HBA CLI User ’s Guide (p art number SN0054614-00)  SANsurfer FC HBA CLI release notes and ReadMe file Related VMware document ation:  Online VMware Comp atibility Guide located here: http://www .vmware.com/go/hcl  VMware Fibre Channel SAN Configuration Guide located here: http://www .vmware.com/pdf/vs[...]

FC0054607-00 A ix  2 Installatio n details the sup ported features and covers installation of hardware, drivers, and SANsurfer ® manageme nt tools.  3 Configuration covers how to id entify QLogic adapters, start Fast! UTIL, verify that the driver is loaded, configure driver p arameters, deploy N_Port ID virtualization (NPIV), monitor NP IV f[...]

x FC0054607-00 A  T ext within square brackets indicates optional p arameters. For example iscli [optional parameters] [ Command Variable ]  Te x t i n blue font indicates a hyperlink (ju mp) to a figure, table, chapter , or section in this guide, and link s to W eb sites are shown in underlined blue . For example: T able 4-1 lists the co nfi[...]

FC0054607-00 A xi Visit the QLogic support Web site listed in Contact Information for the latest firmware and software updates. A vailability QLogic T echnical Support for product s under wa rranty is available during local standard working hours exclud ing QLogic Observed Holidays. T raining QLogic offers training for technical professionals for a[...]

xii FC0054607-00 A Notes[...]

FC0054607-00 A 1-1 1 Hardware and Sof tware Component s This chapter provides details a bout QLogic Fibre Channel and Converged Network Adapters in VMware ESX/ESXi, including:  Hardware Component s  “Software Component s” on page 1-3  “Supported QLogic Adapters” on p age 1-4 Hardware Component s A typical QLogic Fibre Channel or C [...]

1–Hardware and So ftware Components Hardware Components 1-2 FC0054607-00 A Figure 1-1 Adapter Components T able 1-1. Adapter Com ponent Details Callout Number Description 1 The reduced instruction set comp uter (RISC) processor , also known as the intelligent stor- age periphera l (ISP) controller , is the heart of the adapter . The RISC proces s[...]

1–Hardware and Sof tware Component s Software Comp onents FC0054607-00 A 1-3 Sof tware Component s This section describes the following QLogic adapter software component s:  Boot Code  OS Driver  Firmware  Management T ools and Utilities Boot Code Boot code resides on the Flash memory on the ada pter . The primary function of the boot[...]

1–Hardware and So ftware Components Supported QLogic Adapters 1-4 FC0054607-00 A Firmware The firmware module performs most of the Fibre Channel and FCoE protocol-related functions, thus freeing the system CPU and memory resources from protocol processing. This ef fici ency keep s the QLogic Fibre Channel and Converged Network Adapter drivers thi[...]

FC0054607-00 A 2-1 2 Inst allation This chapter provides the follo wing inst allation information:  Supported Features  “Installing the Hardware” o n page 2-2  “Installing the Drive r” on page 2-3  “Installing SANsurfer Man agement T ools” on page 2-3 Supported Features When properly inst alled, QLogic Fibre Channel and Conv[...]

2–Installation Installing the Hardware 2-2 FC0054607-00 A  Support for MSI-X —on 4/8Gb Fibre Channel and Converged Ne twork Adapters.  Support for VMware SCSI p ath failover —for Active/Active and Active/Passive stora ge devices.  Support for VMware VMotion™ and VMware Storage VMotion  Remote SAN and adapter manage ment —using[...]

2–Installation Installing the Driver FC0054607-00 A 2-3 5. Refasten the adapter's reta ining bracket using the existing screw or lever . 6. Close the computer cover . 7. Plug the Fibre Channel or Etherne t cable into the adapter . 8. Plug in the power cable and turn on the comp uter . 9. V erify the LEDs on the adapter to ensure proper opera[...]

2–Installation Installing SANsurfer Management T ools 2-4 FC0054607-00 A Inst al ling SANsurfer FC HBA Manage r T o run SANsurfer FC HBA Manager on a VMware ESX 4.0 server requires a two-step installation process, whereb y: 1. Y ou must install the SANsurfer back end, commonly called the qlremote agent , on the ESX server . 2. Y ou must download [...]

2–Installation Installing SANsurfer Management T ools FC0054607-00 A 2-5 2. Click the by Operating System button, and then select Fibre Channel Adapters , VMware , and VMware ESX/ESXi , as shown in Figure 2-2 . Figure 2-2 Downloading SANs urfer FC HBA Manager—VMware 3. Click Go . 4. On the VMware ESX/ESXi download page under Management T ools ,[...]

2–Installation Installing SANsurfer Management T ools 2-6 FC0054607-00 A c. In the command window , type hostname , and then press ENTER . 9. On the ESX Host, add the IP address and the “ho stname” of the remote system where you plan to run SANsur fer FC HBA Manager to the following files: /etc/hosts /etc/hosts.allow 10. On the remote system,[...]

2–Installation Installing SANsurfer Management T ools FC0054607-00 A 2-7 3. Click Go . 4. Under Management T ools , click SANsurfer FC HBA Manager (x86/x64) . 5. On the End User Sof tware License Agreement p age, click Agree . 6. Save the zipped file and then use it to inst all SANsurfer FC HBA Manager by following the installation wizard. After [...]

2–Installation Installing SANsurfer Management T ools 2-8 FC0054607-00 A 4. On the VMware ESX/ESXi download page under Management T ools , click SANsurfer FC HBA CLI (x86/x64) . 5. On the End User Sof tware License Agreement p age, click Agree . 6. Save the scli- x . xx . xx - xx .i386.rpm .gz file to your local machine. (In the file name, x.xx.x[...]

FC0054607-00 A 3-1 3 Configuration QLogic Fibre Channel an d Converged Network Adapters on VMware ESX/ESXi 4.0 configuration proce dures include the following:  Identifying QLogic Adapters on VMware ESX/ESXi 4.0  “Using the QLogic Fast!UTIL BIOS Utility” on p age 3-5  “V erifying That the Driver is Loaded” on page 3-6  “Config[...]

3–Configuration Identifying QLogic Adapte rs on VMware ESX/ESXi 4.0 3-2 FC0054607-00 A T o identify QLogic Fibre Channel and Converged Ne twork Adapters using vSph ere: 1. S tart vS phere Client and select the host you want. 2. Click the Configuration tab to b ring the Configuration page to the front. 3. Under Hardwar e on the left, click S torag[...]

3–Configuration Identifying QLogic Adapter s on VMware ESX/ESXi 4.0 FC0054607-00 A 3-3 T o identify QLogic Fibre Channel and Converged Ne twork Adapters using console OS: 1. Discover the device using lspci . 2. T o list the subdirectories, run the following command: ls /proc/scsi: If the qla2 xxx directory is present, QLog ic adapters are inst al[...]

3–Configuration Identifying QLogic Adapte rs on VMware ESX/ESXi 4.0 3-4 FC0054607-00 A Figure 3-2 Finding Adapte rs on VMware ESX/ESXi 4.0 Driver information includes the following:  Host adapter: loop state specifies the current state of the adapter port, including:  READY —Driver is ready to handle IO commands.  UPDATE —Driver is u[...]

3–Configuration Using the QLogic Fast!UTIL BIOS Utility FC0054607-00 A 3-5  NPIV Supported indicates wh ether the adapter port suppo rts NPIV . If Yes , the maximum number of supported virtual port s on that specific adapter port is shown in the next line, Max Virtu al Ports .  SCSI Device Information list s the adapters’ world wide names[...]

3–Configuration V erifying That the Driver is Loaded 3-6 FC0054607-00 A  Select Host Adapter setting enables you to select a specific ada pter , if you have multiple Fibre Channel or Converged Network Adap ters in your system, and then configure or view the adapter ’s settings. The Fast! UTIL BIOS u tility is described in detail in the BIOS [...]

3–Configuration Configuring the Driver Parameters FC0054607-00 A 3-7 Figure 3-3 V erifying That the Driver is Loaded Configuring the Driver Parameters Use the esxcfg-module command to configure the QLogic Fibre Channel and Converged Network Adapter driver p arameters. T o configure driver pa rameters: 1. T o list the driver parameters, exe cute t[...]

3–Configuration Configuring the Driver Parameters 3-8 FC0054607-00 A where < options > is one of the configurable p arameters listed in T able 3-1 on pa ge 3-8 . For example, the following command set s the maximum device qu eue depth reported by the QLogic to a value of 32 : # esxcfg-module -s ql2xmaxqdepth=32 qla2 xxx 3. T o update the ES[...]

3–Configuration Deploying NPIV for VMware ESX/ESXi 4.0 FC0054607-00 A 3-9 Deploying NPIV for VMware ESX/ESXi 4.0 QLogic Fibre Channel and Converged Ne twork Adapt ers support N_Port ID virtualization (NPIV) for Fibre Channe l and FCoE SANs. NPIV enables each virtual machine to have its own Fibre Chan nel-FCoE world wide port name (WWPN) by creati[...]

3–Configuration Monitoring NPIV Virtual Ports from SANsurfer 3-10 FC0054607-00 A VMware ESX/ESXi 4.0 enables NPIV supp ort on QLogic 4Gb/ 8Gb Fibre Channel Adapters and QLE8000 Series Co nverged Network Adapters. No additional software or ha rdware installation is required to support NPIV . Note that VMware ESX/ESXi 4.0 supports NPIV only on RDM [...]

3–Configuration Monitoring NPIV V irtual Ports from SANsurfer FC0054607-00 A 3-1 1 Figure 3-4 SANsurfer FC HBA Manager Showing NPIV When you select an in dividual virtual por t on the T opology pa ge, SANsurfer FC HBA Manager displays additional det ails about the selected virtu al port on four tabbed p ages. The Information page (see Figure 3-5 [...]

3–Configuration Configuring Bo ot from SAN 3-12 FC0054607-00 A Figure 3-5 V irtual Port In formation Page in SANsurfer Configuring Boot from SAN Boot from SAN refers to installing and booting a server ’ s operating system from a storage device atta ched to the SAN instead of from a locally att ached storage device. The OS is inst alled on one o[...]

3–Configuration Configuring Boot from SAN FC0054607-00 A 3-13 VMware ESX/ESXi 4.0 provides boot from SAN capability on QLogic Fibre Channel Adapters. For storage array and Fibre Chann el switch configuration, refer to the appropriate user manual for the device. For VMware ESX/ESXi 4.0-specific configuration requirement s, refer to the VMware Fibr[...]

3–Configuration Configuring Bo ot from SAN 3-14 FC0054607-00 A 7. After the Host Adapter BIOS is enabled, select the boot device as shown in the following tab le: a. Choose Select able Boot Settings , and then press ENTER . b. On the Selectab le Boot Settings p age, choose Select able Boot . c. T o toggle the value to Enabled , press ENTER . 8. A[...]

FC0054607-00 A A-1 A T roubleshooting This appendix provides the following met hods of determining the stat us of the adapters and finding solutions to common prob lems:  T roubleshooting with LEDs  “Dynamic Extended Logging” on p age A-3  “T roubleshooting with Driver Logs” on page A-4  “Debugging Using Proc Informa tion” o[...]

A–T roubleshoot ing T roubleshoot ing with LEDs A-2 FC0054607-00 A T able A-2. QLA24 xx/QLE24xx/QEM2462 Adapter LED Scheme Y ellow LED Green LED Amber LED Activity ❍ ❍ ❍ Power of f ●●● Power on (befor e firmware init) Flashing Flashing Flashing Power on (after firmware init) Y ellow , green, and amber LEDs flashing alternately Firmwar[...]

A–T roubleshooting Dynamic Exte nded Logging FC0054607-00 A A-3 Dynamic Extended Logging The QLogic driver provides a mechani sm to dynamically enable extended error logging about driver operation. Thes e logs provide debugging and error information to help you underst and driver behavior regarding issues related to the adapter . These logs are s[...]

A–T roubleshoot ing T roubleshooting with Driver Lo gs A-4 FC0054607-00 A When the logging is enabled, the d river version in the /proc/scsi/qla2xxx/< adapter numbe r > is appended with a -debug flag as shown below: # cat /proc/scsi/qla2xxx/5 QLogic PCI to Fibre Channel Host Adapter for QLE2462: Firmware version 4.04.09 [IP] [Multi-ID] [84X[...]

A–T roubleshooting T roubleshoot ing with Driver Log s FC0054607-00 A A-5 Aug 18 15:15:13 localhost vmkernel: 0:00:00:34.550 cpu6:4109)<6>qla2xxx 0000:0a:00.0: Allocated (1413 KB) for firmware dump... Aug 18 15:15:13 localhost vmkernel: 0:00:00:34.572 cpu6:4109)IDT: 942: 0x71 <qla2xxx> sharable (entropy source), flags 0x10 Aug 18 15:1[...]

A–T roubleshoot ing T roubleshooting with Driver Lo gs A-6 FC0054607-00 A T able A-6 lists the more common driver log messages and provid es an explanation of each. T able A-6. Common Driver Log Messages "qla2xxx <dev driver string>: Found an ISPXXXX, irq yyy, iobase zzz" Driver is reporting wh ich adap ter it has foun d during in[...]

A–T roubleshooting T roubleshoot ing with Driver Log s FC0054607-00 A A-7 "scsi(%d): RSCN,..." Driver received a registe red state chang e notification (RSCN) async event from the firmware . Additional information follows the message (tha t is, mailbox values from the firmware). "scsi(%d): Cannot get topology - retrying" Firmw[...]

A–T roubleshoot ing T roubleshooting with Driver Lo gs A-8 FC0054607-00 A "WARNING qla2xxx: Couldn't allocate host from scsi layer!" Indicates the driver could not r egister with the SCSI la yer , usua lly because it could n ot allocate the mem- ory required for the adapter . "WARNING scsi(%d): [ERROR] Failed to allocate memor[...]

A–T roubleshooting Debugging Using Proc Information FC0054607-00 A A-9 Debugging Using Proc Information The driver /proc/scsi/qla2xxx/ < adapter_number > provides debugging information that can help you troubleshoot problems with the driver . The /proc entry provides firsthand informa tion about the current state of th e driver . T able A-8[...]

A–T roubleshoot ing Collecting System Logs for T roubleshooting A-10 FC0054607-00 A Collecting System Logs for T roubleshooting T o collect all relevant dat a on the running system into one ta r file, execute the following command: # vm-support Frequently Seen Issues T able A-8 lists some common issues and q ues tions and provides tips for their [...]

FC0054607-00 A Glossary-1 Glossary adapter The board that interfaces between the host system and the t arget devices. Adapter is synonymous with host bus adapter (HBA) , host channel adapter (HCA) , host adapter , and a dapter board . arbitrated loop A circular (ring) topology (versus point-to-point) where two or more port s can be interconnected, [...]

Fibre Channel and Conver ged Network Adapters for VMware ESX/ESXi 4.0 User ’s Guide Glossary-2 FC0054607-00 A cache A temporary high-speed storage (memory) area where recently used or freque ntly accessed data is st ored for rapid access, thus increasing the ef ficiency of processor operations. Cache contents duplicat e recently-used values store[...]

FC0054607-00 A Glossary-3 Fibre Channel and Converged Network Adapters for VMware ESX/ESXi 4.0 User’s Guid e fabric switch Also, switched fabric. Connect s multiple devices from independent Fibre Channel-arbitrated loop s (FC-ALs) and point-to-point topologies into a fabric using Fibre Channel switches. Fast! UTIL QLogic Fast! UTIL™ Fibre Chann[...]

Fibre Channel and Conver ged Network Adapters for VMware ESX/ESXi 4.0 User ’s Guide Glossary-4 FC0054607-00 A ISL Inter-switch link. The connection between two switches using E_Port s. ISP Intelligent storage peripheral. QLogic trademark and family of Fibre Channel and SCSI controller chips that replace network interface chips in network ada pter[...]

FC0054607-00 A Glossary-5 Fibre Channel and Converged Network Adapters for VMware ESX/ESXi 4.0 User’s Guid e N_Port Node port. A port that connect s by a point-to-point link to either a single N_Port or a single F_Port . N_Port s handle creation, detection, and flow of messag e units to a nd from the connected systems. N_Ports are end ports in vi[...]

Fibre Channel and Conver ged Network Adapters for VMware ESX/ESXi 4.0 User ’s Guide Glossary-6 FC0054607-00 A This is important to the driver when selecting the proper method of failover notification. It can make a dif ference to the target device, which might have to t ake different actions when re ceiving retries of the request from another ini[...]

FC0054607-00 A Glossary-7 Fibre Channel and Converged Network Adapters for VMware ESX/ESXi 4.0 User’s Guid e ta rg e t The storage-device end point of a SCSI session. Initiators request dat a from target s (usually disk-drives, tape-drives, or other media devices). T ypically , a SCSI peripheral device is the t arget but an adapter may , in some [...]

Fibre Channel and Conver ged Network Adapters for VMware ESX/ESXi 4.0 User ’s Guide Glossary-8 FC0054607-00 A Notes[...]

FC0054607-00 A Index-1 Index A acronyms, definitions of Glossary-1 adapter port beacon, defin ition of Glossary-1 adapter port, definition o f Glossary-1 adapters definition of Glossary-1 identifying on VMware ESX 3-1 installing hardware 2-2 supported 1-4 agreements , license x arbitrated loop, definition of Glossary-1 audience, intended vii automa[...]

Fibre Channel and Conver ged Network Adapters for VMware ESX/ESXi 4.0 User ’s Guide Index-2 FC0054607-00 A device boot, configuring 3-5 definition of Glossary-2 external boot 1-3 fibre, scanning for 3-5 documentatio n conventions used in guide ix related vii driver definition of Glossary-2 installing 2-3 logs, troubleshooting with A-4 OS 1-3 para[...]

FC0054607-00 A Index-3 Fibre Channel and Converged Network Adapters for VMware ESX/ESXi 4.0 User’s Guid e installing 2-1 driver 2-3 hardware 2-2 SANsurfer FC HBA CLI 2-7 SANsurfer FC HBA Manager 2-4 SANsurfer management tools 2-3 instance (port), definitio n of Glossary-6 intelligent storage peripheral, See ISP intended audience vii inter-switch [...]

Fibre Channel and Conver ged Network Adapters for VMware ESX/ESXi 4.0 User ’s Guide Index-4 FC0054607-00 A NPIV definition of Glossary-5 deploying 3-9 virtual ports, monitorin g 3-10 NVRAM definition of Glossary-5 description of 1-3 O OS driver 1-3 P parameters, configuring driver 3-7 path, definition of Glossary-5 phoning QLogic support xi PLOGI[...]

FC0054607-00 A Index-5 Fibre Channel and Converged Network Adapters for VMware ESX/ESXi 4.0 User’s Guid e supported adapters 1-4 features 2-1 system logs, collecting A-10 T target definition of Glossary-7 devices, max queue depth 3-9 discovery , rescanning for A-10 mode, port A-9 numbers, differe nt assigned A-10 TCP/IP , definition of Glossary-7[...]

© 2009 QLogic Corporation. Specifications ar e subject to change without notice. All ri ghts reserved worldwide. QLogic and the Q Logic logo are registered trademarks of QLog ic Corporation. VMware is a registered trademark, and vCenter , VMotion, and vS phere are trademarks of VMware , Inc. PCI-X, ExpressModule, and PCIe are trademarks and PCI Ex[...]