Qlogic Fast Fabric Uživatelská příručka

IB0054607-01 AUser GuideFastFabric 7.0

x IB0054607-01 AFastFabric 7.0 User Guide 4-44 CA Port Selection Screen . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

4–Real-Time Fabric MonitorFabric View Sub-Screens4-36 IB0054607-01 ALink Selection Screen (24000+ Links)If there are 24000 or more links found within

4–Real-Time Fabric MonitorFabric View Sub-ScreensIB0054607-01 A 4-37Link Selection Screen (1200-24000 Links)After selecting a block of 24000 Links or

4–Real-Time Fabric MonitorFabric View Sub-Screens4-38 IB0054607-01 ALink Selection Screen (60-1200 Links)After selecting a block of 1200 Links or if t

4–Real-Time Fabric MonitorFabric View Sub-ScreensIB0054607-01 A 4-39Link Selection Screen (1-60 Links)After selecting a block of 60 Links or if there

4–Real-Time Fabric MonitorFabric View Sub-Screens4-40 IB0054607-01 ALink Information Selection ScreenFigure 4-54 is an example of the screen for selec

4–Real-Time Fabric MonitorFabric View Sub-ScreensIB0054607-01 A 4-41Link End-Node Information Selection ScreenFigure 4-55 is an example of the screen

4–Real-Time Fabric MonitorFabric View Sub-Screens4-42 IB0054607-01 ALink ElementA link is an established connection between two ports (cable or backpl

4–Real-Time Fabric MonitorFabric View Sub-ScreensIB0054607-01 A 4-43Link End-Port Information Selection ScreenFigure 4-56 is an example of the screen

4–Real-Time Fabric MonitorFabric View Sub-Screens4-44 IB0054607-01 ASlow Link Selection ScreenFigure 4-57 is an example of the screen for selecting wh

4–Real-Time Fabric MonitorFabric View Sub-ScreensIB0054607-01 A 4-45SM ScreensSM Selection ScreenFigure 4-58 is an example of the initial screen for s

IB0054607-01 A xiPrefaceIntended AudienceThis manual is intended to provide network administrators and other qualified personnel a reference for insta

4–Real-Time Fabric MonitorFabric View Sub-Screens4-46 IB0054607-01 ASM Detailed Information ScreenFigure 4-59 is an example of the screen showing deta

4–Real-Time Fabric MonitorPerformance View Sub-Screens IB0054607-01 A 4-47Performance View Sub-Screens Bandwidth Utilization Screens When a user selec

4–Real-Time Fabric MonitorPerformance View Sub-Screens 4-48 IB0054607-01 ALow Bandwidth Utilization Selection Screen After selecting the (u)til<l&g

4–Real-Time Fabric MonitorPerformance View Sub-Screens IB0054607-01 A 4-49Error Condition Screens When a user selects the (G)rp<1-4><e> su

4–Real-Time Fabric MonitorPerformance View Sub-Screens 4-50 IB0054607-01 AIntegrity Error Selection Screen After selecting the (e)rr<1> sub-menu

4–Real-Time Fabric MonitorPerformance View Sub-Screens IB0054607-01 A 4-51Link Selection Screen Figure 4-64 is an example of the screen for selecting

4–Real-Time Fabric MonitorAdmin Menu Screens4-52 IB0054607-01 AAdmin Menu ScreensMain ScreenFigure 4-65 is the main screen of the Admin menu selection

4–Real-Time Fabric MonitorAdmin Menu ScreensIB0054607-01 A 4-53Fabric Discovery ScreenFigure 4-66 is the screen for viewing results from the execution

4–Real-Time Fabric MonitorAdmin Menu Screens4-54 IB0054607-01 A

IB0054607-01 A 5-15 Configuration of IPoIB Name MappingThe FastFabric tools support the concept of a management network and an IPoIB network. For some

xii IB0054607-01 A To return to the root directory from anywhere in the file structure:Type cd /root and press ENTER.  Enter the following command:

5–Configuration of IPoIB Name Mapping5-2 IB0054607-01 A

IB0054607-01 A A-1A FastFabric Configuration FilesTable A-2 list the configuration files that are used by FastFabric. The description in the table als

A–FastFabric Configuration FilesFastFabric Configuration FileA-2 IB0054607-01 AFastFabric Configuration FileThe FastFabric tools support a configurati

A–FastFabric Configuration FilesFastFabric Configuration FileIB0054607-01 A A-3export CONFIG_DIRfi# Override default location for HOSTS_FILEexport HOS

A–FastFabric Configuration FilesFastFabric Configuration FileA-4 IB0054607-01 A# $1 = hostname provided (could be ethernet or IPoIB name)echo "$1

A–FastFabric Configuration FilesFastFabric Configuration FileIB0054607-01 A A-5# local HCA port/fabric selection string (for example 0:0 or 1:2) for#

A–FastFabric Configuration FilesFastFabric Configuration FileA-6 IB0054607-01 Aexport FF_CHASSIS_CMDS=${FF_CHASSIS_CMDS:-showInventory fwVersion showI

A–FastFabric Configuration FilesPort Statistics Thresholds Configuration FileIB0054607-01 A A-7Port Statistics Thresholds Configuration FileThe /etc/s

A–FastFabric Configuration FilesPort Statistics Thresholds Configuration FileA-8 IB0054607-01 APortRcvConstraintErrors 10LocalLinkIntegrityErr

A–FastFabric Configuration FilesSignal Integrity Thresholds Configuration FileIB0054607-01 A A-9Signal Integrity Thresholds Configuration FileThe /etc

IB0054607-01 A xiiiTechnical SupportCustomers should contact their authorized maintenance provider for technical support of their QLogic products. QLo

A–FastFabric Configuration FilesSignal Integrity Thresholds Configuration FileA-10 IB0054607-01 A# alternative value is Greater# Normal Data MovementP

A–FastFabric Configuration FilesHost List FilesIB0054607-01 A A-11Host List FilesThe /etc/sysconfig/iba/hosts and /etc/sysconfig/iba/allhosts files ar

A–FastFabric Configuration FilesChassis List FilesA-12 IB0054607-01 AChassis List FilesThe /etc/sysconfig/iba/chassis and /etc/sysconfig/iba/esm_chass

A–FastFabric Configuration FilesExternally Managed Switch List FileIB0054607-01 A A-13However, in some cases it may be desirable to perform operations

A–FastFabric Configuration FilesExternally Managed Switch List FileA-14 IB0054607-01 AThe following is a sample ibanodes file:# [ICS VERSION STRING: @

A–FastFabric Configuration FilesExternally Managed Switch List FileIB0054607-01 A A-15The GUID will be used to select the switch and on firmware updat

A–FastFabric Configuration FilesExternally Managed Switch List FileA-16 IB0054607-01 AThe ordering is controlled by an optional distance field in the

A–FastFabric Configuration FilesPort List FileIB0054607-01 A A-17Port List FileThe /etc/sysconfig/iba/ports file is used to specify the local HCA port

A–FastFabric Configuration FilesFabric Topology Input FileA-18 IB0054607-01 AFabric Topology Input FileThe /etc/sysconfig/iba/topology.0:0.xml file is

A–FastFabric Configuration FilesFabric Topology Input FileIB0054607-01 A A-19<PortNum>1</PortNum><NodeType>CA</NodeType><No

xiv IB0054607-01 AKnowledge DatabaseThe QLogic knowledge database is an extensive collection of QLogic product information that you can search for spe

A–FastFabric Configuration FilesFabric Topology Input FileA-20 IB0054607-01 A

Corporate Headquarters QLogic Corporation 26650 Aliso Viejo Parkway Aliso Viejo, CA 92656 949.389.6000 www.qlogic.comInternational Office

IB0054607-01 A 1-11 FastFabric OverviewFeature OverviewThe FastFabric Toolset is designed to both simplify and expedite common InfiniBand (IB) cluster

1–FastFabric OverviewFeature Overview1-2 IB0054607-01 A Fabric topology analysis and verification Fabric route analysis Aids in ongoing fabric stat

1–FastFabric OverviewFastFabric ArchitectureIB0054607-01 A 1-3FastFabric ArchitectureFigure 1-1. FastFabric ArchitectureFastFabric is typically instal

1–FastFabric OverviewFastFabric Architecture1-4 IB0054607-01 AIf remote access to FastFabric is desired, set up remote access to the InfiniBand Manage

IB0054607-01 A 2-12 FastFabric TUI MenuFastFabric TUI Menu OverviewFastFabric is easiest to use from the textual user interface (TUI) menu system. The

ii IB0054607-01 AFastFabric 7.0 User Guide Information furnished in this manual is believed to be accurate and reliable. However, QLogic Corporation a

2–FastFabric TUI MenuFastFabric TUI Menu Overview2-2 IB0054607-01 AIf more than one item is selected, the items will be performed in the order shown i

2–FastFabric TUI MenuQLogic InfiniBand Software Main MenuIB0054607-01 A 2-3QLogic InfiniBand Software Main MenuThe QLogic InfiniBand Software main men

2–FastFabric TUI MenuQLogic InfiniBand Software Main Menu2-4 IB0054607-01 AGenerate Supporting Information for Problem ReportMenu item 5) Generate Sup

2–FastFabric TUI MenuFastFabric Main MenuIB0054607-01 A 2-5FastFabric Main MenuThe FastFabric main menu is the starting point to manage the fabric usi

2–FastFabric TUI MenuFast Fabric IB Chassis Setup/Admin Menu2-6 IB0054607-01 AFabric MonitoringMenu item 5) Fabric Monitoring when selected displays t

2–FastFabric TUI MenuFast Fabric IB Chassis Setup/Admin MenuIB0054607-01 A 2-7Menu Items DescriptionSelecting items 0 through c will change the item f

2–FastFabric TUI MenuFast Fabric IB Chassis Setup/Admin Menu2-8 IB0054607-01 AUpdate Chassis Firmware(Switch) This will run the iba_chassis_admin upda

2–FastFabric TUI MenuFast Fabric IB Chassis Setup/Admin MenuIB0054607-01 A 2-9 NTP Server IP Address Time zone and Daylight Savings Time (DST) Maxi

2–FastFabric TUI MenuFast Fabric IB Chassis Setup/Admin Menu2-10 IB0054607-01 AConfigure Chassis Fabric Manager(Switch) The Configure Chassis Fabric M

2–FastFabric TUI MenuFast Fabric IB Chassis Setup/Admin MenuIB0054607-01 A 2-11Get Basic Chassis Configuration(Switch) The Get Basic Chassis Configura

IB0054607-01 A iiiTable of ContentsPrefaceIntended Audience . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xi

2–FastFabric TUI MenuFast Fabric IB Chassis Setup/Admin Menu2-12 IB0054607-01 A(All): The answer to Would you like to perform fabric link speed error

2–FastFabric TUI MenuFast Fabric InfiniBand Externally Managed Switch Setup/Admin MenuIB0054607-01 A 2-13 enableall - Enables Fabric Manager start on

2–FastFabric TUI MenuFast Fabric InfiniBand Externally Managed Switch Setup/Admin Menu2-14 IB0054607-01 AFigure 2-5. Fast Fabric IB Switch Setup/Admin

2–FastFabric TUI MenuFast Fabric InfiniBand Externally Managed Switch Setup/Admin MenuIB0054607-01 A 2-15Refer to FastFabric Command Line Interface Re

2–FastFabric TUI MenuFast Fabric InfiniBand Externally Managed Switch Setup/Admin Menu2-16 IB0054607-01 AIf any switches fail to be updated, use the V

2–FastFabric TUI MenuFast Fabric InfiniBand Externally Managed Switch Setup/Admin MenuIB0054607-01 A 2-17Reboot Switch(Switch) This will run the iba_s

2–FastFabric TUI MenuFast Fabric InfiniBand Externally Managed Switch Setup/Admin Menu2-18 IB0054607-01 AReport Switch VPD Information(Switch) This wi

2–FastFabric TUI MenuFast Fabric IB Host SetupIB0054607-01 A 2-19Fast Fabric IB Host SetupThis menu is focused on initial host setup and installation

2–FastFabric TUI MenuFast Fabric IB Host Setup2-20 IB0054607-01 AEdit Configuration and Select/Edit Hosts Files(All) This will permit the hosts and fa

2–FastFabric TUI MenuFast Fabric IB Host SetupIB0054607-01 A 2-21Install/Upgrade QLogic IB Software(Host) This will run the iba_host_admin load or iba

iv IB0054607-01 AFastFabric 7.0 User Guide Fast Fabric IB Chassis Setup/Admin Menu . . . . . . . . . . . . . . . . . . . . . . . . . 2-6Menu Items Des

2–FastFabric TUI MenuFast Fabric IB Host Setup2-22 IB0054607-01 ABuild MPI Test Apps and Copy to Hosts(Host) This will build the MPI sample benchmarks

2–FastFabric TUI MenuFast Fabric IB Host Verification/Admin MenuIB0054607-01 A 2-23View iba_host_admin result files (All) This permits viewing of the

2–FastFabric TUI MenuFast Fabric IB Host Verification/Admin Menu2-24 IB0054607-01 AFigure 2-7. Fast Fabric IB Host Verification/Admin MenuMenu Items D

2–FastFabric TUI MenuFast Fabric IB Host Verification/Admin MenuIB0054607-01 A 2-25Verify Hosts via Ethernet ping(All) This will run the pingall comma

2–FastFabric TUI MenuFast Fabric IB Host Verification/Admin Menu2-26 IB0054607-01 A(All): The answer to Would you like to perform fabric link speed er

2–FastFabric TUI MenuFast Fabric IB Host Verification/Admin MenuIB0054607-01 A 2-27Refresh SSH Known Hosts(Linux) This will run the setup_ssh -U comma

2–FastFabric TUI MenuFast Fabric IB Host Verification/Admin Menu2-28 IB0054607-01 Asettings and any motherboard jumpers related to devices on PCI buse

2–FastFabric TUI MenuFabric MonitoringIB0054607-01 A 2-29For detail levels 2-4, the additional information is only gathered on the node running the ca

2–FastFabric TUI MenuFabric Monitoring2-30 IB0054607-01 AFabric Performance Monitoring(All) This selection initiates iba_top. for full details about i

IB0054607-01 A 3-13 iba_top Fabric Performance MonitorIntroductioniba_top is a command line tool which displays performance, congestion, and error inf

IB0054607-01 A vFastFabric 7.0 User Guide Menu Items Description. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2-19Edit Conf

3–iba_top Fabric Performance Monitoriba_top TUI3-2 IB0054607-01 AFigure 3-9. iba_top TUI Screen LayoutImage IdentificationThe first display line of ib

3–iba_top Fabric Performance Monitoriba_top TUIIB0054607-01 A 3-3Common Input CommandsThe following input commands are available in every screen:Q: Qu

3–iba_top Fabric Performance Monitoriba_top TUI Screens3-4 IB0054607-01 Aiba_top TUI ScreensAdditional screens, described in the following paragraphs,

3–iba_top Fabric Performance Monitoriba_top TUI ScreensIB0054607-01 A 3-5Performance and Error Statistics for Each Port GroupFabric performance and er

3–iba_top Fabric Performance Monitoriba_top TUI Screens3-6 IB0054607-01 AScreen-Specific Input CommandsThe summary screen accepts the following input

3–iba_top Fabric Performance Monitoriba_top TUI ScreensIB0054607-01 A 3-7Image Information ScreenThe Image Information screen (Figure 3-12) displays i

3–iba_top Fabric Performance Monitoriba_top TUI Screens3-8 IB0054607-01 AFigure 3-13. Group Information ScreenBandwidth Statistics ScreenThe Bandwidth

3–iba_top Fabric Performance Monitoriba_top TUI ScreensIB0054607-01 A 3-9The Bandwidth Statistics screen accepts input commands which specify paramete

3–iba_top Fabric Performance Monitoriba_top TUI Screens3-10 IB0054607-01 AFigure 3-15. Error Statistics ScreenThe five error categories are each based

3–iba_top Fabric Performance Monitoriba_top TUI ScreensIB0054607-01 A 3-11Congestion:Port Transmit Discards (neighbor port)Port Transmit Congestion (n

vi IB0054607-01 AFastFabric 7.0 User Guide Command Entry. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3-2Common

3–iba_top Fabric Performance Monitoriba_top TUI Screens3-12 IB0054607-01 AGroup Configuration ScreenThe Group Configuration screen (Figure 3-16) displ

3–iba_top Fabric Performance Monitoriba_top TUI ScreensIB0054607-01 A 3-13Group Focus ScreenThe Group Focus screen (Figure 3-17) displays a list of th

3–iba_top Fabric Performance Monitoriba_top TUI Screens3-14 IB0054607-01 AFigure 3-17. Group Focus ScreenPort Statistics ScreenThe Port Statistics scr

3–iba_top Fabric Performance Monitoriba_top TUI ScreensIB0054607-01 A 3-15Figure 3-18. Port Statistics ScreenCommand Line OptionsThe following command

3–iba_top Fabric Performance Monitoriba_top TUI Screens3-16 IB0054607-01 A4 — STDERR (iba_top)16 — STDERR PaClient-q/--quiet — disable progress report

IB0054607-01 A 4-14 Real-Time Fabric MonitorReal-time Fabric Monitor OverviewThe Real-time Fabric Monitor (RFM) is a TUI based user interactive applic

4–Real-Time Fabric MonitorRFM Screen Layout and User Interaction4-2 IB0054607-01 ASyntaxiba_rfm [-v] [-h<hca>] [-p<port>] [-i<seconds&

4–Real-Time Fabric MonitorRFM Screen Layout and User InteractionIB0054607-01 A 4-3Figure 4-19. RFM Main ScreenThe Views are as follows: Infrastructur

4–Real-Time Fabric MonitorMain Screen4-4 IB0054607-01 AThe screens of RFM are segmented into fixed sections that provide specific information about th

4–Real-Time Fabric MonitorMain ScreenIB0054607-01 A 4-5Command-line SegmentThe Command-line segment of the screen (Figure 4-20) enables the user to su

IB0054607-01 A viiFastFabric 7.0 User Guide Switch Node Screens . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-15Switch

4–Real-Time Fabric MonitorMain Screen4-6 IB0054607-01 A.Selection SegmentThe Selection segment of the screen (Figure 4-20) displays the various Views

4–Real-Time Fabric MonitorView ScreenIB0054607-01 A 4-7 3 — this option selects the Sma Congestion error category 4 — this option selects the Securi

4–Real-Time Fabric MonitorView Screen4-8 IB0054607-01 AFigure 4-21. View ScreenMenu SectionThis section of the screen displays any menu selections ava

4–Real-Time Fabric MonitorView ScreenIB0054607-01 A 4-9 (F)abricView - this menu selection takes the user to the Fabric View main screen, which enabl

4–Real-Time Fabric MonitorView Screen4-10 IB0054607-01 AFigure 4-24. Context SectionThe Context Section will always contain the name of the context an

4–Real-Time Fabric MonitorView ScreenIB0054607-01 A 4-11Figure 4-25. Infrastructure and Fabric View Information SectionThe following are the definitio

4–Real-Time Fabric MonitorView Screen4-12 IB0054607-01 AFigure 4-26. Performance View Error Conditions Information SectionThe following are the defini

4–Real-Time Fabric MonitorView ScreenIB0054607-01 A 4-13Figure 4-27. Performance View Bandwidth Utilization Information SectionThe following are the d

4–Real-Time Fabric MonitorView Screen4-14 IB0054607-01 ASub-Menu SectionDisplays an additional set of minor menu selections that are available. These

4–Real-Time Fabric MonitorInfrastructure View Sub-ScreensIB0054607-01 A 4-15 (cC)rit — forward/reverse switch between utilization and error categorie

viii IB0054607-01 AFastFabric 7.0 User Guide Error Condition Screens . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-49Switch

4–Real-Time Fabric MonitorInfrastructure View Sub-Screens4-16 IB0054607-01 AFigure 4-30. Switch Node Selection Screen (500+ Switch Nodes)

4–Real-Time Fabric MonitorInfrastructure View Sub-ScreensIB0054607-01 A 4-17Switch Node Selection Screen (26-500 Switch Nodes)After selecting a block

4–Real-Time Fabric MonitorInfrastructure View Sub-Screens4-18 IB0054607-01 ASwitch Node Selection Screen (1-25 Switch Nodes)After selecting a block of

4–Real-Time Fabric MonitorInfrastructure View Sub-ScreensIB0054607-01 A 4-19Switch Node Information Selection ScreenFigure 4-33 is an example of the s

4–Real-Time Fabric MonitorInfrastructure View Sub-Screens4-20 IB0054607-01 ASwitch Node Device Information ScreenFigure 4-34 is an example of the scre

4–Real-Time Fabric MonitorInfrastructure View Sub-ScreensIB0054607-01 A 4-21Switch Node Port Selection ScreenFigure 4-35 is an example of the screen f

4–Real-Time Fabric MonitorInfrastructure View Sub-Screens4-22 IB0054607-01 ASwitch Node Port Information Selection ScreenFigure 4-36 is an example of

4–Real-Time Fabric MonitorInfrastructure View Sub-ScreensIB0054607-01 A 4-23Switch Node General Port Information ScreenFigure 4-37 is an example of th

4–Real-Time Fabric MonitorInfrastructure View Sub-Screens4-24 IB0054607-01 ASwitch Node Port Statistics Selection ScreenFigure 4-38 is the screen for

4–Real-Time Fabric MonitorInfrastructure View Sub-ScreensIB0054607-01 A 4-25Switch Node Port Performance ScreenFigure 4-39 is the screen for viewing p

IB0054607-01 A ixFastFabric 7.0 User Guide List of FiguresFigure Page1-1 FastFabric Architecture . . . . . . . . . . . . . . . . . . . . . . . . . .

4–Real-Time Fabric MonitorInfrastructure View Sub-Screens4-26 IB0054607-01 AChannel Adapter (CA) ScreensWhen the user selects the CAs category from th

4–Real-Time Fabric MonitorInfrastructure View Sub-ScreensIB0054607-01 A 4-27CA Selection Screen (1-25 CAs)After selecting a block of 25 CAs or if ther

4–Real-Time Fabric MonitorInfrastructure View Sub-Screens4-28 IB0054607-01 ACA Information Selection ScreenFigure 4-42 is an example of the screen for

4–Real-Time Fabric MonitorInfrastructure View Sub-ScreensIB0054607-01 A 4-29CA Device Information ScreenFigure 4-43 is an example of the screen for vi

4–Real-Time Fabric MonitorInfrastructure View Sub-Screens4-30 IB0054607-01 ACA Port Selection ScreenFigure 4-44 is an example of the screen for select

4–Real-Time Fabric MonitorInfrastructure View Sub-ScreensIB0054607-01 A 4-31CA Port Information Selection ScreenFigure 4-45 is an example of the scree

4–Real-Time Fabric MonitorInfrastructure View Sub-Screens4-32 IB0054607-01 ACA Port General Information ScreenFigure 4-46 is an example of the screen

4–Real-Time Fabric MonitorInfrastructure View Sub-ScreensIB0054607-01 A 4-33CA Port Statistics Selection ScreenFigure 4-47 is an example of the screen

4–Real-Time Fabric MonitorInfrastructure View Sub-Screens4-34 IB0054607-01 ACA Port Performance ScreenFigure 4-48 is an example of the screen for view

4–Real-Time Fabric MonitorFabric View Sub-ScreensIB0054607-01 A 4-35Fabric View Sub-ScreensLink ScreensWhen a user selects the Links category from the