IBM Power Systems E870 Technical Overview And Introduction

Summary of Power Systems E870

  • Page 1

    Draft document for review october 14, 2014 10:19 am redp-5137-00 ibm.Com/redbooks red paper front cover ibm power systems e870 and e880 technical overview and introduction alexandre bicas caldeira younghoon cho james cruickshank bartłomiej grabowski new modular architecture for increased reliability...

  • Page 3

    International technical support organization ibm power systems e870 and e880 technical overview and introduction october 2014 draft document for review october 14, 2014 10:19 am 5137edno.Fm redp-5137-00

  • Page 4

    © copyright international business machines corporation 2014. All rights reserved. Note to u.S. Government users restricted rights -- use, duplication or disclosure restricted by gsa adp schedule contract with ibm corp. 5137edno.Fm draft document for review october 14, 2014 10:19 am first edition (o...

  • Page 5: Contents

    © copyright ibm corp. 2014. All rights reserved. Iii draft document for review october 14, 2014 10:19 am 5137toc.Fm contents notices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Vii trademarks . . . . . . . . . . . ...

  • Page 6

    5137toc.Fm draft document for review october 14, 2014 10:19 am iv ibm power systems e870 and e880 technical overview and introduction 2.1 logical diagrams . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32 2.2 the ibm power8 processor . . ....

  • Page 7

    Contents v draft document for review october 14, 2014 10:19 am 5137toc.Fm 2.11 hardware management console . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 96 2.11.1 hmc code level. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ....

  • Page 8

    5137toc.Fm draft document for review october 14, 2014 10:19 am vi ibm power systems e870 and e880 technical overview and introduction 4.3.2 uncorrectable error introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 150 4.3.3 processor core/cache correctable error hand...

  • Page 9: Notices

    © copyright ibm corp. 2014. All rights reserved. Vii draft document for review october 14, 2014 10:19 am 5137spec.Fm notices this information was developed for products and services offered in the u.S.A. Ibm may not offer the products, services, or features discussed in this document in other countr...

  • Page 10: Trademarks

    5137spec.Fm draft document for review october 14, 2014 10:19 am viii ibm power systems e870 and e880 technical overview and introduction trademarks ibm, the ibm logo, and ibm.Com are trademarks or registered trademarks of international business machines corporation in the united states, other countr...

  • Page 11: Preface

    © copyright ibm corp. 2014. All rights reserved. Ix draft document for review october 14, 2014 10:19 am 5137pref.Fm preface this ibm® redpaper™ publication is a comprehensive guide covering the ibm power system e870 (9119-mme) and ibm power system e880 (9119-mhe) servers that support ibm aix®, ibm i...

  • Page 12: Comments Welcome

    5137pref.Fm draft document for review october 14, 2014 10:19 am x ibm power systems e870 and e880 technical overview and introduction james cruickshank works in the power system client technical specialist team for ibm in the uk. He holds an honors degree in mathematics from the university of leeds....

  • Page 13

    Preface xi draft document for review october 14, 2014 10:19 am 5137pref.Fm 2455 south road poughkeepsie, ny 12601-5400 stay connected to ibm redbooks find us on facebook: http://www.Facebook.Com/ibmredbooks follow us on twitter: http://twitter.Com/ibmredbooks look for us on linkedin: http://www.Link...

  • Page 14

    5137pref.Fm draft document for review october 14, 2014 10:19 am xii ibm power systems e870 and e880 technical overview and introduction.

  • Page 15: General Description

    © copyright ibm corp. 2014. All rights reserved. 1 draft document for review october 14, 2014 10:19 am 5137ch01.Fm chapter 1. General description the ibm power system e870 (9119-mme) and ibm power system e880 (9119-mhe) servers use the latest power8 processor technology that is designed to deliver u...

  • Page 16: 1.1  Systems Overview

    5137ch01.Fm draft document for review october 14, 2014 10:19 am 2 ibm power systems e870 and e880 technical overview and introduction 1.1 systems overview the following sections provide detailed information about the power e870 and power e880 systems. 1.1.1 power e870 server the power e870 (9119-mme...

  • Page 17

    Chapter 1. General description 3 draft document for review october 14, 2014 10:19 am 5137ch01.Fm figure 1-1 shows a single system node power e870 in a t42 rack with two pcie i/o drawers and an exp24s disk drawer. Figure 1-1 a power e870 in a t42 rack 1.1.2 power e880 server the power e880 (9119-mhe)...

  • Page 18

    5137ch01.Fm draft document for review october 14, 2014 10:19 am 4 ibm power systems e870 and e880 technical overview and introduction each optional 19-inch pcie gen3 4u i/o expansion drawer provides twelve pcie gen 3 slots. The i/o expansion drawer connects to the system unit with a pcie x16 to opti...

  • Page 19

    Chapter 1. General description 5 draft document for review october 14, 2014 10:19 am 5137ch01.Fm the scu provides redundant service processor function to the system nodes using flexible service processor (fsp) cables. Each system node has two fsp connections to the system control unit. The scu provi...

  • Page 20

    5137ch01.Fm draft document for review october 14, 2014 10:19 am 6 ibm power systems e870 and e880 technical overview and introduction figure 1-4 shows the front view of the system node. Figure 1-4 front view of the system node figure 1-5 shows the rear view of the system node with notable features h...

  • Page 21

    Chapter 1. General description 7 draft document for review october 14, 2014 10:19 am 5137ch01.Fm unlike the inter-node flex connectors on the power 770 and power 780 servers, the smp cables on the power e870 and e880 servers are fully flexible. These cables do not impose restrictions on allowed rack...

  • Page 22: 1.2  Operating Environment

    5137ch01.Fm draft document for review october 14, 2014 10:19 am 8 ibm power systems e870 and e880 technical overview and introduction 1.1.5 i/o drawers i/o drawers to provide additional pcie adapter slots and sas disk slots are available for the power e870 and e880. More details can be found in sect...

  • Page 23: 1.4  System Features

    Chapter 1. General description 9 draft document for review october 14, 2014 10:19 am 5137ch01.Fm table 1-2 physical dimensions of the power e870 and power e870 figure 1-8 shows a picture of a power e870 system control unit and system node from the front. Figure 1-8 power 870 system control unit and ...

  • Page 24

    5137ch01.Fm draft document for review october 14, 2014 10:19 am 10 ibm power systems e870 and e880 technical overview and introduction 12u for a system with two system node drawers one processor feature per system node. All system nodes must have the same feature: – 4.024 ghz, (4 x 0/8-core) 32-core...

  • Page 25

    Chapter 1. General description 11 draft document for review october 14, 2014 10:19 am 5137ch01.Fm 1.4.2 power e880 system features the following features are available on the power e880: one or two 5u 19-inch rack-mount system node drawers one 2u 19-inch rack-mount system control unit drawer 12u for...

  • Page 26

    5137ch01.Fm draft document for review october 14, 2014 10:19 am 12 ibm power systems e870 and e880 technical overview and introduction 1.4.3 minimum features each power e870 or power e880 initial order must include a minimum of the following items: 1 x processor module – 4.024 ghz, 32-core power8 pr...

  • Page 27

    Chapter 1. General description 13 draft document for review october 14, 2014 10:19 am 5137ch01.Fm when ibm i is the primary operating system, the order must include a minimum of the following items: 1 x specify code – mirrored system disk level, specify code (#0040) – device parity protection-all, s...

  • Page 28

    5137ch01.Fm draft document for review october 14, 2014 10:19 am 14 ibm power systems e870 and e880 technical overview and introduction 1.4.4 power supply features this section describes how the system nodes and system control units are powered. System node power four ac power supplies are required f...

  • Page 29

    Chapter 1. General description 15 draft document for review october 14, 2014 10:19 am 5137ch01.Fm table 1-3 summary of processor features for the power e870 table 1-4 summarizes the processor feature codes for the power e880. Table 1-4 summary of processor features for the power e880 feature code de...

  • Page 30

    5137ch01.Fm draft document for review october 14, 2014 10:19 am 16 ibm power systems e870 and e880 technical overview and introduction 1.4.7 memory features 1600 mhz memory cdimms are available as 64 gb (#em8j), 128 gb (#em8k), 256 gb (#em8l), and 512 gb (#em8m) memory features. Each memory feature ...

  • Page 31: 1.6  I/o Drawers

    Chapter 1. General description 17 draft document for review october 14, 2014 10:19 am 5137ch01.Fm 1.4.8 system node pcie slots each power e870 or power e880 system node enclosure provides eight half-length, half-high x16 pcie gen3 slots. These pcie slots can be used for either low profile pcie adapt...

  • Page 32

    5137ch01.Fm draft document for review october 14, 2014 10:19 am 18 ibm power systems e870 and e880 technical overview and introduction expansion drawer (#emx0) holds two expansion modules which are attached to any two x16 pcie slots in the same system node or in different system nodes. Disk-only i/o...

  • Page 33

    Chapter 1. General description 19 draft document for review october 14, 2014 10:19 am 5137ch01.Fm 1.6.2 i/o drawers and usable pci slot figure 1-10 shows the rear view of the pcie gen3 i/o expansion drawer with the location codes for the pcie adapter slots in the pcie3 6-slot fanout module. Figure 1...

  • Page 34

    5137ch01.Fm draft document for review october 14, 2014 10:19 am 20 ibm power systems e870 and e880 technical overview and introduction slots c1 and c4 in each pcie3 6-slot fanout module are x16 pcie3 buses and slots c2, c3, c5, and c6 are x8 pcie buses. All slots support enhanced error handling (eeh...

  • Page 35

    Chapter 1. General description 21 draft document for review october 14, 2014 10:19 am 5137ch01.Fm 1.7 comparison between models the power e870 offers configuration options where the power8 processor can have one of two processor speeds. Each system node is populated with four single chip modules (sc...

  • Page 36: 1.8  Build to Order

    5137ch01.Fm draft document for review october 14, 2014 10:19 am 22 ibm power systems e870 and e880 technical overview and introduction 1.8 build to order you can do a build to order (also called a la carte ) configuration by using the ibm configurator for e-business (e-config). With it, you specify ...

  • Page 37: 1.11  Management Consoles

    Chapter 1. General description 23 draft document for review october 14, 2014 10:19 am 5137ch01.Fm 1.10.3 upgrade considerations feature conversions are set up for the following items: pcie crypto blind swap cassettes power ifl processor activations power ifl powervm for linux active memory expansion...

  • Page 38: 1.12  System Racks

    5137ch01.Fm draft document for review october 14, 2014 10:19 am 24 ibm power systems e870 and e880 technical overview and introduction in 2014, a new hmc model was announced, machine type 7042-cr8. Hardware features on the cr8 model include a new x86 processor, dual hard drives (raid 1), and redunda...

  • Page 39

    Chapter 1. General description 25 draft document for review october 14, 2014 10:19 am 5137ch01.Fm 1.12.1 ibm 7014 model t00 rack the 1.8-meter (71-inch) model t00 is compatible with past and present ibm power systems. The features of the t00 rack are as follows: 36u (eia units) of usable space. Opti...

  • Page 40

    5137ch01.Fm draft document for review october 14, 2014 10:19 am 26 ibm power systems e870 and e880 technical overview and introduction 1.12.3 ibm 7953 model 94y rack the 2.0-meter (79.3 inch) model 94y rack has the following features: 42u (eia units) weights: – base empty rack: 187 kg (221 lb.) – ma...

  • Page 41

    Chapter 1. General description 27 draft document for review october 14, 2014 10:19 am 5137ch01.Fm when mounting the horizontal pdus it is a good practice to place them almost at the top or almost at the bottom of the rack leaving 2u or more of space at the very top or very bottom of the open for cab...

  • Page 42

    5137ch01.Fm draft document for review october 14, 2014 10:19 am 28 ibm power systems e870 and e880 technical overview and introduction configuration with two pairs of 60a pdus suppling a two system node configuration, four i/o expansion drawers, and four exp24s disk drawers. Figure 1-13 two system n...

  • Page 43

    Chapter 1. General description 29 draft document for review october 14, 2014 10:19 am 5137ch01.Fm power cords can be requested with an initial order of the rack or with a later upgrade of the rack features. The pdus have 12 client-usable iec 320-c13 outlets. There are six groups of two outlets fed b...

  • Page 44

    5137ch01.Fm draft document for review october 14, 2014 10:19 am 30 ibm power systems e870 and e880 technical overview and introduction.

  • Page 45: Architecture and Technical

    © copyright ibm corp. 2014. All rights reserved. 31 draft document for review october 14, 2014 10:19 am 5137ch02.Fm chapter 2. Architecture and technical overview this chapter describes the overall system architecture for the ibm power system e870 (9119-mme) and ibm power system e880 (9119-mhe) serv...

  • Page 46: 2.1  Logical Diagrams

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 32 ibm power systems e870 and e880 technical overview and introduction 2.1 logical diagrams this section contains logical diagrams for the power e870 and e880. Figure 2-1 shows the logical system diagram for a single system node of a po...

  • Page 47

    Chapter 2. Architecture and technical overview 33 draft document for review october 14, 2014 10:19 am 5137ch02.Fm figure 2-2 on page 33 shows the logical system diagram for the system control unit of a power e870 or a power e880. Figure 2-2 logical system diagram for the system control unit power in...

  • Page 48

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 34 ibm power systems e870 and e880 technical overview and introduction flexible symmetric multiprocessing (smp) cables are used to connect system nodes when a power e870 or power e880 is configured with more than one system node. Figure...

  • Page 49

    Chapter 2. Architecture and technical overview 35 draft document for review october 14, 2014 10:19 am 5137ch02.Fm figure 2-4 shows the smp connection topology for a three-drawer power e880. Figure 2-4 smp connection topology for a three-drawer power e880 t1 t2 t5 t6 t3 t4 p3 x3 x1 x0 a2 a1 a0 dr aw ...

  • Page 50

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 36 ibm power systems e870 and e880 technical overview and introduction figure 2-5 shows the smp connection topology for a four-drawer power e880. Figure 2-5 smp connection topology for a four-drawer power e880 2.2 the ibm power8 process...

  • Page 51

    Chapter 2. Architecture and technical overview 37 draft document for review october 14, 2014 10:19 am 5137ch02.Fm 2.2.1 power8 processor overview the power8 processor is manufactured using the ibm 22 nm silicon-on-insulator (soi) technology. Each chip is 649 mm 2 and contains 4.2 billion transistors...

  • Page 52

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 38 ibm power systems e870 and e880 technical overview and introduction the following are additional features that can augment the performance of the power8 processor: support for ddr3 and ddr4 memory through memory buffer chips that off...

  • Page 53

    Chapter 2. Architecture and technical overview 39 draft document for review october 14, 2014 10:19 am 5137ch02.Fm table 2-1 summarizes the technology characteristics of the power8 processor. Table 2-1 summary of power8 processor technology 2.2.2 power8 processor core the power8 processor core is a 6...

  • Page 54

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 40 ibm power systems e870 and e880 technical overview and introduction more information about power isa version 2.07 can be found at the following website: https://www.Power.Org/documentation/power-isa-version-2-07/ figure 2-8 shows a p...

  • Page 55

    Chapter 2. Architecture and technical overview 41 draft document for review october 14, 2014 10:19 am 5137ch02.Fm table 2-2 smt levels that are supported by power processors the architecture of the power8 processor, with its larger caches, larger cache bandwidth, and faster memory, allows threads to...

  • Page 56

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 42 ibm power systems e870 and e880 technical overview and introduction figure 2-9 gives a simple overview of the power8 processor memory access structure in the power e870 and power e880. Figure 2-9 overview of power8 memory access stru...

  • Page 57

    Chapter 2. Architecture and technical overview 43 draft document for review october 14, 2014 10:19 am 5137ch02.Fm no off-chip driver or receivers removing drivers or receivers from the l3 access path lowers interface requirements, conserves energy, and lowers latency. Small physical footprint the pe...

  • Page 58

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 44 ibm power systems e870 and e880 technical overview and introduction for more information about the power8 memory subsystem, see 2.3, “memory subsystem” on page 47. 2.2.7 hardware transactional memory transactional memory is an altern...

  • Page 59

    Chapter 2. Architecture and technical overview 45 draft document for review october 14, 2014 10:19 am 5137ch02.Fm processor. From the practical perspective, capi allows a specialized hardware accelerator to be seen as an additional processor in the system, with access to the main system memory, and ...

  • Page 60

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 46 ibm power systems e870 and e880 technical overview and introduction 2.2.9 power management and system performance the power8 processor has power saving and performance enhancing features that can be used to lower overall energy usage...

  • Page 61: 2.3  Memory Subsystem

    Chapter 2. Architecture and technical overview 47 draft document for review october 14, 2014 10:19 am 5137ch02.Fm 2.2.10 comparison of the power7, power7+, and power8 processors table 2-4 shows comparable characteristics between the generations of power7, power7+, and power8 processors. Table 2-4 co...

  • Page 62

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 48 ibm power systems e870 and e880 technical overview and introduction provide memory expansion up to 125%, depending on the workload type and its memory usage. As an example, a server with 256 gb of ram physically installed can effecti...

  • Page 63

    Chapter 2. Architecture and technical overview 49 draft document for review october 14, 2014 10:19 am 5137ch02.Fm a detailed diagram of the cdimms available for the power e870 and power e880 can be seen in figure 2-12. Figure 2-12 short cdimm and tall cdimm details the memory buffer is a l4 cache an...

  • Page 64

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 50 ibm power systems e870 and e880 technical overview and introduction memory for both servers is 256 gb of ram, whereas they can have a minimum of 128 gb of ram active. For the power e870 the following memory options are orderable: 64 ...

  • Page 65

    Chapter 2. Architecture and technical overview 51 draft document for review october 14, 2014 10:19 am 5137ch02.Fm a physical diagram with the location codes of the memory cdimms of a system node, as well as their grouping as memory quads can be seen on figure 2-14 on page 51. Figure 2-14 system node...

  • Page 66

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 52 ibm power systems e870 and e880 technical overview and introduction table 2-5 shows the cdimm plugging order for a power e870 or e880 with a single system node: table 2-5 optimal cdimm memory quad placement for a single system node t...

  • Page 67

    Chapter 2. Architecture and technical overview 53 draft document for review october 14, 2014 10:19 am 5137ch02.Fm table 2-7 shows the cdimm plugging order for a power e880 with a three system nodes: table 2-7 optimal cdimm memory quad placement for three system nodes system node 1 processor 0 proces...

  • Page 68

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 54 ibm power systems e870 and e880 technical overview and introduction table 2-8 shows the cdimm plugging order for a power e880 with a four system nodes: table 2-8 optimal cdimm memory quad placement for four system nodes 2.3.3 memory ...

  • Page 69

    Chapter 2. Architecture and technical overview 55 draft document for review october 14, 2014 10:19 am 5137ch02.Fm on figure 2-15 on page 55 there is an example of the minimum required activations for a system with 1 tb of installed memory. Figure 2-15 example of the minimum required activations for ...

  • Page 70

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 56 ibm power systems e870 and e880 technical overview and introduction table 2-10 power e870 single core bandwidth estimates the bandwidth figures for the caches are calculated as follows: l1 cache: in one clock cycle, two 16-byte load ...

  • Page 71

    Chapter 2. Architecture and technical overview 57 draft document for review october 14, 2014 10:19 am 5137ch02.Fm for the entire power e870 system populated with two system nodes, the overall bandwidths are what is shown in table 2-12 on page 57. Table 2-12 power e870 total bandwidth estimates power...

  • Page 72

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 58 ibm power systems e870 and e880 technical overview and introduction table 2-14 power e880 system node bandwidth estimates pcie interconnect: each power8 processor has 32 pcie lanes running at 7.877 gbps full-duplex. The bandwidth for...

  • Page 73

    Chapter 2. Architecture and technical overview 59 draft document for review october 14, 2014 10:19 am 5137ch02.Fm active memory mirroring (amm) is included with all power e870 and power e880 systems at no additional charge. It can be enabled, disabled, or re-enabled depending on the user’s requireme...

  • Page 74: 2.4  Capacity On Demand

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 60 ibm power systems e870 and e880 technical overview and introduction with amm, uncorrectable errors in data that are owned by a partition or application are handled by the existing special uncorrectable error handling methods in the h...

  • Page 75

    Chapter 2. Architecture and technical overview 61 draft document for review october 14, 2014 10:19 am 5137ch02.Fm units can be permanently activated by purchasing an activation feature called capacity upgrade on demand (cuod) and entering the provided activation code on your server. With the cuod of...

  • Page 76

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 62 ibm power systems e870 and e880 technical overview and introduction table 2-16 power systems capacity upgrade on demand static processor activation features the table 2-17 lists the static memory activation features that are availabl...

  • Page 77

    Chapter 2. Architecture and technical overview 63 draft document for review october 14, 2014 10:19 am 5137ch02.Fm after a power enterprise pool is created, the hmc can be used to perform the following functions: mobile cod processor and memory resources can be assigned to systems with inactive resou...

  • Page 78

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 64 ibm power systems e870 and e880 technical overview and introduction this offering provides a system administrator an interface at the hmc to manage the activation and deactivation of resources. A monitor that resides on the server re...

  • Page 79

    Chapter 2. Architecture and technical overview 65 draft document for review october 14, 2014 10:19 am 5137ch02.Fm for more information about registration, enablement, and usage of elastic cod, visit the following location: http://www.Ibm.Com/systems/power/hardware/cod 2.4.4 utility capacity on deman...

  • Page 80: 2.5  System Bus

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 66 ibm power systems e870 and e880 technical overview and introduction 2.4.6 software licensing and cod for software licensing considerations with the various cod offerings, see the most recent revision of the power systems capacity on ...

  • Page 81

    Chapter 2. Architecture and technical overview 67 draft document for review october 14, 2014 10:19 am 5137ch02.Fm attached to exp24s sff gen2 drawers. The exp24s can be either attached to sas adapters on the system nodes or on the pcie expansion drawer. For a list of adapters and their supported slo...

  • Page 82: 2.6  Internal I/o Subsystem

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 68 ibm power systems e870 and e880 technical overview and introduction the cables necessary for each system node have been grouped under a single feature code, allowing for an easier configuration. Each cable set includes a pair of fsp ...

  • Page 83

    Chapter 2. Architecture and technical overview 69 draft document for review october 14, 2014 10:19 am 5137ch02.Fm the physical location of the slots can be seen on figure 2-20. Figure 2-20 system node top view and pcie slot location codes 2.6.1 blind-swap cassettes the power e870 and power e880 use ...

  • Page 84: 2.7  Pci Adapters

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 70 ibm power systems e870 and e880 technical overview and introduction 2.6.2 system ports the system nodes do not have integrated ports. All networking and storage for the virtual machines must pre provided via pcie adapters installed i...

  • Page 85

    Chapter 2. Architecture and technical overview 71 draft document for review october 14, 2014 10:19 am 5137ch02.Fm ibm power8 processor-based servers can support two different form factors of pcie adapters: pcie low profile (lp) cards, which are used with system node pcie slots. Pcie full height and ...

  • Page 86

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 72 ibm power systems e870 and e880 technical overview and introduction 2.7.3 graphics accelerator adapters table 2-23 lists the available graphics accelerator adapters. An adapter can be configured to operate in either 8-bit or 24-bit c...

  • Page 87

    Chapter 2. Architecture and technical overview 73 draft document for review october 14, 2014 10:19 am 5137ch02.Fm 2.7.5 fibre channel adapter the systems support direct or san connection to devices that use fibre channel adapters. Table 2-25 summarizes the available fibre channel adapters, which all...

  • Page 88

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 74 ibm power systems e870 and e880 technical overview and introduction 2.7.6 fibre channel over ethernet fibre channel over ethernet (fcoe) allows for the convergence of fibre channel and ethernet traffic onto a single adapter and a con...

  • Page 89

    Chapter 2. Architecture and technical overview 75 draft document for review october 14, 2014 10:19 am 5137ch02.Fm table 2-27 lists the available asynchronous and usb adapters. Table 2-27 available asynchronous and usb adapters 2.7.8 infiniband host channel adapter the infiniband architecture (iba) i...

  • Page 90: 2.8  Internal Storage

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 76 ibm power systems e870 and e880 technical overview and introduction ability to configure adapter as coprocessor or accelerator support for smart card applications using europay, mastercard and visa cryptographic key generation and ra...

  • Page 91

    Chapter 2. Architecture and technical overview 77 draft document for review october 14, 2014 10:19 am 5137ch02.Fm it is also important to note that several daily functions where a dvd drive was needed can now be executed by using other methods like virtual media repository on the virtual i/o server ...

  • Page 92

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 78 ibm power systems e870 and e880 technical overview and introduction concurrent repair and add/removal of pcie adapter cards is done by hmc guided menus or by operating system support utilities. A blind swap cassette (bsc) is used to ...

  • Page 93

    Chapter 2. Architecture and technical overview 79 draft document for review october 14, 2014 10:19 am 5137ch02.Fm connect the other end of the optical cable to connector t1 on one of the pcie3 6-slot fanout modules in your expansion drawer. Connect another cable to connector t2 on the pcie3 optical ...

  • Page 94

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 80 ibm power systems e870 and e880 technical overview and introduction figure 2-26 shows typical optical cable connections. Figure 2-26 typical optical cable connection general rules for the pci gen3 i/o expansion drawer configuration t...

  • Page 95

    Chapter 2. Architecture and technical overview 81 draft document for review october 14, 2014 10:19 am 5137ch02.Fm figure 2-27 shows example of a single system node and two pci gen3 i/o expansion drawers. Figure 2-27 example of a single system node and two i/o drawers left fanout right fanout left fa...

  • Page 96

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 82 ibm power systems e870 and e880 technical overview and introduction figure 2-28 shows an example of two system nodes and two pci gen3 i/o expansion drawers. Figure 2-28 example of two system nodes and two i/o drawers left fanout righ...

  • Page 97

    Chapter 2. Architecture and technical overview 83 draft document for review october 14, 2014 10:19 am 5137ch02.Fm figure 2-29 shows an example of two system node and four pci gen3 i/o expansion drawers. Figure 2-29 example of two system nodes and four i/o drawers 2.9.3 pcie gen3 i/o expansion drawer...

  • Page 98

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 84 ibm power systems e870 and e880 technical overview and introduction 2.10 external disk subsystems this section describes the following external disk subsystems that can be attached to the power e870 and power e880 system: exp24s sff ...

  • Page 99

    Chapter 2. Architecture and technical overview 85 draft document for review october 14, 2014 10:19 am 5137ch02.Fm with aix, linux, and vios, you can order the exp24s with four sets of six bays, two sets of 12 bays, or one set of 24 bays (mode 4, 2, or 1). With ibm i, you can order the exp24s as one ...

  • Page 100

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 86 ibm power systems e870 and e880 technical overview and introduction figure 2-31 on page 86 shows the mode stickers. Figure 2-31 mode sticker locations at the rear of the 5887 disk drive enclosure.

  • Page 101

    Chapter 2. Architecture and technical overview 87 draft document for review october 14, 2014 10:19 am 5137ch02.Fm the exp24s sas ports are attached to a sas pcie adapter or pair of adapters using sas yo or x cables. Cable length varies depending on the feature code and proper length should be calcul...

  • Page 102

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 88 ibm power systems e870 and e880 technical overview and introduction there are six sas connectors on the rear of the exp24s drawer to which to sas adapters or controllers are attached. They are labeled t1, t2, and t3; there are two t1...

  • Page 103

    Chapter 2. Architecture and technical overview 89 draft document for review october 14, 2014 10:19 am 5137ch02.Fm figure 2-33 on page 89 shows the rear connectors of the exp24s drawer, how they relate with the modes of operation, and disk grouping. Figure 2-33 rear view of exp24s with the 3 modes of...

  • Page 104

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 90 ibm power systems e870 and e880 technical overview and introduction scenario 1 - basic non-redundant connection this scenario assumes a single virtual i/o server with a single pcie sas adapter #5901 and a exp24s set on mode 1, allowi...

  • Page 105

    Chapter 2. Architecture and technical overview 91 draft document for review october 14, 2014 10:19 am 5137ch02.Fm scenario 2 - basic redundant connection this scenario assumes a single virtual i/o server with two pcie sas adapter #5901 and a exp24s set on mode 1, allowing for up to 24 disks to be at...

  • Page 106

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 92 ibm power systems e870 and e880 technical overview and introduction scenario 3 - dual virtual i/o servers sharing a single exp24s this scenario assumes a dual virtual i/o server with two pcie sas adapter #5901 each and a exp24s set o...

  • Page 107

    Chapter 2. Architecture and technical overview 93 draft document for review october 14, 2014 10:19 am 5137ch02.Fm scenario 4 - dual virtual i/o servers sharing two exp24s this scenario assumes a dual virtual i/o server with two pcie sas adapter #5901 each and two exp24s set on mode 2, allowing for u...

  • Page 108

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 94 ibm power systems e870 and e880 technical overview and introduction scenario 5 - four virtual i/o servers sharing two exp24s this scenario assumes four virtual i/o server with two pcie sas adapter #5901 each and two exp24s set on mod...

  • Page 109

    Chapter 2. Architecture and technical overview 95 draft document for review october 14, 2014 10:19 am 5137ch02.Fm 2.10.3 ibm system storage the ibm system storage disk systems products and offerings provide compelling storage solutions with superior value for all levels of business, from entry-level...

  • Page 110

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 96 ibm power systems e870 and e880 technical overview and introduction additionally, the ibm system storage ds8000® includes a range of features that automate performance optimization and application quality of service, and also provide...

  • Page 111

    Chapter 2. Architecture and technical overview 97 draft document for review october 14, 2014 10:19 am 5137ch02.Fm hmc command to initiate a remote restart operation this removes the requirement of vmcontrol for the powervm remote restart function. Updated web browser support: – mozilla firefox esr 1...

  • Page 112

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 98 ibm power systems e870 and e880 technical overview and introduction 2.11.3 hmc connectivity to the power8 processor-based systems power8 processor-based servers, and their predecessor systems, that are managed by an hmc require ether...

  • Page 113

    Chapter 2. Architecture and technical overview 99 draft document for review october 14, 2014 10:19 am 5137ch02.Fm if the service processor of the managed server does not receive a dhcp reply before timeout, predefined ip addresses are set up on both ports. Static ip address allocation is also an opt...

  • Page 114

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 100 ibm power systems e870 and e880 technical overview and introduction figure 2-40 shows one possible highly available hmc configuration that is managing two servers. Each hmc is connected to one fsp port of each managed server. Figure...

  • Page 115

    Chapter 2. Architecture and technical overview 101 draft document for review october 14, 2014 10:19 am 5137ch02.Fm 2.12.1 virtual i/o server the minimum required level of virtual i/o server for both the power e870 and power e880 is vios 2.2.3.4 with ifix iv63331 or later. Ibm regularly updates the v...

  • Page 116

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 102 ibm power systems e870 and e880 technical overview and introduction ibm aix version 7.1 a partition that uses aix 7.1 can run in power6, power6+, power7, or power8 mode. This allows for an easier migration from previous systems and ...

  • Page 117

    Chapter 2. Architecture and technical overview 103 draft document for review october 14, 2014 10:19 am 5137ch02.Fm linux operating system licenses are ordered separately from the hardware. You can acquire linux operating system licenses from ibm to be included with the power7+ processor-based server...

  • Page 118

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 104 ibm power systems e870 and e880 technical overview and introduction ibm cobol for aix enables you to selectively target code generation of your programs to either exploit a particular power systems architecture or to be balanced amo...

  • Page 119: 2.13  Energy Management

    Chapter 2. Architecture and technical overview 105 draft document for review october 14, 2014 10:19 am 5137ch02.Fm 2.13 energy management the power e870 and power e880 systems have features to help clients become more energy efficient. Energyscale technology enables advanced energy management featur...

  • Page 120

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 106 ibm power systems e870 and e880 technical overview and introduction table 2-33 maximum frequency boosts for power e870 and e880 processors the frequency boost figures are maximums and will depend on the environment where the servers...

  • Page 121

    Chapter 2. Architecture and technical overview 107 draft document for review october 14, 2014 10:19 am 5137ch02.Fm processor chip winkle mode the most amount of energy can be saved when a whole power8 chiplet enters the winkle mode. In this mode, the entire chiplet is turned off, including the l3 ca...

  • Page 122

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 108 ibm power systems e870 and e880 technical overview and introduction server power down if overall data center processor usage is low, workloads can be consolidated on fewer numbers of servers so that some servers can be turned off co...

  • Page 123

    Chapter 2. Architecture and technical overview 109 draft document for review october 14, 2014 10:19 am 5137ch02.Fm the on-die nature of the occ allows for approximately 100× speedup in response to workload changes over power7+, enabling reaction under the timescale of a typical os time slice and all...

  • Page 124

    5137ch02.Fm draft document for review october 14, 2014 10:19 am 110 ibm power systems e870 and e880 technical overview and introduction.

  • Page 125: Virtualization

    © copyright ibm corp. 2014. All rights reserved. 111 draft document for review october 14, 2014 10:19 am 5137ch03.Fm chapter 3. Virtualization as you look for ways to maximize the return on your it infrastructure investments, consolidating workloads becomes an attractive proposition. Ibm power syste...

  • Page 126: 3.1  Ibm Power Hypervisor

    5137ch03.Fm draft document for review october 14, 2014 10:19 am 112 ibm power systems e870 and e880 technical overview and introduction 3.1 ibm power hypervisor combined with features in the power8 processors, the ibm power hypervisor delivers functions that enable other system technologies, includi...

  • Page 127

    Chapter 3. Virtualization 113 draft document for review october 14, 2014 10:19 am 5137ch03.Fm 3.1.1 virtual scsi the power hypervisor provides a virtual scsi mechanism for the virtualization of storage devices. The storage virtualization is accomplished by using two paired adapters: a virtual scsi s...

  • Page 128

    5137ch03.Fm draft document for review october 14, 2014 10:19 am 114 ibm power systems e870 and e880 technical overview and introduction 3.1.3 virtual fibre channel a virtual fibre channel adapter is a virtual adapter that provides client logical partitions with a fibre channel connection to a storag...

  • Page 129: 3.2  Power Processor Modes

    Chapter 3. Virtualization 115 draft document for review october 14, 2014 10:19 am 5137ch03.Fm 3.2 power processor modes although they are not virtualization features, the power processor modes are described here because they affect various virtualization features. On power system servers, partitions...

  • Page 130

    5137ch03.Fm draft document for review october 14, 2014 10:19 am 116 ibm power systems e870 and e880 technical overview and introduction figure 3-2 shows the compatibility modes within the lpar profile. Figure 3-2 configuring partition profile compatibility mode using the hmc table 3-2 lists the diff...

  • Page 131

    Chapter 3. Virtualization 117 draft document for review october 14, 2014 10:19 am 5137ch03.Fm 3.3 active memory expansion active memory expansion is a optional feature for the enterprise servers power e870 and power e880. This feature enables memory expansion on the system. By using compression and ...

  • Page 132: 3.4  Powervm

    5137ch03.Fm draft document for review october 14, 2014 10:19 am 118 ibm power systems e870 and e880 technical overview and introduction for more information about active memory expansion, download the document active memory expansion: overview and usage guide, found at: http://public.Dhe.Ibm.Com/com...

  • Page 133

    Chapter 3. Virtualization 119 draft document for review october 14, 2014 10:19 am 5137ch03.Fm micro-partitioning when you use the micro-partitioning technology, you can allocate fractions of processors to a logical partition. This technology was introduced with power5 processor-based systems. A logi...

  • Page 134

    5137ch03.Fm draft document for review october 14, 2014 10:19 am 120 ibm power systems e870 and e880 technical overview and introduction the power e880 has statement of direction to support up to 192 cores in a single system. Here are the maximum numbers: 192 dedicated partitions 1024 micropartitions...

  • Page 135

    Chapter 3. Virtualization 121 draft document for review october 14, 2014 10:19 am 5137ch03.Fm processing mode when you create a logical partition, you can assign entire processors for dedicated use, or you can assign partial processing units from a shared processor pool. This setting defines the pro...

  • Page 136

    5137ch03.Fm draft document for review october 14, 2014 10:19 am 122 ibm power systems e870 and e880 technical overview and introduction shared mode in shared mode, logical partitions use virtual processors to access fractions of physical processors. Shared partitions can define any number of virtual...

  • Page 137

    Chapter 3. Virtualization 123 draft document for review october 14, 2014 10:19 am 5137ch03.Fm micropartitions are created and then identified as members of either the default shared processor pool 0 or a user-defined shared processor pool n . The virtual processors that exist within the set of micro...

  • Page 138

    5137ch03.Fm draft document for review october 14, 2014 10:19 am 124 ibm power systems e870 and e880 technical overview and introduction because the vios is an operating system-based appliance server, redundancy for physical devices that are attached to the vios can be provided by using capabilities ...

  • Page 139

    Chapter 3. Virtualization 125 draft document for review october 14, 2014 10:19 am 5137ch03.Fm figure 3-6 shows a configuration example of an sea with one physical and two virtual ethernet adapters. An sea can include up to 16 virtual ethernet adapters on the vios that shares the physical access. Fig...

  • Page 140

    5137ch03.Fm draft document for review october 14, 2014 10:19 am 126 ibm power systems e870 and e880 technical overview and introduction the virtual i/o adapters (virtual scsi server adapter and a virtual scsi client adapter) are configured by using a managed console or through the integrated virtual...

  • Page 141

    Chapter 3. Virtualization 127 draft document for review october 14, 2014 10:19 am 5137ch03.Fm system planning tool (spt) and workload estimator, which are designed to ease the deployment of a virtualized infrastructure. For more information about the system planning tool, see 3.5, “system planning t...

  • Page 142

    5137ch03.Fm draft document for review october 14, 2014 10:19 am 128 ibm power systems e870 and e880 technical overview and introduction with server evacuation feature, multiple migrations can occur based on the concurrency setting of the hmc. Migrations are performed as sets, with the next set of mi...

  • Page 143

    Chapter 3. Virtualization 129 draft document for review october 14, 2014 10:19 am 5137ch03.Fm for more information regarding active memory sharing, see ibm powervm virtualization active memory sharing, redp-4470. 3.4.7 active memory deduplication in a virtualized environment, the systems might have ...

  • Page 144

    5137ch03.Fm draft document for review october 14, 2014 10:19 am 130 ibm power systems e870 and e880 technical overview and introduction for more information about specific features for linux, see the following website: http://pic.Dhe.Ibm.Com/infocenter/lnxinfo/v3r0m0/index.Jsp?Topic=%2fliaam%2fsuppo...

  • Page 145

    Chapter 3. Virtualization 131 draft document for review october 14, 2014 10:19 am 5137ch03.Fm for more information about specific linux distributions, see the following website: http://pic.Dhe.Ibm.Com/infocenter/lnxinfo/v3r0m0/index.Jsp?Topic=%2fliaam%2fliaamd istros.Htm 3.4.10 powervm simplificatio...

  • Page 146

    5137ch03.Fm draft document for review october 14, 2014 10:19 am 132 ibm power systems e870 and e880 technical overview and introduction figure 3-7 shows new options starting from the hmc firmware v8r1 that are available for powervm simplification. Selecting manage powervm opens a new window, where a...

  • Page 147

    Chapter 3. Virtualization 133 draft document for review october 14, 2014 10:19 am 5137ch03.Fm using these options, a user can deploy a system, select a system template, and click deploy. After deploying a system, a user can choose a partition template from the library. Performance the performance fu...

  • Page 148

    5137ch03.Fm draft document for review october 14, 2014 10:19 am 134 ibm power systems e870 and e880 technical overview and introduction figure 3-9 shows the bottom of the window where performance and capacity data are presented in a graphical format. Figure 3-9 hmc performance monitoring cpu memory ...

  • Page 149

    Chapter 3. Virtualization 135 draft document for review october 14, 2014 10:19 am 5137ch03.Fm new gui functions as part of the enhancements introduced in this version, this new capability aids in the management of powervm from a single ui. Figure 3-10 shows all virtualization components are now disp...

  • Page 150

    5137ch03.Fm draft document for review october 14, 2014 10:19 am 136 ibm power systems e870 and e880 technical overview and introduction 3.4.11 single view of all virtual i/o servers the manage virtual i/o servers function displays a list of vios that are configured in the managed system. It also dis...

  • Page 151

    Chapter 3. Virtualization 137 draft document for review october 14, 2014 10:19 am 5137ch03.Fm the new ui lets the user view the adapter configuration of the virtual storage devices that are allocated to the vios. The adapter view provides a mapping of the adapters to the physical storage device. By ...

  • Page 152

    5137ch03.Fm draft document for review october 14, 2014 10:19 am 138 ibm power systems e870 and e880 technical overview and introduction the following tasks can be completed by using the add virtual network wizard: create internal or bridged networks create tagged or untagged virtual networks create ...

  • Page 153: 3.5  System Planning Tool

    Chapter 3. Virtualization 139 draft document for review october 14, 2014 10:19 am 5137ch03.Fm 3.5 system planning tool the ibm system planning tool (spt) helps you design systems to be partitioned with logical partitions. You can also plan for and design non-partitioned systems by using the spt. The...

  • Page 154

    5137ch03.Fm draft document for review october 14, 2014 10:19 am 140 ibm power systems e870 and e880 technical overview and introduction after the product code is loaded, the ibm powervc no-menus interface guides you through three simple configuration steps to register physical hosts, storage provide...

  • Page 155: 3.8  Vios 2.2.3.4 Features

    Chapter 3. Virtualization 141 draft document for review october 14, 2014 10:19 am 5137ch03.Fm helps better use virtualized ibm power system servers by showing the distribution of workloads can replay saved historical data helps with the resolution of performance-related issues helps to proactively a...

  • Page 156

    5137ch03.Fm draft document for review october 14, 2014 10:19 am 142 ibm power systems e870 and e880 technical overview and introduction twinax ports (#en0k, #en0l, #el3c), sr optical ports (#en0h, #en0j, #el38), and lr optical ports (#en0n, #en0m).Virtual i/o slot limit increase. With vios version 2...

  • Page 157

    Chapter 3. Virtualization 143 draft document for review october 14, 2014 10:19 am 5137ch03.Fm to verify that your managed system can support this capability enter the following command as shown in example 3-1. Example 3-1 power vm remote restart capable hscroot@slcb27a:~>lssyscfg -r sys -m server1 -...

  • Page 158

    5137ch03.Fm draft document for review october 14, 2014 10:19 am 144 ibm power systems e870 and e880 technical overview and introduction the capability is only displayed if the managed system supports it. To activate a partition on a supported system to support dynamic partition remote restart, enter...

  • Page 159: Serviceability

    © copyright ibm corp. 2014. All rights reserved. 145 draft document for review october 14, 2014 10:19 am 5137ch04.Fm chapter 4. Reliability, availability, and serviceability this chapter provides information about ibm power systems reliability, availability, and serviceability (ras) design and featu...

  • Page 160: 4.1  Introduction

    5137ch04.Fm draft document for review october 14, 2014 10:19 am 146 ibm power systems e870 and e880 technical overview and introduction 4.1 introduction the power8 processor-based servers are available in two different classes: scale-out systems: for environments consisting of multiple systems worki...

  • Page 161: 4.2  Reliability

    Chapter 4. Reliability, availability, and serviceability 147 draft document for review october 14, 2014 10:19 am 5137ch04.Fm the processor design now supports a spare data lane on each fabric bus, which is used to communicate between processor modules. A spare data lane can be substituted for a fail...

  • Page 162

    5137ch04.Fm draft document for review october 14, 2014 10:19 am 148 ibm power systems e870 and e880 technical overview and introduction processor module, which generates a pcie bus directly from the processor module. Parts selection also plays a critical role in overall system reliability. Ibm uses ...

  • Page 163

    Chapter 4. Reliability, availability, and serviceability 149 draft document for review october 14, 2014 10:19 am 5137ch04.Fm 4.3 processor/memory availability details the more reliable a system or subsystem is, the more available it should be. Nevertheless, considerable effort is made to design syst...

  • Page 164

    5137ch04.Fm draft document for review october 14, 2014 10:19 am 150 ibm power systems e870 and e880 technical overview and introduction 4.3.2 uncorrectable error introduction an uncorrectable error can be defined as a fault that can cause incorrect instruction execution within logic functions, or an...

  • Page 165

    Chapter 4. Reliability, availability, and serviceability 151 draft document for review october 14, 2014 10:19 am 5137ch04.Fm 4.3.5 alternative processor recovery and partition availability priority if processor instruction retry for a fault within a core occurs multiple times without success, the fa...

  • Page 166

    5137ch04.Fm draft document for review october 14, 2014 10:19 am 152 ibm power systems e870 and e880 technical overview and introduction nothing within the system terminates just because such an event is encountered. Rather, the hardware monitors the usage of pages with marks. If such data is never u...

  • Page 167

    Chapter 4. Reliability, availability, and serviceability 153 draft document for review october 14, 2014 10:19 am 5137ch04.Fm 4.3.10 memory protection power8 processor-based systems have a three-part memory subsystem design. This design consists of two memory controllers in each processor module, whi...

  • Page 168

    5137ch04.Fm draft document for review october 14, 2014 10:19 am 154 ibm power systems e870 and e880 technical overview and introduction for each such port, there are eight dram modules worth of data (64 bits) plus another dram module’s worth of error correction and other such data. There is also a s...

  • Page 169

    Chapter 4. Reliability, availability, and serviceability 155 draft document for review october 14, 2014 10:19 am 5137ch04.Fm or a pcie switch. The integrated pcie controller supports try again (end-point error recovery) and freezing. Ibm device drivers under aix are fully eeh-capable. For linux unde...

  • Page 170

    5137ch04.Fm draft document for review october 14, 2014 10:19 am 156 ibm power systems e870 and e880 technical overview and introduction 4.4 enterprise systems availability details besides all the standard ras features described, enterprise class systems allows for increased ras and availability by i...

  • Page 171

    Chapter 4. Reliability, availability, and serviceability 157 draft document for review october 14, 2014 10:19 am 5137ch04.Fm by working in a redundant architecture, some tasks that would require that a given application would be brought offline, can now be execute with the application running, allow...

  • Page 172

    5137ch04.Fm draft document for review october 14, 2014 10:19 am 158 ibm power systems e870 and e880 technical overview and introduction group or rootvg. The rootvg can be accessed through a san, the same as the data that partitions use. Alternatively, a vios can use storage locally attached to a ser...

  • Page 173

    Chapter 4. Reliability, availability, and serviceability 159 draft document for review october 14, 2014 10:19 am 5137ch04.Fm lpm also needs that all systems in the lpm cluster be attached to the same san (when using san for required common storage) which typically requires use of fibre channel adapt...

  • Page 174

    5137ch04.Fm draft document for review october 14, 2014 10:19 am 160 ibm power systems e870 and e880 technical overview and introduction externally to each system, redundant hardware management consoles (hmcs) can be utilized for greater availability. There can also be options to maintain redundancy ...

  • Page 175

    Chapter 4. Reliability, availability, and serviceability 161 draft document for review october 14, 2014 10:19 am 5137ch04.Fm figure 4-6 on page 161 illustrates how such a system could be configured to maximize redundancy in a vios environment, presuming the rootvgs for each vios are accessed from st...

  • Page 176: 4.6  Serviceability

    5137ch04.Fm draft document for review october 14, 2014 10:19 am 162 ibm power systems e870 and e880 technical overview and introduction for enterprise class systems, i/o drawers for expanding i/o are supported. When these drawers are used, all the slots connected to a pcie adapter for expansion draw...

  • Page 177

    Chapter 4. Reliability, availability, and serviceability 163 draft document for review october 14, 2014 10:19 am 5137ch04.Fm the serviceability features that are delivered in this system provide a highly efficient service environment by incorporating the following attributes: design for customer set...

  • Page 178

    5137ch04.Fm draft document for review october 14, 2014 10:19 am 164 ibm power systems e870 and e880 technical overview and introduction 4.6.3 service processor in power8 processor-based systems with a dedicated service processor, the dedicated service processor is primarily responsible for fault ana...

  • Page 179

    Chapter 4. Reliability, availability, and serviceability 165 draft document for review october 14, 2014 10:19 am 5137ch04.Fm (light path for low-end servers), and access all service processor functions without having to power down the system to the standby state. The administrator or ibm ssr dynamic...

  • Page 180

    5137ch04.Fm draft document for review october 14, 2014 10:19 am 166 ibm power systems e870 and e880 technical overview and introduction run time all power systems servers can monitor critical system components during run time, and they can take corrective actions when recoverable faults occur. The i...

  • Page 181

    Chapter 4. Reliability, availability, and serviceability 167 draft document for review october 14, 2014 10:19 am 5137ch04.Fm wizard. With the new hmc v8r8.1.0 a serviceable event manager is available to block problems from being automatically transferred to ibm. For more information about this topic...

  • Page 182

    5137ch04.Fm draft document for review october 14, 2014 10:19 am 168 ibm power systems e870 and e880 technical overview and introduction sfp application on the ivm for providing service functions and interfaces on non-hmc partitioned servers. Extended error data extended error data (eed) is additiona...

  • Page 183

    Chapter 4. Reliability, availability, and serviceability 169 draft document for review october 14, 2014 10:19 am 5137ch04.Fm home feature starts the service organization so that the appropriate service action can begin. Call home can be done through hmc or most non-hmc managed systems. Although conf...

  • Page 184

    5137ch04.Fm draft document for review october 14, 2014 10:19 am 170 ibm power systems e870 and e880 technical overview and introduction light path the light path led function is for scale-out systems that can be repaired by clients. In the light path led implementation, when a fault condition is det...

  • Page 185: 4.7  Manageability

    Chapter 4. Reliability, availability, and serviceability 171 draft document for review october 14, 2014 10:19 am 5137ch04.Fm in addition to the previously mentioned components, the operator panel can be replaced concurrently by using service functions of the asmi menu. Repair and verify services rep...

  • Page 186

    5137ch04.Fm draft document for review october 14, 2014 10:19 am 172 ibm power systems e870 and e880 technical overview and introduction the service processor operating system has specific programs and device drivers for the service processor hardware. The host interface is a processor support interf...

  • Page 187

    Chapter 4. Reliability, availability, and serviceability 173 draft document for review october 14, 2014 10:19 am 5137ch04.Fm use the asmi to change the service processor ip addresses or to apply certain security policies and prevent access from unwanted ip addresses or ranges. You might be able to u...

  • Page 188

    5137ch04.Fm draft document for review october 14, 2014 10:19 am 174 ibm power systems e870 and e880 technical overview and introduction by pulling it out to access the switches and viewing the lcd display here are several of the operator panel features: a 2 x 16 character lcd display reset, enter, p...

  • Page 189

    Chapter 4. Reliability, availability, and serviceability 175 draft document for review october 14, 2014 10:19 am 5137ch04.Fm ibm i and its associated machine code provide dedicated service tools (dsts) as part of the ibm i licensed machine code (licensed internal code) and system service tools (ssts...

  • Page 190

    5137ch04.Fm draft document for review october 14, 2014 10:19 am 176 ibm power systems e870 and e880 technical overview and introduction in addition, you can use the manage serviceable events task to initiate service functions on systems and logical partitions, including the exchanging of parts, conf...

  • Page 191

    Chapter 4. Reliability, availability, and serviceability 177 draft document for review october 14, 2014 10:19 am 5137ch04.Fm if the system is managed by a management console, you use the management console for firmware updates. By using the management console, you can take advantage of the cfm optio...

  • Page 192

    5137ch04.Fm draft document for review october 14, 2014 10:19 am 178 ibm power systems e870 and e880 technical overview and introduction each ibm power systems server has the following levels of server firmware and power subsystem firmware: installed level this level of server firmware or power subsy...

  • Page 193

    Chapter 4. Reliability, availability, and serviceability 179 draft document for review october 14, 2014 10:19 am 5137ch04.Fm table 4-1 firmware naming convention the following example uses the convention: 01sv810_030_030 = power8 entry systems firmware for 8286-41a and 8286-42a an installation is di...

  • Page 194

    5137ch04.Fm draft document for review october 14, 2014 10:19 am 180 ibm power systems e870 and e880 technical overview and introduction electronic services news page the electronic services news page is a single internet entry point that replaces the multiple entry points that traditionally are used...

  • Page 195

    Chapter 4. Reliability, availability, and serviceability 181 draft document for review october 14, 2014 10:19 am 5137ch04.Fm my systems provides valuable reports of installed hardware and software, using information that is collected from the systems by esa. Reports are available for any system that...

  • Page 196

    5137ch04.Fm draft document for review october 14, 2014 10:19 am 182 ibm power systems e870 and e880 technical overview and introduction in the next window, you can configure the hmc that is used to manage the serviceable events and proceed with further configuration steps, as shown in figure 4-10. F...

  • Page 197

    Chapter 4. Reliability, availability, and serviceability 183 draft document for review october 14, 2014 10:19 am 5137ch04.Fm approve call home approves the call home of this event. This option is available only if the event is not approved already. The help / learn more function can be used to get m...

  • Page 198

    5137ch04.Fm draft document for review october 14, 2014 10:19 am 184 ibm power systems e870 and e880 technical overview and introduction inventory collection x x x environmental and power warnings x x x hot-swap dasd / media x x x dual disk controllers / split backplane x x x eed collection x x x sp ...

  • Page 199: Related Publications

    © copyright ibm corp. 2014. All rights reserved. 185 draft document for review october 14, 2014 10:19 am 5137bibl.Fm related publications the publications listed in this section are considered particularly suitable for a more detailed discussion of the topics covered in this paper. Ibm redbooks the ...

  • Page 200: Help From Ibm

    5137bibl.Fm draft document for review october 14, 2014 10:19 am 186 ibm power systems e870 and e880 technical overview and introduction ibm power system e870 server specifications http://www.Ibm.Com/systems/power/hardware/e870/specs.Html ibm power system e880 server specifications http://www.Ibm.Com...

  • Page 202: Red

    ® redp-5137-00 draft document for review october 14, 2014 10:19 am international technical support organization building technical information based on practical experience ibm redbooks are developed by the ibm international technical support organization. Experts from ibm, customers and partners fr...