- DL manuals
- IBM
- Server
- Power 750 Express
- Technical Overview And Introduction
IBM Power 750 Express Technical Overview And Introduction - 1.1 Systems Overview
2
IBM Power 750 and 760 Technical Overview and Introduction
1.1 Systems overview
Detailed information about the Power 750 Express server and Power 760 systems is within
the following sections. Figure 1-1 shows the front view of the Power 750 and Power 760.
Figure 1-1 Front view of the Power 750 Express and Power 760
1.1.1 IBM Power 750 Express server
The Power 750 Express server (8408-E8D) supports up to four POWER7+ processor dual
chip modules (DCMs). Each of the four processor DCMs is an 8-core DCM packaged with
2 x 4-core chips. All 8-core processor DCMs are either 3.5 or 4.0 GHz mounted on a
dedicated card. The Power 750 is in a 19-inch rack-mount, 5U (EIA units) drawer
configuration. Each POWER7+ processor DCM is a 64-bit, 8-core processor packaged on a
dedicated card with a maximum of 16 DDR3 DIMMs, 10 MB of L3 cache per core, and
256 KB of L2 cache per core. A Power 750 Express server can be populated with one, two,
three, or four DCMs providing 8, 16, 24, or 32 cores. All the cores are active.
The Power 750 Express serversupports a maximum of 64 DDR3 DIMM slots, 16 per 8-core
DCM. Memory features (two DIMMs per memory feature) supported are 8, 16, and 32 GB
and run at a speed of 1066 MHz. A system with four DCMs installed has a maximum memory
of 1024 GB. The optional Active Memory Expansion feature enables the effective maximum
memory capacity to be much larger than the true physical memory. Innovative compression
and decompression of memory content using a new hardware accelerator can allow memory
expansion up to 125% for AIX partitions. A server with a maximum of 1024 GB can effectively
be expanded in excess of more than 2 TB. This can enhance virtualization and server
consolidation by allowing more partitions or running more work with the same physical
amount of memory.
The Power 750 Express server delivers great I/O expandability. In addition to the six PCIe
Gen2 slots in the system unit, up to four 12X-attached I/O drawers (FC 5802 or FC 5877),
Power 760 (front views)
Power 750 Express (front views)
Summary of Power 750 Express
Page 1
Ibm.Com/redbooks red paper front cover ibm power 750 and 760 technical overview and introduction james cruickshank sorin hanganu volker haug stephen lutz john t schmidt marco vallone features the 8408-e8d and 9109-rmd based on the latest power7+ processor technology discusses the dual chip module ar...
Page 3
International technical support organization ibm power 750 and 760 technical overview and introduction may 2013 redp-4985-00
Page 4
© copyright international business machines corporation 2013. All rights reserved. Note to u.S. Government users restricted rights -- use, duplication or disclosure restricted by gsa adp schedule contract with ibm corp. First edition (may 2013) this edition applies to the ibm power 750 (8408-e8d) an...
Page 5: Contents
© copyright ibm corp. 2013. All rights reserved. Iii contents notices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Vii trademarks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ....
Page 6
Iv ibm power 750 and 760 technical overview and introduction 2.1.4 memory access . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48 2.1.5 on-chip l3 cache innovation and intelligent cache . . . . . . . . . . . . . . . . . . . . . . . 49 2.1.6 pow...
Page 7
Contents v 2.12 operating system support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 100 2.12.1 ibm aix operating system . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 101 2.12.2 ibm i operating system . . . . . . . . . ....
Page 8
Vi ibm power 750 and 760 technical overview and introduction 4.4.4 electronic services and electronic service agent . . . . . . . . . . . . . . . . . . . . . . . 179 4.5 power7+ ras features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 180 4.6 power-on ...
Page 9: Notices
© copyright ibm corp. 2013. All rights reserved. Vii notices this information was developed for products and services offered in the u.S.A. Ibm may not offer the products, services, or features discussed in this document in other countries. Consult your local ibm representative for information on th...
Page 10: Trademarks
Viii ibm power 750 and 760 technical overview and introduction trademarks ibm, the ibm logo, and ibm.Com are trademarks or registered trademarks of international business machines corporation in the united states, other countries, or both. These and other ibm trademarked terms are marked on their fi...
Page 11: Preface
© copyright ibm corp. 2013. All rights reserved. Ix preface this ibm® redpaper™ publication is a comprehensive guide covering the ibm power 750 (8408-e8d) and power 760 (9109-rmd) servers that support ibm aix®, ibm i, and linux operating systems. The goal of this paper is to introduce the major inno...
Page 12: Authors
X ibm power 750 and 760 technical overview and introduction authors this paper was produced by a team of specialists from around the world working at the international technical support organization, poughkeepsie center. James cruickshank works in the power systems client technical specialist team f...
Page 13: Comments Welcome
Preface xi thanks to the following people for their contributions to this project: larry l. Amy, ron arroyo, hsien-i chang, carlo costantini, kirk dietzman, gary elliott, michael s. Floyd, james hermes, pete heyrman, john hilburn, roberto huerta de la torre, dan hurlimann, roxette johnson, sabine jo...
Page 14
Xii ibm power 750 and 760 technical overview and introduction stay connected to ibm redbooks find us on facebook: http://www.Facebook.Com/ibmredbooks follow us on twitter: http://twitter.Com/ibmredbooks look for us on linkedin: http://www.Linkedin.Com/groups?Home=&gid=2130806 explore new redbooks pu...
Page 15: General Description
© copyright ibm corp. 2013. All rights reserved. 1 chapter 1. General description the ibm power 750 express server (8408-e8d) and ibm power 760 server (9109-rmd) use the latest power7+ processor technology that is designed to deliver unprecedented performance, scalability, reliability, and manageabi...
Page 16: 1.1 Systems Overview
2 ibm power 750 and 760 technical overview and introduction 1.1 systems overview detailed information about the power 750 express server and power 760 systems is within the following sections. Figure 1-1 shows the front view of the power 750 and power 760. Figure 1-1 front view of the power 750 expr...
Page 17
Chapter 1. General description 3 add up to 40 pcie gen1 slots. This set of pcie slots can provide extensive connectivity to lans, switches, sans, asynchronous devices, sas storage, tape storage, and more. For example, more than 64 tb of sas disk storage is supported. The power 750 express system uni...
Page 18
4 ibm power 750 and 760 technical overview and introduction the power 760 server supports a maximum of 64 ddr3 dimm slots, 16 per 0/12-core processor dcm. Memory features (two memory dimms per feature) supported are 8, 16, 32, and 64 gb and run at a speed of 1066 mhz. A system with four dcms install...
Page 19: 1.2 Operating Environment
Chapter 1. General description 5 1.2 operating environment table 1-1 lists the operating environment specifications for the servers. Table 1-1 operating environment for power 750 express and power 760 description operating non-operating temperature 5 - 35 degrees c (41 - 95 degrees f) 5 - 45 degrees...
Page 20: 1.4 Physical Package
6 ibm power 750 and 760 technical overview and introduction 1.3 ibm systems energy estimator the ibm systems energy estimator is a web-based tool for estimating power requirements for ibm power systems. You can use this tool to estimate typical power requirements (watts) for a specific system config...
Page 21: 1.5 System Features
Chapter 1. General description 7 1.5 system features this section describes the features available on the power 750 and power 760 systems. 1.5.1 power 750 express system features the following features are available on the power 750 express: a 5u 19-inch rack-mount system enclosure one to four 8-cor...
Page 22
8 ibm power 750 and 760 technical overview and introduction eight i/o expansion slots per system – six gen2 pcie 8x slots plus two gx++ slots powervm (optional) – ibm micro-partitioning® – virtual i/o server (vios) – automated cpu and memory reconfiguration support for dedicated and shared processor...
Page 23
Chapter 1. General description 9 one hot-plug, slim-line sata media bay per system redundant hot-swap 1,925 watts ac power supplies choice of integrated multifunction card options (maximum one per system): – dual 10 gb copper and dual 1 gb ethernet (fc 1768) – dual 10 gb optical and dual 1 gb ethern...
Page 24
10 ibm power 750 and 760 technical overview and introduction 1.5.3 minimum features each system has a minimum feature set to be valid. Table 1-3 shows the minimum system configuration for a power 750. Table 1-3 minimum features for power 750 express system power 750 minimum features notes one system...
Page 25
Chapter 1. General description 11 table 1-4 shows the minimum system configuration for a power 760 system. Table 1-4 minimum features for power 760 system for ibm i: two disk drives 856 gb 10k rpm sas sff disk drive (fc 1737) 856 gb 10k rpm sas sff-2 disk drive (fc 1738) 571 gb 10k rpm sas sff disk ...
Page 26
12 ibm power 750 and 760 technical overview and introduction one primary operating system aix (fc 2146) ibm i (fc 2145) linux (fc 2147) one processor card 0/12-core, 3.1 ghz power7+ processor card (fc ept5) 0/12-core, 3.4 ghz power7+ processor card (fc ept6) eight processor activations 0/12-core, 3....
Page 27
Chapter 1. General description 13 1.5.4 power supply features two system ac power supplies (fc 5532) are required for each system enclosure. The second power supply provides redundant power for enhanced system availability. To provide full redundancy, the two power supplies must be connected to sepa...
Page 28
14 ibm power 750 and 760 technical overview and introduction figure 1-3 shows the top view of the power 750 and power 760 system with four dcms installed. Figure 1-3 view of the power 750 and power 760 with four dcms installed the power 750 server does not support capacity upgrade on demand for proc...
Page 29
Chapter 1. General description 15 summary of processor features table 1-5 summarizes the processor feature codes for the power 750 express server. Cells marked n/a indicate bulk ordering codes and custom card identification number (ccin) are not applicable. A blank ccin cell indicates ccin not avail...
Page 30
16 ibm power 750 and 760 technical overview and introduction 1.5.6 memory features in power7+ systems, ddr3 memory is used throughout. There are four capacity memory features, each has two dimms: 8 gb, 16 gb, 32 gb, or 64 gb. The power 760 supports all four memory features. The power 750 does not su...
Page 31
Chapter 1. General description 17 table 1-7 gives the maximum and minimum memory configurations for power 750 and power 760 with different number of dcms installed. Table 1-7 maximum and minimum memory configurations of the power 750 and power 760 table 1-8 details the memory features available in t...
Page 32
18 ibm power 750 and 760 technical overview and introduction different memory feature codes can be mixed on each of the two memory riser cards associated with each dcm. Likewise, riser cards on multiple processor dcms can have the same or different memory features. For better performance, two guidel...
Page 33
Chapter 1. General description 19 certain hdd and ssd features are available for order in large quantities. Table 1-10 lists the disk drives available in a quantity of 150. Table 1-10 available disk drives in quantity of 150 es0c 387 gb sff-2 ssd emlc aix, linux 1790 600 gb 10k rpm sas sff disk driv...
Page 34
20 ibm power 750 and 760 technical overview and introduction a device capable of reading a dvd must be in the system or attached to the system. It must be available to perform operating system installation, maintenance, problem determination, and service actions such as maintaining system firmware a...
Page 35: 1.7 I/o Drawers
Chapter 1. General description 21 the minimum system configuration requires at least one sas hdd or ssd in the system for aix, linux, or vios and two drives for ibm i. However, if using a fibre channel attached san indicated by fc 0837, an hdd or ssd is not required. Attachment to the san using a fi...
Page 36
22 ibm power 750 and 760 technical overview and introduction figure 1-5 shows the front view of the fc 5802 12x i/o drawer. Figure 1-5 the front view of the fc 5802 i/o drawer 1.7.2 exp30 ultra ssd i/o drawer the enhanced exp30 ultra ssd i/o drawer (fc edr1) provides the ibm power 750 and power 760 ...
Page 37
Chapter 1. General description 23 figure 1-7 shows the exp24s i/o drawer. Figure 1-7 exp24s sff gen2-bay drawer (fc 5887) front view 1.7.4 exp12s sas drawer the exp12s sas drawer (fc 5886) is a 2 eia drawer and mounts in a 19-inch rack. The drawer can hold either sas disk drives or ssd. The exp12s s...
Page 38
24 ibm power 750 and 760 technical overview and introduction table 1-11 summarizes the maximum number of supported disk-only i/o drawers. Table 1-11 maximum number of disk only i/o drawers supported 1.8 comparison between models the power 750 contains either one, two, three, or four 8-core 3.5 ghz o...
Page 39
Chapter 1. General description 25 processor card feature codes 1 x fc ept7 1 x fc ept8 4 x fc ept7 4 x fc ept8 1 x fc ept5 1 x fc ept6 4 x fc ept5 4 x fc ept6 processor activation and enablement feature codes 8 x fc epte 8 x fc eptf 32 x fc epte 32 x fc eptf 8 x fc epta 8 x fc eptb 48 x fc epta 48 x...
Page 40: 1.9 Build to Order
26 ibm power 750 and 760 technical overview and introduction 1.9 build to order you can perform a build-to-order or a la carte configuration using the ibm configurator for e-business (e-config), where you specify each configuration feature that you want on the system. This method is the only configu...
Page 41
Chapter 1. General description 27 other key points beyond i/o drawers are summarized in the following list: all sas disk drives supported on the power6, power6+, and power7 rack and tower servers are supported. However, scsi disk drives are not supported. Quarter-inch cartridge (qic) tape drives are...
Page 42: 1.13 System Racks
28 ibm power 750 and 760 technical overview and introduction several hmc models are supported to manage power7+ based systems. The model 7042-cr7 is the only hmc available for ordering at the time of writing, but you can also use one of the withdrawn models listed in table 1-14. Table 1-14 hmc model...
Page 43
Chapter 1. General description 29 you order additional i/o drawer hardware for an existing system (mes order). Use the rack fc 0551 and fc 0553 if you want ibm to integrate the newly ordered i/o drawer in a 19-inch rack before shipping the mes order. The 8408-e8d and 9109-rmd have the following rack...
Page 44
30 ibm power 750 and 760 technical overview and introduction for the t00 rack, three door options are available: – front door for 1.8 m rack (fc 6068) this feature provides an attractive black full height rack door. The door is steel, with a perforated flat front surface. The perforation pattern ext...
Page 45
Chapter 1. General description 31 weights are as follows: – t42 base empty rack: 261 kg (575 lb) – t42 full rack: 930 kg (2045 lb) for the t42 rack, various door options are available as shown in figure 1-9. Figure 1-9 door options for the t42 rack the 2.0 m rack trim kit (fc 6272) is used, if no fr...
Page 46
32 ibm power 750 and 760 technical overview and introduction rear door heat exchanger to lead away more heat a special door, called a rear door heat exchanger (fc 6858), is available. This door replaces the standard rear door on the rack. Copper tubes are attached to the rear door to circulate chill...
Page 47
Chapter 1. General description 33 four pdus can be mounted vertically in the back of the t00 and t42 racks. Figure 1-10 shows placement of the four vertically mounted pdus. In the rear of the rack, two additional pdus can be installed horizontally in the t00 rack and three in the t42 rack. The four ...
Page 48
34 ibm power 750 and 760 technical overview and introduction table 1-15 shows the available wall power cord options for the pdu and ipdu features, which must be ordered separately. Table 1-15 power wall cord options for the pdu and ipdu features the universal pdus are compatible with previous models...
Page 49
Chapter 1. General description 35 table 1-16 shows the supported tape or dvd drives for ibm power servers in the 7214-1u2. Table 1-16 supported feature codes for 7214-1u2 ibm system storage 7216 multi-media enclosure the ibm system storage 7216 multi-media enclosure (model 1u2) is designed to attach...
Page 50
36 ibm power 750 and 760 technical overview and introduction to attach a 7216 multi-media enclosure to the power 750 and power 760, consider the following cabling procedures: attachment by an sas adapter a pcie dual-x4 sas adapter (fc 5901) or a pcie lp dual-x4-port sas adapter 3 gb (fc 5278) must b...
Page 51
Chapter 1. General description 37 figure 1-11 shows the 7216 multi-media enclosure. Figure 1-11 7216-1u2 multi-media enclosure in general, the 7216-1u2 is supported by the aix, ibm i, and linux operating systems. Ibm i, from version 7.1, now fully supports the internal 5.25 inch rdx sata removable h...
Page 52
38 ibm power 750 and 760 technical overview and introduction table 1-18 shows the supported options for ibm power servers in the 7226-1u3: table 1-18 supported feature codes for 7226-1u3 option descriptions are as follows: dat160 80 gb tape drives: with sas or usb interface options and a data transf...
Page 53
Chapter 1. General description 39 media used in lto ultrium 5 half-high 1.5 tb tape drives are compatible with half high lto5 tape drives installed in the ibm ts2250 and ts2350 external tape drives, ibm lto5 tape libraries, and half high lto5 tape drives installed internally in ibm power6, power6+, ...
Page 54
40 ibm power 750 and 760 technical overview and introduction 1.13.7 oem rack the system can be installed in a suitable oem rack, if the rack conforms to the eia-310-d standard for 19-inch racks. This standard is published by the electrical industries alliance. For detailed information see the ibm po...
Page 55
Chapter 1. General description 41 the vertical distance between the mounting holes must consist of sets of three holes spaced (from bottom to top) 15.9 mm (0.625 in.), 15.9 mm (0.625 in.), and 12.67 mm (0.5 in.) on center, making each three-hole set of vertical hole spacing 44.45 mm (1.75 in.) apart...
Page 56
42 ibm power 750 and 760 technical overview and introduction.
Page 57: Architecture and Technical
© copyright ibm corp. 2013. All rights reserved. 43 chapter 2. Architecture and technical overview the ibm power 750 offers a 4-socket system enclosure populated with dual chip modules (dcms). Each dcm has two 4-core power7+ processors. The ibm power 760 offers a 4-socket system enclosure, also popu...
Page 58
44 ibm power 750 and 760 technical overview and introduction figure 2-1 shows the logical system diagram of the power 750 and power 760. Figure 2-1 ibm power 750 and power 760 logical system diagram dasd backplane i/o backplane multifunction card cpu card dc m0 p7+ x z memory controller gx++ p7+ mem...
Page 59
Chapter 2. Architecture and technical overview 45 2.1 the ibm power7+ processor the ibm power7+ processor represents a leap forward in technology achievement and associated computing capability. The multi-core architecture of the power7+ processor has been matched with innovation across a wide range...
Page 60
46 ibm power 750 and 760 technical overview and introduction figure 2-2 power7+ processor die with key areas indicated 2.1.1 power7+ processor overview the power7+ processor chip is fabricated with ibm 32 nm silicon-on-insulator (soi) technology using copper interconnects, and implements an on-chip ...
Page 61
Chapter 2. Architecture and technical overview 47 2.1.2 power7+ processor core each power7+ processor core implements aggressive out-of-order (ooo) instruction execution to drive high efficiency in the use of available execution paths. The power7+ processor has an instruction sequence unit that is c...
Page 62
48 ibm power 750 and 760 technical overview and introduction figure 2-3 shows the evolution of simultaneous multithreading in the industry. Figure 2-3 evolution of simultaneous multithreading the various smt modes offered by the power7+ processor allow flexibility, enabling users to select the threa...
Page 63: Power7+
Chapter 2. Architecture and technical overview 49 figure 2-4 gives a simple overview of the power7+ processor memory access structure in the power 750 and power 760 systems. Figure 2-4 overview of power7+ memory access structure 2.1.5 on-chip l3 cache innovation and intelligent cache a breakthrough ...
Page 64
50 ibm power 750 and 760 technical overview and introduction figure 2-5 shows the flr-l3 cache regions for each of the cores on the power7+ processor die. Figure 2-5 fast local regions of l3 cache on the power7+ processor the innovation of using edram on the power7+ processor die is significant for ...
Page 65: 2.2 Power7+ Processor Card
Chapter 2. Architecture and technical overview 51 2.1.6 power7+ processor and intelligent energy energy consumption is an important area of focus for the design of the power7+ processor, which includes intelligent energy features that help to dynamically optimize energy usage and performance so that...
Page 66
52 ibm power 750 and 760 technical overview and introduction 2.2.1 overview figure 2-6 illustrates the major components of the power 750 and power 760 cpu card. Figure 2-6 ibm power 750 and power 760 cpu board 2.2.2 processor interconnects this section describes the processor to memory architectural...
Page 67
Chapter 2. Architecture and technical overview 53 the previous power7 technology-based power 750 (8233-e8b) uses a single node design. It was available as a 4-socket system with one power7 chip per socket and w-y-z buses between sockets, as shown in figure 2-7. A 6-core or 8-core power7 chip was ord...
Page 68: 2.3 Memory Subsystem
54 ibm power 750 and 760 technical overview and introduction considerations should be taken into account as when deploying workloads that span multiple system enclosures on a power 770 or power 780 server to achieve optimum performance. For more information, see the “architecture of the ibm power7+ ...
Page 69
Chapter 2. Architecture and technical overview 55 each riser card in the system must be populated with at least one pair of dimms. Figure 2-9 shows the physical memory dimm topology for power 750 and power 760 connected to one dcm. Figure 2-9 physical memory dimm topology for a power 750 and power 7...
Page 70
56 ibm power 750 and 760 technical overview and introduction figure 2-10 shows the memory location codes and how the memory riser cards are divided in quads, each quad being attached to a memory buffer. Figure 2-10 memory riser card for power 750 and power 760 systems a power7+ dcm uses one memory c...
Page 71
Chapter 2. Architecture and technical overview 57 the following tables (table 2-4 through table 2-7 on page 59) show the plugging orders for various dcm configurations. Table 2-4 memory plug order for a system with one dcm table 2-5 memory plug order for a system with two dcms table information: 1 =...
Page 72
58 ibm power 750 and 760 technical overview and introduction table 2-6 memory plug order for a system with three dcms dcm 0 / p3-c12 mc1 / riser card 1 / p3-c1 mc0 / riser card 2 / p3-c2 pair of dimm slots pair of dimm slots c1/c3 c2/c4 c5/c7 c6/c8 c1/c3 c2/c4 c5/c7 c6/c8 1 13 19 7 2 14 20 8 dcm 1 /...
Page 73
Chapter 2. Architecture and technical overview 59 table 2-7 memory plug order for a system with four dcms dcm 0 / p3-c12 mc1 / riser card 1 / p3-c1 mc0 / riser card 2 / p3-c2 pair of dimm slots pair of dimm slots c1/c3 c2/c4 c5/c7 c6/c8 c1/c3 c2/c4 c5/c7 c6/c8 1 17 25 9 2 18 26 10 dcm 1 / p3-c17 mc1...
Page 74
60 ibm power 750 and 760 technical overview and introduction 2.3.3 memory bandwidth power7+ has exceptional cache, memory, and interconnect bandwidths. Table 2-8 shows the maximum bandwidth estimate for the power 750 system running at 4.06 ghz. Table 2-8 power 750 processor and memory bandwidth esti...
Page 75: 2.4 Capacity On Demand
Chapter 2. Architecture and technical overview 61 memory: each of the two memory controllers uses two ports with 8 bytes that connect to a buffer chip. Each buffer chip connects to four dimms running at 1066 mhz, with two dimms being active at a given point in time. See figure 2-9 on page 55 for ref...
Page 76: 2.5 System Bus
62 ibm power 750 and 760 technical overview and introduction 2.4.3 software licensing and cod for software licensing considerations with the various cod offerings, see the most recent revision of the power systems capacity on demand user’s guide: http://www.Ibm.Com/systems/power/hardware/cod 2.5 sys...
Page 77: 2.6 Internal I/o Subsystem
Chapter 2. Architecture and technical overview 63 table 2-10 external gx++ i/o bandwidth 2.6 internal i/o subsystem the internal i/o subsystem resides on the i/o planar, which supports six pcie slots. All pcie slots are hot-pluggable and enabled with enhanced error handling (eeh). In the unlikely ev...
Page 78
64 ibm power 750 and 760 technical overview and introduction 2.6.1 blind swap cassettes the power 750 and power 760 uses fourth-generation blind swap cassettes to manage the installation and removal of adapters. This mechanism requires an interposer card that allows the pcie adapters to plug in vert...
Page 79: 2.7 Pci Adapters
Chapter 2. Architecture and technical overview 65 100 mb (100 baset) full duplex. Each rj45 port's configuration is independent of the other. The rj45 ports use 4-pair cat 6a cabling for distances of up to 100 meters. Cat5 cabling is not supported. The two 10 gb copper twinax ports are sfp+ and the ...
Page 80
66 ibm power 750 and 760 technical overview and introduction gen2: double the speed of the gen1 interface, which gives a capacity of a peak bandwidth of 4 gbps on an 8-lane interface pcie gen1 slots support gen1 adapter cards and also most of the gen2 adapters. In this case, when a gen2 adapter is u...
Page 81
Chapter 2. Architecture and technical overview 67 pcie full-height and full-high cards, which are plugged into the following servers slots: – power 720 and power 740 (within the base system, five pcie half-length slots are supported.) – power 750 – power 755 – power 760 – power 770 – power 780 – pow...
Page 82
68 ibm power 750 and 760 technical overview and introduction before adding or rearranging adapters, use the system planning tool to validate the new adapter configuration. See the ibm system planning tool website: http://www.Ibm.Com/systems/support/tools/systemplanningtool/ if you are installing a n...
Page 83
Chapter 2. Architecture and technical overview 69 table 2-13 available lan adapters feature code ccin adapter description slot size os support 5287 5287 2-port 10 gb ethernet sr pcie adapter pcie full height aix, linux 5288 5288 2-port 10 gb ethernet sfp+ copper adapter pcie full height aix, linux 5...
Page 84
70 ibm power 750 and 760 technical overview and introduction 2.7.6 graphics accelerator adapters the ibm power 750 and power 760 support up to eight of the fc 5748 cards, as shown in table 2-14. They can be configured to operate in either 8-bit or 24-bit color modes. These adapters support both anal...
Page 85
Chapter 2. Architecture and technical overview 71 2.7.9 fibre channel adapters the ibm power 750 and power 760 servers support direct or san connection to devices that use fibre channel adapters. Table 2-17 summarizes the available fibre channel adapters. All of these adapters have lc connectors. If...
Page 86
72 ibm power 750 and 760 technical overview and introduction figure 2-12 comparison between existing fibre channel and network connection and fcoe connection table 2-18 lists the available fibre channel over ethernet adapter. It is a high-performance converged network adapter (cna) using sr optics. ...
Page 87
Chapter 2. Architecture and technical overview 73 defines a layered hardware protocol, and also a software layer to manage initialization and the communication between devices. Each link can support multiple transport services for reliability and multiple prioritized virtual communication channels. ...
Page 88: 2.8 Internal Storage
74 ibm power 750 and 760 technical overview and introduction support for smart card applications using europay, mastercard and visa cryptographic key generation and random number generation pin processing - generation, verification, translation encrypt and decrypt using aes and des keys see the foll...
Page 89
Chapter 2. Architecture and technical overview 75 a pcie slot in a system enclosure. This adapter controls the third set of bays. By having three controllers, you can have three sets of boot drives supporting three partitions. You can configure the two embedded controllers together as a pair for hig...
Page 90
76 ibm power 750 and 760 technical overview and introduction is required if ibm i is to access any of the sas bays in that processor enclosure. Aix and linux support configurations using two sets of three bays (3/3) or three sets of two bays (2/2/2) without the dual ioa enablement card. With fc 5662...
Page 91
Chapter 2. Architecture and technical overview 77 2.8.1 dual split backplane mode dual split backplane mode offers two sets of three disks and is the standard configuration. One set can be connected to an external sas pcie adapter if fc 1819 is selected. Figure 2-14 shows how the six disk bays are s...
Page 92
78 ibm power 750 and 760 technical overview and introduction triple split backplane mode. The pci adapter that drives two of the six disks can be located in the same power 750 or power 760 system enclosure or in an external i/o drawer. Figure 2-15 triple split backplane overview although ssds are su...
Page 93
Chapter 2. Architecture and technical overview 79 raid 0, 10, 5, and 6 support up to six drives. Ssds and hdds can be used, but can never be mixed in the same disk enclosure. To connect to the external storage, you need to connect to the fc 5887 disk drive enclosure. Figure 2-16 shows the topology o...
Page 94
80 ibm power 750 and 760 technical overview and introduction 2.9 external i/o subsystems the power 750 and power 760 server support the attachment of i/o drawers. Any combination of the following two i/o drawers can be attached to the system unit, providing extensive capability to expand the overall...
Page 95
Chapter 2. Architecture and technical overview 81 the physical dimensions of the drawer measure 444.5 mm (17.5 in.) wide by 177.8 mm (7.0 in.) high by 711.2 mm (28.0 in.) deep for use in a 19-inch rack. Figure 2-17 shows the front view of the 12x i/o drawer pcie (fc 5802). Figure 2-17 front view of ...
Page 96
82 ibm power 750 and 760 technical overview and introduction 2.9.3 12x i/o drawer pcie configuration and cabling rules the following sections offer details about the disk drive configuration, 12x loop and spcn cabling rules. Configuring the disk drive subsystem of the fc 5802 drawer the 12x i/o draw...
Page 97
Chapter 2. Architecture and technical overview 83 the location codes for the front and rear views of the fc 5802 i/o drawer are provided in figure 2-20 and figure 2-21. Figure 2-20 fc 5802 i/o drawer from view location codes figure 2-21 fc 5802 i/o drawer rear view location codes p3-d1 p3-d2 p3-d3 p...
Page 98
84 ibm power 750 and 760 technical overview and introduction table 2-24 lists the sas ports associated to the disk bays with the mode selector switch 4. Table 2-24 sas connection mappings using mode switch 4 for more detailed information about cabling and other switch modes, see the power systems en...
Page 99
Chapter 2. Architecture and technical overview 85 figure 2-23 shows typical 12x i/o loop port connections. Figure 2-23 typical 12x i/o loop port connections table 2-25 shows various 12x cables to satisfy the various length requirements. Table 2-25 12x connection cables 12x i/o drawer pcie spcn cabli...
Page 100
86 ibm power 750 and 760 technical overview and introduction figure 2-24 12x i/o drawer pcie spcn cabling various spcn cables are available. Table 2-26 shows the available spcn cables options to satisfy various length requirements. Table 2-26 spcn cables 2.10 external disk subsystems this section de...
Page 101
Chapter 2. Architecture and technical overview 87 integrated sas controllers each physically provide 3.1 gb write cache. Working as a pair, they provide mirrored write-cache data and controller redundancy. The cache contents are designed to be protected by built-in flash memory in case of power fail...
Page 102
88 ibm power 750 and 760 technical overview and introduction disks the 387 gb ssd (fc es02 and fc es04) used in the exp30 ultra ssd i/o drawer uses high-performance, industrial-strength emlc technology. These ssds are packaged as 1.8-inch sas drives, which can be added to or removed concurrently whi...
Page 103
Chapter 2. Architecture and technical overview 89 when connecting one drawer to the server, a suggestion for redundancy is to have both fc 1914 ports connected to the drawer, as shown on figure 2-26. Figure 2-26 connection between one or two fc 1914 cards and a single fc edr1 drawer power 750 or pow...
Page 104
90 ibm power 750 and 760 technical overview and introduction if the server must be connected to two fc edr1, connect each controller to a separate gx++ adapter, as shown on figure figure 2-27. Figure 2-27 connection between two fc 1914 and two fc edr1 exp30 drawer connection to exp24s drawer two exp...
Page 105
Chapter 2. Architecture and technical overview 91 figure 2-28 shows two exp24s drawers connected to one exp30 drawer. Figure 2-28 fc edr1 drawer connection to two fc 5887 drawers 2.10.2 exp24s sff gen2-bay drawer the exp24s sff gen2-bay drawer (fc 5887) is an expansion drawer that supports up to 24 ...
Page 106
92 ibm power 750 and 760 technical overview and introduction in addition to the existing sas disks options, ibm has the following available disk models: 900 gb 10k rpm sas hdd in gen-2 carrier for aix and linux (fc 1752) 856 gb 10k rpm sas hdd in gen-2 carrier for ibm i (fc 1738) there is an expansi...
Page 107
Chapter 2. Architecture and technical overview 93 an exp24s drawer in mode 4 can be attached to two or four sas controllers and provide much configuration flexibility. An exp24s in mode 2 has similar flexibility. Up to 24 hdds can be supported with any of the supported sas adapters or controllers. I...
Page 108
94 ibm power 750 and 760 technical overview and introduction 2.10.6 ibm system storage the ibm system storage disk systems products and offerings provide compelling storage solutions with superior value for all levels of business, from entry-level to high-end storage systems. Ibm system storage n se...
Page 109
Chapter 2. Architecture and technical overview 95 service levels for dynamic, heterogeneous workloads, and tight integration with hypervisors and the openstack platform enable optimal storage agility for cloud environments. Optimized with inherent efficiencies that simplify storage, xiv delivers the...
Page 110
96 ibm power 750 and 760 technical overview and introduction the power 750 and power 760 platforms support two main service environments: attachment to one or more hmcs is a supported option by the system this is the common configuration for servers supporting logical partitions with dedicated or vi...
Page 111
Chapter 2. Architecture and technical overview 97 hmc raid 1 support hmcs now offer a high-availability feature. Starting from hmc 7042-cr7 raid 1 protection will be enabled by default. This feature enables data redundancy using two physical disk drives. Raid 1 is also offered on both the 7042-cr6 a...
Page 112
98 ibm power 750 and 760 technical overview and introduction for the hmc to communicate properly with the managed server, eth0 of the hmc must be connected to either the hmc1 or hmc2 port of the managed server, although other network configurations are possible. You can attach a second hmc to hmc2 p...
Page 113
Chapter 2. Architecture and technical overview 99 2.11.2 high availability hmc configuration the hmc is an important hardware component. When in operation, power systems servers and their hosted partitions can continue to operate when no hmc is available. However, in such conditions, certain operati...
Page 114
100 ibm power 750 and 760 technical overview and introduction figure 2-31 shows one possible highly available hmc configuration that is managing two servers. Each hmc is connected to one fsp port of all managed servers. Figure 2-31 highly available hmc and network architecture for simplicity, only h...
Page 115
Chapter 2. Architecture and technical overview 101 for details about the software available on ibm power systems, visit the ibm power systems software™ website: http://www.Ibm.Com/systems/power/software/index.Html 2.12.1 ibm aix operating system the following sections discuss the various levels of a...
Page 116
102 ibm power 750 and 760 technical overview and introduction a partition using aix 7.1 can run in power6, power6+, or power7 mode. The best approach is to run the partition in power7 mode to allow exploitation of new hardware capabilities such as smt4 and active memory expansion. 2.12.2 ibm i opera...
Page 117
Chapter 2. Architecture and technical overview 103 for information about features and external devices that are supported by linux, see the following site: http://www.Ibm.Com/systems/p/os/linux/index.Html be sure to update your systems with the latest linux for power service and productivity tools a...
Page 118
104 ibm power 750 and 760 technical overview and introduction chip, ibm advances a more than a 20-year investment in the xl compilers for power series and ibm powerpc® series architectures. Xl c, xl c/c++, and xl fortran features that are introduced to use the latest power7+ processor include the fo...
Page 119: 2.13 Energy Management
Chapter 2. Architecture and technical overview 105 tools from rational developer for power systems software, and a choice between the xl c/c++ for aix or cobol for aix compilers. 2.13 energy management the power 750 and 760 servers are designed with features to help clients become more energy-effici...
Page 120
106 ibm power 750 and 760 technical overview and introduction power saver mode is not supported during boot or reboot, although it is a persistent condition that will be sustained after the boot when the system starts executing instructions. Dynamic power saver mode dynamic power saver mode varies p...
Page 121
Chapter 2. Architecture and technical overview 107 figure 2-32, from the active energy manager, shows the dynamic cpu frequency change in a system using the dynamic power saver mode. Figure 2-32 example of a system using dynamic power saver mode power capping power capping enforces a user-specified ...
Page 122
108 ibm power 750 and 760 technical overview and introduction processor core sleep mode to be able to save even more energy, the power7+ processor has an even lower power mode referred to as sleep . Before a core and its associated private l2 cache enter sleep mode, the cache is flushed, transition ...
Page 123
Chapter 2. Architecture and technical overview 109 partition power management available with active energy manager 4.3.1 or later, and power7 systems with the 730 firmware release or later, is the capability to set a power savings mode for partitions or the system processor pool. As in the system-le...
Page 124
110 ibm power 750 and 760 technical overview and introduction the power 750 and power 760 systems implement all the energyscale capabilities listed in 2.13.1, “ibm energyscale technology” on page 105. 2.13.2 thermal power management device card the thermal power management device (tpmd) card is a se...
Page 125: Virtualization
© copyright ibm corp. 2013. All rights reserved. 111 chapter 3. Virtualization as you look for ways to maximize the return on your it infrastructure investments, consolidating workloads becomes an attractive proposition. Ibm power systems combined with powervm technology offer key capabilities that ...
Page 126: 3.1 Power Hypervisor
112 ibm power 750 and 760 technical overview and introduction 3.1 power hypervisor combined with features that are designed into the power7+ processors, the power hypervisor delivers functions that enable other system technologies, including logical partitioning technology, virtualized processors, i...
Page 127
Chapter 3. Virtualization 113 virtual scsi the power hypervisor provides a virtual scsi mechanism for the virtualization of storage devices. The storage virtualization is accomplished using two paired adapters: a virtual scsi server adapter a virtual scsi client adapter a virtual i/o server partitio...
Page 128
114 ibm power 750 and 760 technical overview and introduction virtual fibre channel a virtual fibre channel adapter is a virtual adapter that provides client logical partitions with a fibre channel connection to a storage area network through the virtual i/o server logical partition. The virtual i/o...
Page 129: 3.2 Power Processor Modes
Chapter 3. Virtualization 115 3.2 power processor modes although, strictly speaking, not a virtualization feature, the power modes are described here because they affect various virtualization features. On power system servers, partitions can be configured to run in several modes, including the foll...
Page 130
116 ibm power 750 and 760 technical overview and introduction the selection of the mode is made on a per-partition basis, from the managed console, by editing the partition profile (figure 3-2). Figure 3-2 configuring partition profile compatibility mode from the managed console.
Page 131
Chapter 3. Virtualization 117 table 3-2 lists the differences between these modes. Table 3-2 differences between power6, power6+, and power7 compatibility mode 3.3 active memory expansion active memory expansion enablement is an optional feature of power7 and power7+ processor-based servers that mus...
Page 132
118 ibm power 750 and 760 technical overview and introduction compressible the memory content is, and also depends on having adequate spare cpu capacity available for this compression and decompression. The power7+ processor includes active memory expansion on the processor chip to provide dramatic ...
Page 133
Chapter 3. Virtualization 119 the knee varies depending on how compressible the memory contents are. This example demonstrates the need for a case-by-case study of whether memory expansion can provide a positive return on investment. To help you do this study, a planning tool is included with aix 6....
Page 134
120 ibm power 750 and 760 technical overview and introduction after selecting the value of the memory expansion factor that you want to achieve, you can use this value to configure the partition from the managed console (figure 3-5). Figure 3-5 using the planning tool result to configure the partiti...
Page 135
Chapter 3. Virtualization 121 from the hmc, you can view whether the active memory expansion feature is activated (figure 3-6). Figure 3-6 server capabilities listed from the hmc for details about active memory expansion, download the document active memory expansion: overview and usage guide: http:...
Page 136: 3.4 Powervm
122 ibm power 750 and 760 technical overview and introduction 3.4 powervm the powervm platform is the family of technologies, capabilities, and offerings that deliver industry-leading virtualization on the ibm power systems. It is the umbrella branding term for power systems virtualization (logical ...
Page 137
Chapter 3. Virtualization 123 later, dynamic logical partitioning increased the flexibility, allowing selected system resources, such as processors, memory, and i/o components, to be added and deleted from logical partitions while they are executing. Aix version 5.2, with all the necessary enhanceme...
Page 138
124 ibm power 750 and 760 technical overview and introduction on the power7+ processors, a partition can be defined with a processor capacity as small as 0.05 processing units. This number represents 0.05 of a physical processor. Each physical processor can be shared by up to 20 shared processor par...
Page 139
Chapter 3. Virtualization 125 processing mode when you create a logical partition you can assign entire processors for dedicated use, or you can assign partial processing units from a shared processor pool. This setting defines the processing mode of the logical partition. Figure 3-7 shows a diagram...
Page 140
126 ibm power 750 and 760 technical overview and introduction shared mode in shared mode, logical partitions use virtual processors to access fractions of physical processors. Shared partitions can define any number of virtual processors (the maximum number is 10 times the number of processing units...
Page 141
Chapter 3. Virtualization 127 micropartitions are created and then identified as members of either the default shared processor pool 0 or a user-defined shared processor pool n . The virtual processors that exist within the set of micropartitions are monitored by the power hypervisor, and processor ...
Page 142
128 ibm power 750 and 760 technical overview and introduction levels of processor capacity resolution the following two levels of processor capacity resolution are implemented by the power hypervisor and multiple shared processor pools: level 0 the first level, level 0 , is the resolution of capacit...
Page 143
Chapter 3. Virtualization 129 capacity allocation above the entitled pool capacity (level 1 ) the power hypervisor initially manages the entitled pool capacity at the shared processor pool level. This is where unused processor capacity within a shared processor pool is harvested and then redistribut...
Page 144
130 ibm power 750 and 760 technical overview and introduction dynamic adjustment of reserved pool capacity the reserved pool capacity of a shared processor pool, other than the default shared processor pool 0 , can be adjusted dynamically from the managed console, by using either the graphical inter...
Page 145
Chapter 3. Virtualization 131 network services, and ip addresses. Figure 3-10 shows an overview of a virtual i/o server configuration. Figure 3-10 architectural view of the virtual i/o server because the virtual i/o server is an operating-system-based appliance server, redundancy for physical device...
Page 146
132 ibm power 750 and 760 technical overview and introduction figure 3-11 shows a configuration example of an sea with one physical and two virtual ethernet adapters. An sea can include up to 16 virtual ethernet adapters on the virtual i/o server that share the same physical access. Figure 3-11 arch...
Page 147
Chapter 3. Virtualization 133 virtual scsi virtual scsi refers to a virtualized implementation of the scsi protocol. Virtual scsi is based on a client/server relationship. The virtual i/o server logical partition owns the physical resources and acts as a server or, in scsi terms, a target device. Th...
Page 148
134 ibm power 750 and 760 technical overview and introduction figure 3-12 shows an example where one physical disk is divided into two logical volumes by the virtual i/o server. Each client partition is assigned one logical volume, which is then accessed through a virtual i/o adapter (vscsi client a...
Page 149
Chapter 3. Virtualization 135 virtual i/o server functions the virtual i/o server has several features, including monitoring solutions: support for live partition mobility starting on power6 processor-based systems with the powervm enterprise edition for more information about live partition mobilit...
Page 150
136 ibm power 750 and 760 technical overview and introduction 3.4.5 powervm live partition mobility powervm live partition mobility allows you to move a running logical partition, including its operating system and running applications, from one system to another without any shutdown or without disr...
Page 151
Chapter 3. Virtualization 137 a possibility is to migrate partitions back and forth between power6, power6+, power7 and power7+ processor-based servers. Partition mobility uses the power6 or power6+ compatibility modes that are provided by power7 and power7+ processor-based servers. On the power7+ p...
Page 152
138 ibm power 750 and 760 technical overview and introduction improved live partition mobility benefits the possibility to move partitions between power6, power6+, power7, and power7+ processor-based servers greatly facilitates the deployment of power7+ processor-based servers, as follows: installat...
Page 153
Chapter 3. Virtualization 139 3.4.7 active memory deduplication in a virtualized environment, the systems might have a considerable amount of duplicated information stored on ram after each partition has its own operating system, and some of them might even share the same kind of applications. On he...
Page 154
140 ibm power 750 and 760 technical overview and introduction figure 3-14 shows the behavior of a system with active memory deduplication enabled on its active memory sharing shared memory pool. Duplicated pages from separate lpars are stored only once, providing the active memory sharing pool with ...
Page 155
Chapter 3. Virtualization 141 figure 3-15 shows two pages being written in the active memory sharing memory pool and having their signatures matched on the deduplication table. Figure 3-15 memory pages having their signatures matched by active memory deduplication from the lpar perspective, the acti...
Page 156
142 ibm power 750 and 760 technical overview and introduction figure 3-16 shows the active memory deduplication being enabled to a shared memory pool. Figure 3-16 enabling the active memory deduplication for a shared memory pool the active memory deduplication feature requires the following minimum ...
Page 157
Chapter 3. Virtualization 143 dynamic platform optimizer should be launched through the hmc command-line interface with the optmem command (see example 3-1). The lsoptmem command shows important information about current, and predicted, memory affinity, and also monitors the status of a running opti...
Page 158
144 ibm power 750 and 760 technical overview and introduction 3.4.11 linux support ibm linux technology center (ltc) contributes to the development of linux by providing support for ibm hardware in linux distributions. In particular, the ltc makes tools and code available to the linux communities to...
Page 159
Chapter 3. Virtualization 145 table 3-6 lists the support of specific programming features for various versions of linux. Table 3-6 linux support for power7 features see the following sources of information: advance toolchain: http://www.Ibm.Com/developerworks/wikis/display/hpccentral/how+to+use+adv...
Page 160: 3.5 System Planning Tool
146 ibm power 750 and 760 technical overview and introduction 3.5 system planning tool the ibm system planning tool (spt) helps you design systems to be partitioned with logical partitions. You can also plan for and design non-partitioned systems by using the spt. The resulting output of your design...
Page 161
Chapter 3. Virtualization 147 3.6 new powervm version 2.2.2 features power systems server coupled with powervm technology are designed to help clients build a dynamic infrastructure, reducing costs, managing risk, and improving services levels. Ibm powervm v2.2.2 includes vios 2.2.2.1-fp26, hmc v7r7...
Page 162
148 ibm power 750 and 760 technical overview and introduction.
Page 163: Continuous Availability and
© copyright ibm corp. 2013. All rights reserved. 149 chapter 4. Continuous availability and manageability this chapter provides information about ibm reliability, availability, and serviceability (ras) design and features. This set of technologies, implemented on ibm power systems servers, improves ...
Page 164: 4.1 Reliability
150 ibm power 750 and 760 technical overview and introduction 4.1 reliability highly reliable systems are built with highly reliable components. On ibm power processor-based systems, this basic principle is expanded upon with a clear design for reliability architecture and methodology. A concentrate...
Page 165: 4.2 Availability
Chapter 4. Continuous availability and manageability 151 4.1.2 placement of components packaging is designed to deliver both high performance and high reliability. For example, the reliability of electronic components is directly related to their thermal environment. That is, large decreases in comp...
Page 166
152 ibm power 750 and 760 technical overview and introduction this chapter describes ibm power7+ processor-based systems technologies that are focused on keeping a system running. For a specific set of functions focused on detecting errors before they become serious enough to stop computing work, se...
Page 167
Chapter 4. Continuous availability and manageability 153 processor instruction retry as introduced with the power6 technology, the power7+ processor can do processor instruction retry and alternate processor recovery for several core-related faults. Doing this significantly reduces exposure to both ...
Page 168
154 ibm power 750 and 760 technical overview and introduction 4.2.3 memory protection a memory protection architecture that provides good error resilience for a relatively small l1 cache might be inadequate for protecting the much larger system main store. Therefore, a variety of protection methods ...
Page 169
Chapter 4. Continuous availability and manageability 155 advanced memory buffer chips are exclusive to ibm and help to increase performance, acting as read/write buffers. The power 750 and the power 760 use one memory controller. Advanced memory buffer chips are on the memory cards and support four ...
Page 170
156 ibm power 750 and 760 technical overview and introduction 4.2.4 cache protection power7+ processor-based systems are designed with cache protection mechanisms, including cache line delete in both l2 and l3 arrays, processor instruction retry and alternate processor recovery protection on l1-i an...
Page 171
Chapter 4. Continuous availability and manageability 157 in cases where the data cannot be recovered from another source, a technique called special uncorrectable error (sue) handling is used to prevent an uncorrectable error in memory or cache from immediately causing the system to terminate. Rathe...
Page 172: 4.3 Serviceability
158 ibm power 750 and 760 technical overview and introduction linux, eeh support extends to the majority of frequently used devices, although various third-party pci devices might not provide native eeh support. To detect and correct pcie bus errors, power7+ processor-based systems use crc detection...
Page 173
Chapter 4. Continuous availability and manageability 159 the serviceability features delivered in this system provide a highly efficient service environment by incorporating the following attributes: design for customer setup (csu), customer installed features (cif), and customer-replaceable units (...
Page 174
160 ibm power 750 and 760 technical overview and introduction the service processor can immediately shut down a system in the following circumstances: temperature exceeds the critical level or remains above the warning level for too long. Internal component temperatures reach critical levels. Non-re...
Page 175
Chapter 4. Continuous availability and manageability 161 figure 4-3 shows this option using the asmi. Figure 4-3 asmi auto power restart settings panel partition availability priority also available is the ability to assign availability priorities to partitions. If an alternate processor recovery ev...
Page 176
162 ibm power 750 and 760 technical overview and introduction system error log where it is analyzed by error log analysis (ela) routines. Appropriate actions are taken to report the boot-time error for subsequent service, if required. Concurrent access to the service processors menus of the asmi thi...
Page 177
Chapter 4. Continuous availability and manageability 163 figure 4-4 shows a schematic of fault isolation register implementation. Figure 4-4 schematic of fir implementation fault isolation the service processor interprets error data that is captured by the ffdc checkers (saved in the firs or other f...
Page 178
164 ibm power 750 and 760 technical overview and introduction 4.3.2 diagnosing general diagnostic objectives are to detect and identify problems so that they can be resolved quickly. Elements of diagnostics strategy from ibm are as follows: provide a common error code format equivalent to a system r...
Page 179
Chapter 4. Continuous availability and manageability 165 the service processor correlates and processes runtime error information using logic derived from ibm engineering expertise to count recoverable errors (called thresholding ) and predict when corrective actions must be automatically initiated ...
Page 180
166 ibm power 750 and 760 technical overview and introduction data that contains information about the effect that the repair will have on the system is also included. Error log routines in the operating system and fsp can then use this information and decide whether the fault is a call-home candida...
Page 181
Chapter 4. Continuous availability and manageability 167 4.3.4 notifying after a power systems server detects, diagnoses, and reports an error to an appropriate aggregation point, it then takes steps to notify the client, and if necessary the ibm support organization. Depending on the assessed sever...
Page 182
168 ibm power 750 and 760 technical overview and introduction 4.3.5 locating and servicing the final component of a comprehensive design for serviceability is the ability to effectively locate and replace parts requiring service. Power processor-based systems use a combination of visual cues and gui...
Page 183
Chapter 4. Continuous availability and manageability 169 data centers can be complex places, and guiding light is designed to do more than identify visible components. When a component might be hidden from view, guiding light can flash a sequence of leds that extends to the frame exterior, clearly g...
Page 184
170 ibm power 750 and 760 technical overview and introduction blind swap cassette blind swap pcie adapters represent significant service and ease-of-use enhancements in i/o subsystem design while maintaining high pcie adapter density. Blind swap allows pcie adapters to be concurrently replaced or in...
Page 185: 4.4 Manageability
Chapter 4. Continuous availability and manageability 171 repair and verify system repair and verify (r&v) is a system used to guide a service provider step-by-step through the process of repairing a system and verifying that the problem has been repaired. The steps are customized in the appropriate ...
Page 186
172 ibm power 750 and 760 technical overview and introduction service processor the service processor is a controller that is running its own operating system. It is a component of the service interface card. The service processor operating system has specific programs and device drivers for the ser...
Page 187
Chapter 4. Continuous availability and manageability 173 the asmi is accessible through the management console. It is also accessible by using a web browser on a system that is connected directly to the service processor (in this case, either a standard ethernet cable or a crossed cable) or through ...
Page 188
174 ibm power 750 and 760 technical overview and introduction figure 4-5 shows that the operator panel on a power 750 and power 760 is pulled out. Figure 4-5 operator panel is pulled out from the chassis several features of the operator panel include the following items: a 2 x 16 character lcd displ...
Page 189
Chapter 4. Continuous availability and manageability 175 the modes are as follows: service mode this mode requires a service mode boot of the system and enables the checking of system devices and features. Service mode provides the most complete self-check of the system resources. All system resourc...
Page 190
176 ibm power 750 and 760 technical overview and introduction display/alter/dump licensed internal code log main storage dump manager hardware service manager call home/customer notification error information menu led management menu concurrent/non-concurrent maintenance (within scope of the os) man...
Page 191
Chapter 4. Continuous availability and manageability 177 for power systems, select the power link. Figure 4-6 shows an example. Figure 4-6 support for power servers web page although the content under the popular links section can change, click the firmware and hmc updates link to go to the resource...
Page 192
178 ibm power 750 and 760 technical overview and introduction ibm provides the concurrent firmware maintenance (cfm) function on selected power systems. This function supports applying nondisruptive system firmware service packs to the system concurrently (without requiring a reboot operation to act...
Page 193
Chapter 4. Continuous availability and manageability 179 with the power-on reset engine (pore), the firmware can now dynamically power off processor components, make changes to the registers and re-initialize while the system is running, without discernible impact to any applications running on a pr...
Page 194: 4.5 Power7+ Ras Features
180 ibm power 750 and 760 technical overview and introduction either the internet (https or vpn) or modem, and can be configured to communicate securely through gateways to provide customers a single point of exit from their site. Communication is one way. Activating electronic service agent does no...
Page 195: 4.6 Power-On Reset Engine
Chapter 4. Continuous availability and manageability 181 4.6 power-on reset engine the power7+ chip includes a power-on reset engine (pore), a programmable hardware sequencer responsible for restoring the state of a powered down processor core and l2 cache (deep sleep mode), or chiplet (winkle mode)...
Page 196
182 ibm power 750 and 760 technical overview and introduction optional ecc i/o hub with freeze behavior x x x x x x x pci bus extended error detection x x x x x x x pci bus extended error recovery x x x x most most most pci-pci bridge enhanced error handling x x x x - - - redundant rio or 12x channe...
Page 197
Chapter 4. Continuous availability and manageability 183 serviceability boot-time progress indicators x x x x most most most electronic service agent call home from management console x x x x x x x firmware error codes x x x x x x x operating system error codes x x x x most most most inventory colle...
Page 198
184 ibm power 750 and 760 technical overview and introduction live application mobility - x x - - - - repair and verify guided maintenance x x x x most most most concurrent kernel update - x x x x x x concurrent hot add/repair maintenance x x x x x x x power and cooling redundant, hot swap fans and ...
Page 199: Related Publications
© copyright ibm corp. 2013. All rights reserved. 185 related publications the publications listed in this section are considered particularly suitable for a more detailed discussion of the topics covered in this paper. Ibm redbooks the following ibm redbooks publications provide additional informati...
Page 200: Other Publications
186 ibm power 750 and 760 technical overview and introduction other publications these publications are also relevant as further information sources: ibm power facts and features - ibm power systems, ibm pureflex and power blades http://www.Ibm.Com/systems/power/hardware/reports/factsfeatures.Html s...
Page 201: Online Resources
Related publications 187 online resources these websites are also relevant as further information sources: ibm power systems hardware information center http://pic.Dhe.Ibm.Com/infocenter/powersys/v3r1m5/index.Jsp ibm system planning tool website http://www.Ibm.Com/systems/support/tools/systemplannin...
Page 202
188 ibm power 750 and 760 technical overview and introduction.
Page 204: Red
® redp-4985-00 international technical support organization building technical information based on practical experience ibm redbooks are developed by the ibm international technical support organization. Experts from ibm, customers and partners from around the world create timely technical informat...