- DL manuals
- IBM
- Server
- Power 595
- Technical Overview And Introduction
IBM Power 595 Technical Overview And Introduction
Summary of Power 595
Page 1
Ibm.Com/redbooks red paper front cover ibm power 595 technical overview and introduction charlie cler carlo costantini powervm virtualization technology including live partition mobility world-class performance and flexibility mainframe-inspired continuous availability.
Page 3
International technical support organization ibm power 595 technical overview and introduction august 2008 redp-4440-00
Page 4
© copyright international business machines corporation 2008. All rights reserved. Note to u.S. Government users restricted rights -- use, duplication or disclosure restricted by gsa adp schedule contract with ibm corp. First edition (august 2008) this edition applies to the ibm power systems 595 (9...
Page 5: Contents
© copyright ibm corp. 2008. All rights reserved. Iii contents notices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Vii trademarks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ....
Page 6
Iv ibm power 595 technical overview and introduction 2.3.1 bulk power hub (bph) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58 2.3.2 bulk power controller (bpc) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60 2.3.3 bu...
Page 7
Contents v 3.2 powervm and powervm editions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 110 3.3 capacity on demand. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 111 3.3.1 permanent activation . . . . . . . . . ....
Page 8
Vi ibm power 595 technical overview and introduction 4.6 cluster solution . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 169 related publications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ....
Page 9: Notices
© copyright ibm corp. 2008. All rights reserved. Vii notices this information was developed for products and services offered in the u.S.A. Ibm may not offer the products, services, or features discussed in this document in other countries. Consult your local ibm representative for information on th...
Page 10: Trademarks
Viii ibm power 595 technical overview and introduction trademarks ibm, the ibm logo, and ibm.Com are trademarks or registered trademarks of international business machines corporation in the united states, other countries, or both. These and other ibm trademarked terms are marked on their first occu...
Page 11: Preface
© copyright ibm corp. 2008. All rights reserved. Ix preface this ibm® redpaper is a comprehensive guide describing the ibm power 595 (9119-fha) enterprise-class ibm power systems server. The goal of this paper is to introduce several technical aspects of this innovative server. The major hardware of...
Page 12: Become A Published Author
X ibm power 595 technical overview and introduction partners. Carlo has broad marketing experience and his current major areas of focus are competition, sales, and technical sales support. He is a certified specialist for power systems servers. He holds a masters degree in electronic engineering fro...
Page 13: General Description
© copyright ibm corp. 2008. All rights reserved. 1 chapter 1. General description ibm system i™ and ibm system p™ platforms are unifying the value of their servers into a single and powerful lineup of ibm power systems servers based on power6-processor technology with support for the ibm i operating...
Page 14
2 ibm power 595 technical overview and introduction 1.1 model overview and attributes the power 595 server (9119-fha) offers an expandable, high-end enterprise solution for managing the computing requirements to enable your business to become an on demand business. The power 595 is an 8- to 64-core ...
Page 15
Chapter 1. General description 3 table 1-1 attributes of the 9119-fha attribute 9119-fha smp processor configurations 8- to 64 core power6 using 8-core processor books 8-core processor books up to 8 power6 processor clock rate 4.2 ghz standard or 5.0 ghz turbo l2 cache 4 mb per core l3 cache 32 mb p...
Page 16: 1.2 Installation Planning
4 ibm power 595 technical overview and introduction 1.2 installation planning complete installation instructions are shipped with each server. The power 595 server must be installed in a raised floor environment. Comprehensive planning information is available at this address: http://publib.Boulder....
Page 17
Chapter 1. General description 5 table 1-3 lists the power 595 server full system weights without the covers. Table 1-3 power 595 server full system weights (no covers) table 1-4 lists the power 595 cover weights. Table 1-4 power 595 cover weights table 1-5 lists the power 595 shipping crate dimensi...
Page 18
6 ibm power 595 technical overview and introduction figure 1-1 service clearances for a two-rack system configuration with acoustic doors service clearances for other configurations can be found at: http://publib.Boulder.Ibm.Com/infocenter/eserver/v1r3s/index.Jsp?Topic=/iphad/serv iceclearance.Htm 1...
Page 19
Chapter 1. General description 7 1.2.4 power requirements all power 595 configurations are designed with a fully redundant power system. To take full advantage of the power subsystem redundancy and reliability features, each of the two power cords should be connected to different distribution panels...
Page 20
8 ibm power 595 technical overview and introduction table 1-8 electrical characteristics (u.S., canada, and japan) table 1-9 lists the electrical characteristics for 4.2 ghz and 5.0 ghz power 595 servers, and the powered expansion rack (world trade). Table 1-9 electrical characteristics (world trade...
Page 21
Chapter 1. General description 9 1.3 minimum configuration requirements this section discusses the minimum configuration requirements for the power 595. Also provided are the appropriate feature codes for each system component. The ibm configuration tool also identifies the feature code for each com...
Page 22
10 ibm power 595 technical overview and introduction table 1-10 power 595 minimum system configuration prior to the availability of 12x expansion drawers (#5797 or #5798), new server shipments will use an rio i/o expansion drawer model dependent on the primary operating system selected. When 12x exp...
Page 23
Chapter 1. General description 11 if ibm i is specified as the primary operating system, refer to table 1-12, which lists the minimum required features. Table 1-12 minimum required features when ibm i is the primary operating system 1.3.1 minimum required processor card features the minimum configur...
Page 24
12 ibm power 595 technical overview and introduction 1.3.2 memory features the power 595 utilizes ddr2 dram memory cards. Each processor book provides 32 memory card slots for a maximum of 256 memory cards per server. The minimum system memory is 16 gb of active memory per processor book. The power ...
Page 25
Chapter 1. General description 13 for further information about ibm disk storage systems, including withdrawn products, visit: http://www.Ibm.Com/servers/storage/disk/ the power 595 has the following minimum and maximum configurable i/o device allocation requirements: the 595 utilizes 4u-tall remote...
Page 26
14 ibm power 595 technical overview and introduction for ibm i applications, a maximum of 96 rio-2 drawers or 30 12x i/o drawers can be attached to the 595, depending on the server and attachment configuration.The ibm i supported #0595, #0588, #5094/#5294, #5096/#5296 and #5790 all provide pci slots...
Page 27
Chapter 1. General description 15 the power 595 server must have access to a device capable of reading cd/dvd media or to a nim server. The recommended devices for reading cd/dvd media is the power 595 media drawer (#5720), or and external dvd device (7214-1u2, or 7212-103). Ensure there is a sas ad...
Page 28
16 ibm power 595 technical overview and introduction systems with non-looped configurations could experience degraded performance and serviceability. Rio-2 loop connections operate bidirectional at 1 gbps (2 gbps aggregate). Rio-2 loops connect to the system cec using rio-2 loop attachment adapters ...
Page 29
Chapter 1. General description 17 large write cache disk controllers, specific fibre channel adapters, iscsi adapters, and specific wan/lan adapters. System i hardware technologies and the ibm i operating system (os/400®, i5/os, and so forth) have a long history of supporting i/o adapters (ioas, als...
Page 30
18 ibm power 595 technical overview and introduction existing hmc models 7310 can be upgraded to licensed machine code version 7 to support environments that can include power5, power5+, and power6 processor-based servers. Version 7 is not available for the 7315 hmcs. Licensed machine code version 6...
Page 31
Chapter 1. General description 19 ordering a model conversion provides: change in model designation from p5-590, p5-595, i5-595, and i5-570 to 595 (9119-fha) power 595 labels with the same serial number as the existing server any model-specific system documentation that ships with a new 595 server e...
Page 32
20 ibm power 595 technical overview and introduction feature codes for model conversions the following tables list, for every model conversion, the feature codes involved (processor, memory, rio adapters, racks, memory, capacity on demand, and others). From type-model 9119-590 table 1-16 details new...
Page 33
Chapter 1. General description 21 table 1-19, table 1-20, and table 1-21 list features involved in the 9119-590 to 9119-fha model conversion (rack-related, the specify-codes, and memory). Table 1-19 feature conversions for 9119-590 to 9119-fha rack-related table 1-20 feature conversions for 9119-590...
Page 34
22 ibm power 595 technical overview and introduction from type-model 9119-595 table 1-22 on page 23, table 1-23 on page 23, and table 1-24 on page 23 list features in a 9119-595 to 9119-fha model conversion. #7814 - 4 gb ddr2 memory card, 533 mhz #5694 - 0/8 gb ddr2 memory (4x2 gb) dimms- 667 mhz- p...
Page 35
Chapter 1. General description 23 table 1-22 processor feature conversions for 9119-595 to 9119-fha table 1-23 adapter feature conversions for 9119-595 to 9119-fha table 1-24 additional memory feature conversions for 9119-595 to 9119-fha from feature code to feature code #7988 - 16-core power5 stand...
Page 36
24 ibm power 595 technical overview and introduction table 1-25 and table 1-26 list features involved in the 9119-595 to 9119-fha model conversion (rack-related, specify codes). Table 1-25 feature conversions for 9119-595 to 9119-fha rack-related table 1-26 feature conversions for 9119-595 to 9119-f...
Page 37
Chapter 1. General description 25 table 1-31 administrative feature conversions for 9406-570 to 9119-fha table 1-32 capacity on demand feature conversions for 9406-570 to 9119-fha #7618 - 570 one processor activation #4755 - processor activation #4755 #7738 - 570 base processor activation #4755 - pr...
Page 38
26 ibm power 595 technical overview and introduction table 1-33 memory feature conversions for 9406-570 to 9119-fha from feature code to feature code #4452 - 2 gb ddr-1 main storage #5693 - 0/4 gb ddr2 memory (4x1 gb) dimms-667 mhz- power6 cod memory #4453 - 4 gb ddr main storage #5693 - 0/4 gb ddr2...
Page 39
Chapter 1. General description 27 from type-model 9406-595 table 1-34, table 1-35 on page 28, table 1-36 on page 28, table 1-37 on page 28, table 1-38 on page 29, and table 1-39 on page 29 list the feature codes involved in 9406-595 to 9119-fha model conversion. Table 1-34 feature conversions for 94...
Page 40
28 ibm power 595 technical overview and introduction table 1-35 feature conversions for 9406-595 adapters table 1-36 feature conversions for 9406-595 to 9119-fha capacity on demand table 1-37 feature conversions for 9406-595 to 9119-fha memory features from feature code to feature code #7818 - hsl-2...
Page 41
Chapter 1. General description 29 table 1-38 feature conversions for 9406-595 to 9119-fha miscellaneous table 1-39 feature conversions for 9406-595to 9119-fha specify codes 1.4 racks power and cooling a power 595 system uses racks to house its components: the 24-inch rack system rack includes an int...
Page 42
30 ibm power 595 technical overview and introduction additional requirements are as follows: the 12x i/o drawer (#5797) can be used for additional i/o capacity in the 595 system rack and both of the 595 expansion racks (#6953 and #6954). The 12x i/o drawer (#5798) can only be used in the system rack...
Page 43
Chapter 1. General description 31 the acoustical front door and rear door heat exchanger kit provides both additional cooling and acoustical noise reduction for use where a quieter environment is desired along with additional environmental cooling. This feature provides a specially designed front ac...
Page 44
32 ibm power 595 technical overview and introduction assemblies in the system rack. The bulk power is converted to the power levels required for the cec using dc to dc power converters (dcas). Additional power regulators (#6186) are used with the p5 powered expansion rack (#5792), when needed. Redun...
Page 45
Chapter 1. General description 33 a sequence of selection fields is available with each entry you select. Selection fields include an operating system (for example ibm i, aix, linux) and other software categories that include microcode, firmware, and others. For most options you must select a releas...
Page 46
34 ibm power 595 technical overview and introduction aix v6.1 features include support for: powervm aix 6 workload partitions (wpar) - software based virtualization live application mobility - with the ibm powervm aix 6 workload partitions manager™ for aix (5765-wpm) 64-bit kernel for higher scalabi...
Page 47
Chapter 1. General description 35 1.5.4 ibm i 6.1 before you install ibm i 6.1 on the 595 server, your system must meet the following minimum requirements: ibm i 6.1 (formerly known as i5/os v6r1), or later as with previous releases, 6.1 builds on top of the ibm i integrated capabilities with enhanc...
Page 48
36 ibm power 595 technical overview and introduction the powervm features are supported in version 2.6.9 and above of the linux kernel. The commercially available latest distributions from red hat enterprise (rhel as 5) and novell suse linux (sles 10) support the ibm system p 64-bit architectures an...
Page 49: Architectural and Technical
© copyright ibm corp. 2008. All rights reserved. 37 chapter 2. Architectural and technical overview this chapter discusses the overall system architecture and technical aspects of the power 595 server. The 595 is based on a modular design, where all components are mounted in 24-inch racks. Figure 2-...
Page 50: 2.1 System Design
38 ibm power 595 technical overview and introduction 2.1 system design the ibm power 595 enterprise class structure is the result of the continuous evolution of 595 through pseries®. Its structure and design have been continuously improved, adding more capacity, performance, functionality, and conne...
Page 51
Chapter 2. Architectural and technical overview 39 figure 2-2 details primary rack major subsystems. Figure 2-2 power 595 front view figure 2-3 on page 40 shows the four air-moving devices at the rear of the power 595. Figure 2-25 on page 69 shows the air flow. Io drawers dual clocks bulk power asse...
Page 52
40 ibm power 595 technical overview and introduction figure 2-3 power 595 rear view 2.1.2 center electronic complex (cec) the power 595 cec is a 20u tall, 24-inch rack-mounted device. It houses the system processors, memory, redundant system service processors, i/o drawer connection capability, and ...
Page 53
Chapter 2. Architectural and technical overview 41 the processor book vpd card holds the vpd card and svpd (cod) for processor book information. Routes sense and control signals pass between the dcas and processor book planar (dimm led control). The vps card plugs into processor book planar and the ...
Page 54
42 ibm power 595 technical overview and introduction table 2-1 processor book installation sequence figure 2-5 details the processor book installation sequence. Figure 2-5 processor book layout 2.1.3 cec midplane the power6 595 cec midplane holds the processor books in an ingenious way: four attach ...
Page 55
Chapter 2. Architectural and technical overview 43 figure 2-6 cec midplane table 2-2 lists the cec midplane component locations codes. Table 2-2 cec location codes 2.1.4 system control structure (scs) the power 595 has the ability to run multiple different operating systems on a single server. There...
Page 56
44 ibm power 595 technical overview and introduction the term system control structure (scs) describes an area within the scope of hardware platform management. It addresses the lower levels of platform management, for example the levels that directly deal with accessing and controlling the server h...
Page 57
Chapter 2. Architectural and technical overview 45 required the development of a rigorously modular management architecture, which organizes the management model in the following ways: groups together the management of closely related subsets of hardware elements and logical resources. Divides the m...
Page 58
46 ibm power 595 technical overview and introduction manager and ml2 layer is the agent or the manageable unit. Ml3 layer functions submit transactions that are executed by the ml2 layer. The system controllers’s scope is, as reported before, to manage one system consisting of one or more subsystems...
Page 59
Chapter 2. Architectural and technical overview 47 2.1.5 system controller (sc) card two service processor cards are on the cec midplane. These cards are referred to as system controllers (sc). Figure 2-8 shows a system controller. Figure 2-8 system controller card the sc card provides connectors fo...
Page 60
48 ibm power 595 technical overview and introduction figure 2-9 spcn control network 2.1.6 system vpd cards two types of vital product data (vpd) cards are available: vpd and smartchip vpd (svpd). Vpd for all field replaceable unit (frus) are stored in serial eprom (seeprom). Vpd seeprom modules are...
Page 61
Chapter 2. Architectural and technical overview 49 2.1.7 oscillator card two (redundant) oscillator cards are on the cec midplane. These oscillator cards are sometimes referred to as clock cards . An oscillator card provides clock signals to the entire system. Although the card is actively redundant...
Page 62
50 ibm power 595 technical overview and introduction 2.1.9 dc converter assembly (dca) for the cec, dc power is generated by redundant, concurrently maintainable dc to dc converter assemblies (dcas). The dcas convert main isolated 350vdc to voltage levels appropriate for the processors, memory and c...
Page 63: 2.2 System Buses
Chapter 2. Architectural and technical overview 51 2.2 system buses the power6 processor interfaces can be divided into three categories: smp interconnect: these interfaces connect the power6 processors to each other. These links form a coherent fabric for system requests in addition to a data routi...
Page 64
52 ibm power 595 technical overview and introduction figure 2-13 fbc bus connections the topologies that are illustrated in figure 2-14 on page 54 are described in table 2-3. Table 2-3 topologies of power5 and power6 system description (a) power5 the topology of a power5 processor-based system consi...
Page 65
Chapter 2. Architectural and technical overview 53 with both the power5 and the power6 processor approaches, large systems are constructed by aggregating multiple nodes. (b) power5 a power5 processor-based system can interconnect up to eight nodes with a parallel ring topology. With this approach, b...
Page 66
54 ibm power 595 technical overview and introduction figure 2-14 power5 and power6 processor (a) first-level nodal topology and (b) second-level system topology. Figure 2-15 on page 55 illustrates the potential for a large, robust, 64-core system that uses 8-byte smp interconnect links, both l3 data...
Page 67
Chapter 2. Architectural and technical overview 55 figure 2-15 power 595 64 core 2.2.2 i/o subsystem the power 595 utilizes remote i/o drawers for directly attached pci or pci-x adapters and disk capabilities.The 595 supports i/o dasd and media drawers through remote i/o (rio), high speed loop (hsl)...
Page 68
56 ibm power 595 technical overview and introduction a maximum of four adapters can be installed in each 8-core processor book: two wide and two narrow. Beginning with the adapter slot closest to node controller 0, the slots alternate narrow-wide-narrow-wide. Gx slots t and u are narrow; s and v are...
Page 69: 2.3 Bulk Power Assembly
Chapter 2. Architectural and technical overview 57 figure 2-17 plugging order 2.3 bulk power assembly the power 595 system employs a universal front-end power system. It can accept nominal ac inputs from 200 v to 480 v at 50 or 60 hz and converts this to a main isolated 350 v dc nominal bulk power. ...
Page 70
58 ibm power 595 technical overview and introduction these components are shown in figure 2-18. Figure 2-18 bulk power assembly the power subsystem in the primary system rack is capable of supporting power 595 servers with one to eight processor books installed, a media drawer, and up to three i/o d...
Page 71
Chapter 2. Architectural and technical overview 59 l figure 2-19 bulk power hubs (bph) table 2-5 list the bph location codes. Table 2-5 bulk power hub (bph) location codes b p c b p c hmc hmc s c s c p4 n c n c p3 n c n c p8 n c n c p7 n c 3 p2 n c n c p6 n c n c p5 n c n c p9 n c n c j01 j02 j03 j0...
Page 72
60 ibm power 595 technical overview and introduction 2.3.2 bulk power controller (bpc) one bpc, shown in figure 2-20, is located in each bpa. The bpc provides the base power connections for the internal power cables. Eight power connectors are provided for attaching system components. In addition, t...
Page 73
Chapter 2. Architectural and technical overview 61 table 2-7 bulk power distribution (bpd) assembly component location codes 2.3.4 bulk power regulators (bpr) the redundant bprs interface to the bulk power assemblies to help ensure proper power is supplied to the system components. Figure 2-22 on pa...
Page 74
62 ibm power 595 technical overview and introduction figure 2-22 bulk power regulator (bpr) assemblies table 2-8 lists the bpr component location codes. Table 2-8 bulk power regulator (bpr) component location codes 2.3.5 bulk power fan (bpf) each bulk power assembly has a bpf for cooling the compone...
Page 75
Chapter 2. Architectural and technical overview 63 figure 2-23 bulk power fan (bpf) 2.3.6 integrated battery feature (ibf) an optional integrated battery feature (ibf) is available for the power 595 server. The battery backup units are designed to protect against power line disturbances and provide ...
Page 76
64 ibm power 595 technical overview and introduction hardware, firmware, and systems software, to provide a complete power and thermal management solution. Ibm has a comprehensive strategy for data center energy management: reduce power at the system level where work per watt is the important metric...
Page 77
Chapter 2. Architectural and technical overview 65 energyscale is an infrastructure that enables: real-time measurements feedback to address variability and unpredictability of parameters such as power, temperature, activity, and performance mechanisms for regulating system activity, component opera...
Page 78
66 ibm power 595 technical overview and introduction figure 2-24 power management architecture energyscale functions the ibm energyscale functions, and hardware and software requirements are described in the following list: power trending energyscale provides continuous power usage data collection (...
Page 79
Chapter 2. Architectural and technical overview 67 something that should never be reached but frees up margined power in the data center. The margined power is the amount of extra power that is allocated to a server during its installation in a data center. It is based on the server environmental sp...
Page 80
68 ibm power 595 technical overview and introduction the power 595 uses the existing mdc microcontroller found on each dca to perform the tpmd's functions and executes the firmware that run there. It uses communication between the two mdcs on each processor book and the embedded node controller serv...
Page 81: 2.4 System Cooling
Chapter 2. Architectural and technical overview 69 consistent power management for all power system offerings from bladecenter to power 595. 2.4 system cooling cec cooling is provided by up to four air-moving devices (high-pressure, high-flow blowers) that mount to a plenum on the rear of the cec ca...
Page 82: 2.6 Processor Books
70 ibm power 595 technical overview and introduction to identify frus within a node (mcms, dimms, hub cards, or node controllers), both the fru led (within the node, or on the light strip) and the node led (on the light strip) must be on. The front light strip is shown in figure 2-26. Figure 2-26 fr...
Page 83
Chapter 2. Architectural and technical overview 71 figure 2-28 ibm power 595 processor book architecture the available processor books are listed in table 2-12. Table 2-12 available processor books feature code description #4694 0/8-core power6 4.2 ghz cod 0-core active processor book mcm t power6 d...
Page 84
72 ibm power 595 technical overview and introduction several methods for activating cod power6 processors are available. Table 2-13 lists the cod processor activation features and corresponding cod modes. Additional information about the cod modes are provided in section 3.3, “capacity on demand” on...
Page 85: Power6
Chapter 2. Architectural and technical overview 73 figure 2-29 power 595 processor book (shown in upper placement orientation) each mcm, shown in figure 2-30, contains one dual-core power6 processor chip and two l3 cache chips. Figure 2-30 multi-chip module (mcm) the power6 processor chip provides 4...
Page 86
74 ibm power 595 technical overview and introduction features that are not implemented in the power6 processors within other power systems and system p servers. These features include: dual, integrated l3 cache controllers dual, integrated memory controllers two additional (of the many) enhancements...
Page 87
Chapter 2. Architectural and technical overview 75 figure 2-31 power6 processor the cmos 11s0 lithography technology in the power6 processor uses a 65 nm fabrication process, which enables: performance gains through faster clock rates from up to 5.0 ghz physical size of 341 mm the power6 processor c...
Page 88
76 ibm power 595 technical overview and introduction – two floating-point operations – one branch operation the power6 processor implements the 64-bit ibm power architecture® technology. Each power6 chip incorporates two ultrahigh dual-threaded simultaneous multithreading processor cores, a private ...
Page 89
Chapter 2. Architectural and technical overview 77 examples are discussed in the following list: java applications: applications running ibm technology for java 6.0 32-bit and 64-bit jvm automatically take advantage of the hardware assist during the initial just in time (jit) processing. Application...
Page 90: 2.7 Memory Subsystem
78 ibm power 595 technical overview and introduction 2.7 memory subsystem the power 595 server uses fully buffered, double data rate (ddr2) dram memory dimms. The dimm modules are x8 organized (8 data bits per module). Support is provided for migrated x4 dimm modules. Memory dimms are available in t...
Page 91
Chapter 2. Architectural and technical overview 79 figure 2-32 memory system logical view each processor book supports a total of eight memory units (32 dimms or eight memory features). A fully configured power 595 server with eight processor books supports up to 64 memory units (256 dimms). Using m...
Page 92
80 ibm power 595 technical overview and introduction 2.7.2 available memory features the available memory features (4 dimm units) for the 595 server are shown in table 2-15. Table 2-15 available memory features all memory features for the 595 server are shipped with zero activations. A minimum perce...
Page 93
Chapter 2. Architectural and technical overview 81 2.7.3 memory configuration and placement each processor book features four mcms. The layout of the mcms and their corresponding memory units (a unit is a memory feature, or 4 dimms) is shown in figure 2-33. Figure 2-33 processor book with mcm and me...
Page 94: 2.8 Internal I/o Subsystem
82 ibm power 595 technical overview and introduction when multiple dimm sizes are ordered, smaller dimm sizes are placed in the fewest processor books possible, while insuring that the quantity of remaining larger dimms are adequate to populate at least one feature code per mcm module. The largest d...
Page 95
Chapter 2. Architectural and technical overview 83 2.8.1 connection technology rio-2 and 12x connectivity is provided using gx bus adapter based, remote i/o hubs. These remote i/o hubs are listed in table 2-19. Table 2-19 remote i/o hubs each i/o hub provides two ports that are used to connect inter...
Page 96
84 ibm power 595 technical overview and introduction figure 2-35 i/o hub installation sequence 2.8.2 internal i/o drawers the internal i/o drawers (24 inches) provide storage and i/o connectivity for the 595 server. The available internal i/o drawers are listed in table 2-20 table 2-20 internal i/o ...
Page 97
Chapter 2. Architectural and technical overview 85 figure 2-36 shows the components of an internal i/o drawer. The i/o riser cards provide rio-2 or 12x ports that are connected via cables to the i/o hubs located in the processor books within the cec. Figure 2-36 i/o drawer internal view each i/o dra...
Page 98
86 ibm power 595 technical overview and introduction rio-2 based internal i/o drawer (#5791) the 5791 internal i/o drawer uses rio-2 connectivity to the cec. All 20 slots are pci-x based. An internal diagram of the #5791 internal i/o drawer is shown in figure 2-37. Figure 2-37 #5791 internal i/o exp...
Page 99
Chapter 2. Architectural and technical overview 87 figure 2-38 #5797 and #5798 internal i/o drawers (12x) the power 595 server supports up to 30 expansion drawers (maximum of 12 for rio-2). Figure 2-39 on page 88 shows the drawer installation sequence when the integrated battery feature (ibf) is not...
Page 100
88 ibm power 595 technical overview and introduction figure 2-39 power 595 i/o expansion drawer locations 2.8.3 internal i/o drawer attachment the internal i/o drawers are connected to the 595 server cec using rio-2 or 12x technology. Drawer connections are made in loops to help protect against erro...
Page 101
Chapter 2. Architectural and technical overview 89 table 2-22 number of rio drawers that can be connected 2.8.4 single loop (full-drawer) cabling single loop i/o drawer connections are shown in figure 2-40. Figure 2-40 single loop i/o drawer cabling number of installed processor books rio-2 (#5791) ...
Page 102
90 ibm power 595 technical overview and introduction the short cable connecting the two halves of the drawer ensures that each planar (p1 and p2) within the drawer can access the i/o hub adapter card, even if one of the main connection cables is disconnected or damaged. 2.8.5 dual looped (half-drawe...
Page 103
Chapter 2. Architectural and technical overview 91 – the upper connector on the i/o expansion drawer riser card will connect to the right connector on the i/o hub adapter in the processor book. Loop connection sequence the i/o expansion drawer loops is cabled to the i/o hubs using an even distributi...
Page 104: 2.9 Pci Adapter Support
92 ibm power 595 technical overview and introduction 2.9 pci adapter support ibm offers pci and pci-extended (pci-x) adapters for the 595 server. All adapters support enhanced error handling (eeh). A pci, pci-x, and pci-x 2.0 adapters can be installed in any available pci-x pr pci-x 2.0 slot. Most o...
Page 105
Chapter 2. Architectural and technical overview 93 2.9.1 lan adapters table 2-23 lists the lan adapters that are available for the 595 server. Table 2-23 available lan adapter 2.9.2 scsi adapters table 2-24 lists the scsi adapters that are available for the 595 server. Table 2-24 available scsi adap...
Page 106
94 ibm power 595 technical overview and introduction 2.9.3 iscsi internet scsi (iscsi) is an open, standards-based approach by which scsi information is encapsulated using the tcp/ip protocol to allow its transport over ip networks. It allows transfer of data between storage and servers in block i/o...
Page 107
Chapter 2. Architectural and technical overview 95 wires used as two differential signal pairs. One differential signal transmits in one direction while the other differential signal transmits in the opposite direction. Data can be transmitted in both directions simultaneously. Table 2-26 lists the ...
Page 108
96 ibm power 595 technical overview and introduction wan port that provides support for v.21, v.24/eia232, v.35 and v.36 communication protocols. Table 2-28 lists the asynchronous, wan, and modem adapters that are available for the 595 server. Table 2-28 available asynchronous, wan, and modem adapte...
Page 109: 2.10 Internal Storage
Chapter 2. Architectural and technical overview 97 2.9.8 iop adapter the pci iop adapter is used to drive pci ioa adapters located in expansion drawers, units, and towers. Pci iop and pci ioa adapters are used exclusively by the ibm i operating system. Each pci iop adapter can support up to four pci...
Page 110: 2.11 Media Drawers
98 ibm power 595 technical overview and introduction table 2-33 disk drive options 2.11 media drawers tape and dvd support is provided though the use of a media drawer. As listed in table 2-34, two media drawers are available for the 595 server. Only one #5720 is supported per 595 system. Table 2-34...
Page 111
Chapter 2. Architectural and technical overview 99 2.11.1 media drawer, 19-inch (7214-1u2) the media drawer, 19-inch is a rack mounted media drawer with two media bays as shown in figure figure 2-43 figure 2-43 19” media drawer, 19-inch (7214-1u2) the first bay in the 7214-1u2 media drawer supports ...
Page 112
100 ibm power 595 technical overview and introduction 2.12 external i/o enclosures the 595 server supports three external i/o enclosures that are mounted in 19-inch racks. These enclosures are listed in table 2-36. Table 2-36 external i/o enclosures 2.12.1 totalstorage exp24 disk dwr (#5786) the tot...
Page 113
Chapter 2. Architectural and technical overview 101 2.13 hardware management console (hmc) the hardware management console (hmc) is a dedicated workstation that provides a graphical user interface for configuring, operating, and performing basic system tasks for power6 processor-based (as well as po...
Page 114
102 ibm power 595 technical overview and introduction the 595 server requires one primary hmc that can communicate to all bphs in the system. The primary hmc is connected to port j01 on the bph located on the front side of the system (cec) rack. On a systems that support mission-critical workloads, ...
Page 115
Chapter 2. Architectural and technical overview 103 engineer can sign onto the hmc, the service representative might request the hmc serial number. To find the hmc serial number, open a restricted shell window and run the following command: #lshmc -v 2.14 advanced system management interface the adv...
Page 116
104 ibm power 595 technical overview and introduction 2.14.2 accessing the asmi using an ascii console the asmi on an ascii console supports a subset of the functions provided by the web interface and is available only when the system is in the platform standby state. The asmi on an ascii console is...
Page 117
Chapter 2. Architectural and technical overview 105 2.14.4 server firmware server firmware is the part of the licensed internal code that enables hardware, such as the service processor. Check for available server firmware fixes regularly. Depending on your service environment, you may download your...
Page 118
106 ibm power 595 technical overview and introduction the service processor has various functional states, which can be queried and reported to the power hypervisor component. Service processor states include, but are not limited to, standby, reset, power up, power down, and run time. As part of the...
Page 119
Chapter 2. Architectural and technical overview 107 firmware levels the levels of firmware are: installed level indicates the level of firmware that has been installed and is installed in memory after the managed system is powered off, and powered on using the default temporary side. Activated level...
Page 120
108 ibm power 595 technical overview and introduction.
Page 121: Virtualization
© copyright ibm corp. 2008. All rights reserved. 109 chapter 3. Virtualization the power 595 server combined with optional powervm technology provides powerful virtualization capabilities that can help you consolidate and simplify your environment. This chapter provides an overview of these virtuali...
Page 122
110 ibm power 595 technical overview and introduction 3.2 powervm and powervm editions powervm is a combination of hardware feature enablement and value-added software that provides additional virtualization functions beyond the standard 595 server virtualization capabilities. Powervm enables: share...
Page 123: 3.3 Capacity On Demand
Chapter 3. Virtualization 111 powervm standard edition can be upgraded to powervm enterprise edition by providing a key code, which is entered at the hmc. This upgrade operation is nondisruptive. Additional information about the different powervm editions can be found at the ibm powervm editions web...
Page 124
112 ibm power 595 technical overview and introduction for more information about capacity on demand, visit http://www.Ibm.Com/systems/power/hardware/cod 3.3.1 permanent activation you can permanently activate cod processors and memory by ordering the appropriate activation feature codes. Minimum act...
Page 125
Chapter 3. Virtualization 113 3.3.2 on/off cod on/off capacity on demand offers flexibility in meeting peak demands that are temporary in duration. Inactive cod processors and memory can be temporarily activated with a simple request made by an operator from the hmc. The on/off cod usage is measured...
Page 126
114 ibm power 595 technical overview and introduction consumed 999 memory days, you will need to place an order for another memory enablement code to reset the number of days that you can request to 999. On/off cod billing the on/off cod billing contract requires that you report usage data at least ...
Page 127: 3.4 Power Hypervisor
Chapter 3. Virtualization 115 systems allow you to have an off-site, disaster recovery machine at a lower entry price in comparison to a standard 595 server. The cbu offering includes: 4 processors that are permanently activated and can be used for any workload 28 or 60 standby processors available ...
Page 128: 3.5 Logical Partitioning
116 ibm power 595 technical overview and introduction table 3-6 configurable memory-to-default logical memory block size in most cases, the actual requirements and recommendations are between 256 mb and 512 mb. Physical memory is assigned to partitions in increments of the logical memory block (lmb)...
Page 129
Chapter 3. Virtualization 117 3.5.1 dynamic logical partitions logical partitioning technology allows you to divide a single physical system into separate logical partitions (lpars). Each lpar receives a user specified allocation of dedicated computing resources, such as: processors (whole cpu incre...
Page 130
118 ibm power 595 technical overview and introduction that these maximums are supported by the hardware, however the practical limits depend on the application workload demands. The processing resources allocated to an splar are called processing units (pu). The pu setting represents a guaranteed am...
Page 131: 3.6 Virtual Ethernet
Chapter 3. Virtualization 119 of lpars running in that pool. A system with three pools configured is shown in figure 3-2 on page 119. Figure 3-2 multiple shared processor pools multiple shared pools can help you manage expenses for operating systems and isv software by grouping common applications i...
Page 132: 3.7 Virtual I/o Server
120 ibm power 595 technical overview and introduction standard and 9000 bytes are supported with gigabit ethernet jumbo frames. Thus, with the power hypervisor’s virtual ethernet, you can increase tcp/ip’s mtu size to: 65394 (= 65408 - 14 for the header, no crc) if you do not use vlan 65390 (= 65408...
Page 133
Chapter 3. Virtualization 121 3.7.1 virtual scsi virtual scsi refers to a virtualized implementation of the scsi protocol. Virtual scsi is based on a client/server relationship. The virtual i/o server logical partition owns physical disk and resources and then acts as server or, in scsi terms, targe...
Page 134
122 ibm power 595 technical overview and introduction at the time of writing, virtual scsi supports fibre channel, parallel scsi, iscsi, sas, scsi raid devices and optical devices, including dvd-ram and dvd-rom. Other protocols such as ssa and tape devices are not supported. For more information abo...
Page 135
Chapter 3. Virtualization 123 figure 3-5 architectural view of a shared ethernet adapter a single sea setup can have up to 16 virtual ethernet trunk adapters and each virtual ethernet trunk adapter can support up to 20 vlan networks. Therefore, it is possible for a single physical ethernet to be sha...
Page 136: 3.8 Powervm Lx86
124 ibm power 595 technical overview and introduction 3.8 powervm lx86 the ibm powervm lx86 feature creates a virtual x86 application environment within a linux operating system-based partition running on your 595 server. Most 32-bit x86 linux applications can run in the lx86 environment without req...
Page 137
Chapter 3. Virtualization 125 although powervm lx86 runs most x86 linux applications, powervm lx86 cannot run applications that: directly access hardware devices (for example, graphics adapters). Require nonstandard kernel module access or use kernel modules not provided by the linux for power syste...
Page 138
126 ibm power 595 technical overview and introduction figure 3-7 live partition mobility example partition mobility provides systems management flexibility and can improve system availability when you: avoid planned outages for hardware or firmware maintenance by moving logical partitions to another...
Page 139
Chapter 3. Virtualization 127 – suse linux enterprise services 10 (sles 10) service pack 1 or later previous versions of aix and linux for power can participate in inactive partition mobility, if the operating systems support virtual devices and ibm system p power6 processor-based systems. Source an...
Page 140: 3.11 System Planning Tool
128 ibm power 595 technical overview and introduction live application mobility is part of workload partitions, and enables a way to relocate a wpar from one system to another. To assist with the management of wpars, ibm offers an optional product called workload partition manager (5765-wpm). Wpar m...
Page 141
Chapter 3. Virtualization 129 spt can create two files from your configuration work (which can include any combination of multiple aix, ibm i, and linux for power partitions): configuration file: the configuration file, denoted by the .Cfr file extension, can be imported to the ibm sales configurato...
Page 142
130 ibm power 595 technical overview and introduction the spt and its supporting documentation can be found on the ibm system planning tool site at: http://www.Ibm.Com/systems/support/tools/systemplanningtool/ note: in previous releases of the spt, you could view an hmc system plan, but not edit it....
Page 143: Continuous Availability and
© copyright ibm corp. 2008. All rights reserved. 131 chapter 4. Continuous availability and manageability this chapter provides information about ibm power systems design features that help lower the total cost of ownership (tco). The advanced ibm ras (reliability, availability, and serviceability) ...
Page 144: 4.1 Reliability
132 ibm power 595 technical overview and introduction 4.1 reliability highly reliable systems are built with highly reliable components. On ibm power6 processor-based systems, this basic principle is expanded on with a clear design for reliability architecture and methodology. A concentrated, system...
Page 145
Chapter 4. Continuous availability and manageability 133 4.1.2 placement of components packaging is designed to deliver both high performance and high reliability. For example, the reliability of electronic components is directly related to their thermal environment, that is, large decreases in comp...
Page 146: 4.2 Availability
134 ibm power 595 technical overview and introduction actions include incidents that effect system availability and incidents that are concurrently repaired. Unscheduled incident repair action (uira) is a hardware event that causes a system or partition to be rebooted in full or degraded mode. The s...
Page 147
Chapter 4. Continuous availability and manageability 135 operation on the remaining stable hardware. This prevents the same faulty hardware from affecting system operation again, and the repair action is deferred to a more convenient, less critical time. Persistent deallocation functions include: pr...
Page 148
136 ibm power 595 technical overview and introduction ibms logical partitioning strategy allows any processor core to be shared with any partition on the system, thus enabling the following sequential scenarios for processor deallocation and sparing: 1. When available, an unlicensed capacity on dema...
Page 149
Chapter 4. Continuous availability and manageability 137 power6 processor instruction retry to achieve the highest levels of server availability and integrity, ffdc and recovery safeguards must protect the validity of user data anywhere in the server, including all the internal storage areas and the...
Page 150
138 ibm power 595 technical overview and introduction c. Deallocating faulty core. Upon completion of the alternate processor recovery operation, the power hypervisor will de-allocate the faulty core for deferred repair. Processor contained checkstop: if a specific processor detected fault cannot be...
Page 151
Chapter 4. Continuous availability and manageability 139 bit line, it can dynamically steer the data stored at this bit line into one of a number of spare lines. Figure 4-4 shows memory protection capabilities in action. Figure 4-4 memory protection capabilities in action memory page deallocation al...
Page 152
140 ibm power 595 technical overview and introduction performance. The other power models deliver balanced performance using only a single memory controller. Some models also employ an l3 cache controller. A memory controller on a power6 process-based system is designed with four ports. Each port co...
Page 153
Chapter 4. Continuous availability and manageability 141 as the manager of system memory, at boot time the power hypervisor decides which memory to make available for server use and which to put in the unlicensed or spare pool, based upon system performance and availability considerations. – if the ...
Page 154
142 ibm power 595 technical overview and introduction processor host bridge (phb) chip. When the phb chip detects a problem. It rejects the data, preventing data being written to the i/o device. The phb then enters a freeze mode halting normal operations. Depending on the model and type of i/o being...
Page 155
Chapter 4. Continuous availability and manageability 143 purged, and the line is dynamically deleted (removed from further use). The state of l3 cache line delete is maintained in a deallocation record , so line delete persists through system ipl. This ensures that cache lines varied offline by the ...
Page 156
144 ibm power 595 technical overview and introduction gx+ bus adapters the gx+ bus provides the primary high bandwidth path for rio-2 or gx 12x dual channel adapter connection to the system cec. Errors in a gx+ bus adapter, flagged by system persistent deallocation logic, cause the adapter to be var...
Page 157
Chapter 4. Continuous availability and manageability 145 figure 4-6 pci error recovery 4.2.5 redundant components and concurrent repair update high opportunity components, or those that most affect system availability, are protected with redundancy and the ability to be repaired concurrently. Power ...
Page 158
146 ibm power 595 technical overview and introduction – vital product data and cod modules (active redundancy) – dcas (active redundancy) – voltage regulator modules (active redundancy, hot replace) blowers (active redundancy, hot replace) all out of band service interfaces (active redundancy) syste...
Page 159
Chapter 4. Continuous availability and manageability 147 functions, it is limited in size and complexity when compared to a full operating system implementation, and therefore can be considered better contained from a design and quality assurance viewpoint. As with any software development project, ...
Page 160
148 ibm power 595 technical overview and introduction 4.2.6 availability in a partitioned environment ibms dynamic logical partitioning architecture has been extended with micro-partitioning technology capabilities. These new features are provided by the power hypervisor and are configured using man...
Page 161
Chapter 4. Continuous availability and manageability 149 also offers advanced techniques designed to help contain failures in the coherency domain to a subset of the server. Through careful design, in many cases, failures are contained to a component or to a partition, despite the shared hardware sy...
Page 162: 4.3 Serviceability
150 ibm power 595 technical overview and introduction power6 memory protection key feature to increase the reliability of large, complex applications running under the aix v5.3 or aix 6 releases. Concurrent aix kernel update these updates allow installation of some kernel patches without rebooting t...
Page 163
Chapter 4. Continuous availability and manageability 151 4.3.1 service environments the ibm power5 and power6 processor platforms support three main service environments: servers that do not include a hardware management console (hmc). This is the manufacturing default configuration for from two ope...
Page 164
152 ibm power 595 technical overview and introduction • when the system fan speed is out of operational specification, for example because of a fan failure, the system can increase speed on the redundant fans to compensate for this failure or take other actions • when the server input voltages are o...
Page 165
Chapter 4. Continuous availability and manageability 153 error checkers ibm power6 process-based systems contain specialized hardware detection circuitry that can detect erroneous hardware operations. Error checking hardware ranges from parity error detection coupled with processor instruction retry...
Page 166
154 ibm power 595 technical overview and introduction figure 4-7 schematic of an fir implementation fault isolation the service processor interprets error data captured by the ffdc checkers, which is saved in the firs and who’s on first logic or other firmware-related data capture methods, to determ...
Page 167
Chapter 4. Continuous availability and manageability 155 initialization and configuration of i/o hardware, followed by os initiated software test routines. Boot-time diagnostic routines include: bists for both logic components and arrays ensure the internal integrity of components. Because the servi...
Page 168
156 ibm power 595 technical overview and introduction error logging and analysis after the root cause of an error has been identified by a fault isolation component, an error log entry is created and that includes basic data such as: an error code uniquely describing the error event the location of ...
Page 169
Chapter 4. Continuous availability and manageability 157 the data is formatted and prepared for transmission back to ibm to assist the service support organization with preparing a service action plan for the service representative or for additional analysis. System dump handling in some circumstanc...
Page 170
158 ibm power 595 technical overview and introduction ibm problem management database at the ibm support center, historical problem data is entered into the ibm service and support problem management database. All information related to the error and any service actions taken by the service represen...
Page 171
Chapter 4. Continuous availability and manageability 159 blind-swap pci adapters blind-swap pci adapters represent significant service and ease-of-use enhancements in i/o subsystem design while maintaining high pci adapter density. Standard pci designs supporting hot-add and hot-replace require top ...
Page 172
160 ibm power 595 technical overview and introduction are customized in the appropriate sequence for the particular repair for the specific system being repaired. Repair scenarios covered by repair and verify include: replacing a defective fru reattaching a loose or disconnected component correcting...
Page 173
Chapter 4. Continuous availability and manageability 161 gx+ bus persistent deallocation 9 9 9 9 — — pci bus extended error detection 9 9 9 9 9 9 pci bus extended error recovery 9 9 9 9 limited a limited pci-pci bridge extended error handling 9 9 9 9 9 9 redundant rio link 9 9 9 9 9 9 pci card hot s...
Page 174: 4.5 Manageability
162 ibm power 595 technical overview and introduction 4.5 manageability several functions and tools help you to efficiently and effectively manage your system. 4.5.1 service processor the service processor is a controller running its own operating system. It is a component of the service interface c...
Page 175
Chapter 4. Continuous availability and manageability 163 connections. The service processor provides the ability to view and manage the machine wide settings using the asmi, and allows complete system and partition management from the hmc. The service processor uses two ethernet 10/100 mbps ports th...
Page 176
164 ibm power 595 technical overview and introduction inventory. Electronic service agent can help focus on your company’s strategic business initiatives, save time, and spend less effort managing day to day it maintenance issues. Now integrated in aix 5l v5.3 tl6 in addition to the hmc, electronic ...
Page 177
Chapter 4. Continuous availability and manageability 165 customized support using the ibm id entered during activation, you may view system and support information in the my systems and premium search sections of the electronic services web site. The electronic services web portal is a single intern...
Page 178
166 ibm power 595 technical overview and introduction the asmi is accessible through: the hmc. For details, see section the next section, or see section 2.14, “advanced system management interface” on page 103. A web browser on a system that is connected directly to the service processor (in this ca...
Page 179
Chapter 4. Continuous availability and manageability 167 can be installed either from an hmc or from a running partition in case that system is not managed by an hmc. For update details, see the microcode web page: http://www14.Software.Ibm.Com/webapp/set2/firmware/gjsn if you use an hmc to manage y...
Page 180
168 ibm power 595 technical overview and introduction the service pack level ( fff ) and the last disruptive service pack level ( ddd ) are equal in new firmware. An installation is concurrent if the service pack level ( fff ) of the new firmware is higher than the service pack level currently insta...
Page 181: 4.6 Cluster Solution
Chapter 4. Continuous availability and manageability 169 4.6 cluster solution today's it infrastructure requires that servers meet increasing demands, while offering the flexibility and manageability to rapidly develop and deploy new services. Ibm clustering hardware and software provide the buildin...
Page 182
170 ibm power 595 technical overview and introduction.
Page 183: Related Publications
© copyright ibm corp. 2008. All rights reserved. 171 related publications the publications listed in this section are considered particularly suitable for a more detailed discussion of the topics covered in this paper. Ibm redbooks for information about ordering these publications, see “how to get r...
Page 184: Online Resources
172 ibm power 595 technical overview and introduction online resources these web sites are relevant as further information sources: ibm energyscale for power6 processor-based systems http://www.Ibm.Com/common/ssi/fcgi-bin/ssialias?Infotype=sa&subtype=wh&attachme nt=pow03002usen.Pdf&appname=stge_po_p...
Page 185: How to Get Redbooks
Related publications 173 how to get redbooks you can search for, view, or download redbooks, redpapers, technotes, draft publications and additional materials, as well as order hardcopy redbooks, at this web site: ibm.Com/redbooks help from ibm ibm support and downloads ibm.Com/support ibm global se...
Page 186
174 ibm power 595 technical overview and introduction.
Page 188: Red
® redp-4440-00 international technical support organization building technical information based on practical experience ibm redbooks are developed by the ibm international technical support organization. Experts from ibm, customers and partners from around the world create timely technical informat...