- DL manuals
- IBM
- Server
- OpenPower 720
- Technical Overview And Introduction
IBM OpenPower 720 Technical Overview And Introduction
ibm.com/redbooks
Red
paper
Front cover
IBM
OpenPower 720
Technical Overview
and Introduction
Giuliano Anselmi
Gregor Linzmeier
Wolfgang Seiwald
Philippe Vandamme
Scott Vetter
Deskside and rack-mount server for
managing e-business
Outstanding performance based on
POWER5 processor technology
From Web servers to
integrated cluster solutions
Summary of OpenPower 720
Page 1
Ibm.Com/redbooks red paper front cover ibm openpower 720 technical overview and introduction giuliano anselmi gregor linzmeier wolfgang seiwald philippe vandamme scott vetter deskside and rack-mount server for managing e-business outstanding performance based on power5 processor technology from web ...
Page 3
International technical support organization ibm sserver openpower 720 technical overview and introduction october 2004.
Page 4
© copyright international business machines corporation 2004. All rights reserved. Note to u.S. Government users restricted rights -- use, duplication or disclosure restricted by gsa adp schedule contract with ibm corp. Second edition (october 2004) this edition applies to ibm sserver openpower 720....
Page 5: Contents
© copyright ibm corp. 2004. All rights reserved. Iii contents notices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .V trademarks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ...
Page 6
Iv openpower 720 technical overview and introduction 2.7 internal storage . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28 2.7.1 internal media devices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ...
Page 7: Notices
© copyright ibm corp. 2004. All rights reserved. V notices this information was developed for products and services offered in the u.S.A. Ibm may not offer the products, services, or features discussed in this document in other countries. Consult your local ibm representative for information on the ...
Page 8: Trademarks
Vi openpower 720 technical overview and introduction trademarks the following terms are trademarks of the international business machines corporation in the united states, other countries, or both: eserver ® e server ® ibm.Com® iseries™ pseries® xseries® aix 5l™ aix/l® aix® chipkill™ db2 universal d...
Page 9: Preface
© copyright ibm corp. 2004. All rights reserved. Vii preface this document is a comprehensive guide covering the ibm sserver ® openpower 720 linux servers. We introduce major hardware offerings and discuss their prominent functions. Professionals wishing to acquire a better understanding of ibm sser...
Page 10: Become A Published Author
Viii openpower 720 technical overview and introduction the project that produced this document was managed by: scott vetter ibm u.S. Thanks to the following people for their contributions to this project: ron arroyo, barb hewitt, thoi nguyen, jan palmer, charlie reeves, craig shempert, scott smylie,...
Page 11: General Description
© copyright ibm corp. 2004. All rights reserved. 1 chapter 1. General description the ibm sserver openpower 720 deskside and rack-mount servers are designed for greater application flexibility, with innovative technology, designed to help you become an on demand business. With power5 microprocessor ...
Page 12
2 openpower 720 technical overview and introduction usb 2.0 capable ports, two hmc ports, two rio-2 ports, and two system power control network (spcn) ports. The openpower 720 includes four front-accessible, hot-swap-capable disk bays in a minimum configuration with an additional four hot-swap-capab...
Page 13: 1.1 System Specifications
Chapter 1. General description 3 1.1 system specifications table 1-1 lists the general system specifications of the openpower 720 system. Table 1-1 openpower 720 specifications 1.2 physical package the following sections discuss the major physical attributes found on an openpower 720 in rack-mounted...
Page 14
4 openpower 720 technical overview and introduction figure 1-1 rack-mount and deskside versions of the openpower 720 1.2.1 ibm eserver openpower 720 deskside the openpower 720 is available as a deskside server that is ideal for environments requiring the user to have local access to the hardware. A ...
Page 15
Chapter 1. General description 5 the gxt135p 2d graphics accelerator with analog and digital interfaces (fc 2849) is available and is supported for sms, firmware menus, and other low-level functions, as well as when linux starts the x11-based graphical user interface. Graphical system tools are usab...
Page 16
6 openpower 720 technical overview and introduction two usb 2.0 ports two hmc ports two remote i/o (rio-2) ports two spcn ports in addition, the openpower 720 features one internal ultra320 scsi dual channel controller, redundant hot-swap power supply (optional), cooling fans, and up to two processo...
Page 17
Chapter 1. General description 7 it is recommended that each processor card (if more than a single card is present) have an equal amount of memory installed. Balancing memory across the installed processor cards allows distributed memory accesses that provide optimal performance. The memory controll...
Page 18
8 openpower 720 technical overview and introduction integrated usb ports, or to a usb adapter (fc 2738). A maximum of one usb diskette drive is supported per integrated controller/adapter. The same controller can share a usb mouse and keyboard. 1.3.5 i/o drawers the openpower 720 has five internal p...
Page 19
Chapter 1. General description 9 figure 1-3 7311-d20 i/o drawer i/o drawers and usable pci slots only the 7311 model d20 i/o drawer is supported on an openpower 720 system. Depending on the system configuration, the maximum number of i/o drawers supported is different. Table 1-6 summarizes the maxim...
Page 20
10 openpower 720 technical overview and introduction hmcs can be converted for power5 processor-based systems use when it is loaded with the hmc software required for power5 processor-based systems (fc 0961). To upgrade an existing power4 hmc: order fc 0961 for your existing hmc. Please contact your...
Page 21
Chapter 1. General description 11 however, selection of features smaller than those defined as the minimums disqualify the order as an express product offering. If any of the features in an express product offering is changed, the express product offering identification feature (fc 935x) will be rem...
Page 22: 1.5 System Racks
12 openpower 720 technical overview and introduction 1.5 system racks the enterprise rack models t00 and t42 are 19-inch wide racks for general use with ibm sserver openpower, p5, pseries, and rs/6000 rack-based or rack drawer-based systems. The racks provide increased capacity, greater flexibility,...
Page 23
Chapter 1. General description 13 7311 i/o drawer, inside the rack. Servers can be programmed to illuminate the beacon in response to a detected problem or changes in system status. A rack status beacon junction box (fc 4693) should be used to connect multiple servers and i/o drawers to the beacon. ...
Page 24
14 openpower 720 technical overview and introduction power requirements and save previous investments, these power cords can be requested with an initial order of the rack, or with a later upgrade of the rack features. The pdu has twelve customer-usable iec 320-c13 outlets. There are six groups of t...
Page 25
Chapter 1. General description 15 1.5.5 additional options for rack the intention of this section is to highlight some solutions available to provide a single point of management for environments composed of multiple openpower 720 servers or other ibm sserver openpower, p5, pseries, and rs/6000 syst...
Page 26
16 openpower 720 technical overview and introduction netbay lcm switch (fc 4202). When connecting to a openpower 720, fc 4269 provides connection to the power5 usb ports. Only the ps/2 keyboard is supported when attaching the 7316-tf3 to the lcm switch. The following should be considered when select...
Page 27
Chapter 1. General description 17 figure 1-5 shows the drawing specifications for oem racks. Figure 1-5 reference drawing for oem rack specifications.
Page 28
18 openpower 720 technical overview and introduction.
Page 29: Architecture and Technical
© copyright ibm corp. 2004. All rights reserved. 19 chapter 2. Architecture and technical overview this chapter discusses the overall system architecture represented by figure 2-1. The major components of this diagram are described in the following sections. The bandwidths provided throughout this s...
Page 30: 2.1 The Power5 Chip
20 openpower 720 technical overview and introduction 2.1 the power5 chip the power5 chip features single-threaded and multi-threaded execution, providing higher performance in the single-threaded mode than its power4 predecessor at equivalent frequencies provides. Power5 maintains both binary and ar...
Page 31
Chapter 2. Architecture and technical overview 21 2.1.1 simultaneous multi-threading as a permanent requirement for performance improvements at the application level, simultaneous multi-threading (smt) functionality is embedded in the power5 chip technology. Developers are familiar with process-leve...
Page 32
22 openpower 720 technical overview and introduction next cycle. This allows substantial power saving with no performance impact. In every cycle, the dynamic power management logic determines whether a local clock buffer that drives a set of latches can be clock gated in the next cycle. In addition ...
Page 33: 2.2 Processor Cards
Chapter 2. Architecture and technical overview 23 consumption, and decreased it footprint size through logical partitioning. The power5 processor chip takes advantage of ibm leadership technology. It is made using ibm 0.13- µ m-lithography cmos technology. The power5 processor also uses copper and s...
Page 34: 2.3 Memory Subsystem
24 openpower 720 technical overview and introduction figure 2-5 processor card with ddr1 memory socket layout view 2.2.1 available processor speeds the openpower 720 operates with a processor clock rate of 1.65 ghz for 2 and 4-way power5 processor-based systems and 1.5 ghz for 1 and 2-way systems. A...
Page 35
Chapter 2. Architecture and technical overview 25 figure 2-6 memory placement for the openpower 720 2.3.2 memory throughput the memory subsystem throughput is based on the speed of the memory, not the speed of the processor. An elastic interface, contained in the power5 chip, buffers reads and write...
Page 36: 2.4 System Buses
26 openpower 720 technical overview and introduction figure 2-7 ibm memory certification label sometimes oem vendors put a label reporting the ibm memory part number but not the barcode or the alphanumeric string, or both on their dimms. In case of system failure caused by oem memory installed in th...
Page 37
Chapter 2. Architecture and technical overview 27 2.5.1 pci-x slots and adapters pci-x, where the x stands for extended, is an enhanced pci bus, delivering a bandwidth of up to 1 gb/sec, running a 64-bit bus at 133 mhz. Pci-x is backward compatible, so openpower 720 systems can support existing 3.3 ...
Page 38: 2.7 Internal Storage
28 openpower 720 technical overview and introduction 2.5.4 scsi adapters to connect to external scsi devices, the following adapters provided in table 2-2 are available, at the time of writing, to be used in openpower 720 system. Table 2-2 available scsi adapters there is also the option to make the...
Page 39
Chapter 2. Architecture and technical overview 29 table 2-3 available tape drives 2.7.2 internal scsi disks the openpower 720 can have up to eight disk drives plugged in the two 4-pack disk drives backplanes. The two 4-pack disk drives backplanes can accommodate the devices listed in table 2-4 on pa...
Page 40: 2.8 External I/o Subsystem
30 openpower 720 technical overview and introduction 2.8 external i/o subsystem this section describes the external i/o subsystem, the 7311 model d20 i/o drawer that is supported on the openpower 720 system. 2.8.1 i/o drawers as described in chapter 1, “general description” on page 1, the openpower ...
Page 41
Chapter 2. Architecture and technical overview 31 7311 model d20 internal scsi cabling a 7311 model d20 supports hot-swappable disks using two 6-pack disk bays for a total of 12 disks. Additionally, the scsi cables (fc 4257) are used to connect a scsi adapter (that can have various features) in slot...
Page 42
32 openpower 720 technical overview and introduction figure 2-10 rio-2 connections the rio-2 cables used have different lengths to satisfy the different connection requirements: remote i/o cable, 3.5 m (fc 3147) remote i/o cable, 10 m (fc 3148) 2.8.4 7311 model d20 i/o drawer spcn cabling spcn is us...
Page 43
Chapter 2. Architecture and technical overview 33 figure 2-11 spcn cabling examples there are different spcn cables to satisfy different length requirements: spcn cable drawer to drawer, 2 m (fc 6001) spcn cable drawer to drawer, 3 m (fc 6006) spcn cable rack to rack, 6 m (fc 6008) spcn cable rack t...
Page 44
34 openpower 720 technical overview and introduction is the largest, which scales up to 32 tb of disk storage, at the time this publication was written. Model 600 provides up to 16 bootable partitions that are attached with the gigabit fibre channel adapter (fc 1977). Model 700 provides up to 64 boo...
Page 45
Chapter 2. Architecture and technical overview 35 later, dynamic lpar increased the flexibility, allowing selected system resources, such as processors, memory, and i/o components to be added and deleted from dedicated partitions while they are executing. This requires an attached hmc, with the prop...
Page 46
36 openpower 720 technical overview and introduction physical processor. A maximum of 10 micro-partitions for each physical processor can be defined, but on a loaded system the practical limit is less. Partitions using micro-partitioning technology can also be defined with the capped and uncapped at...
Page 47: 2.10 Service Processor
Chapter 2. Architecture and technical overview 37 shared ethernet adapter the shared ethernet adapter is a new service that acts as a layer 2 network switch to route network traffic from a virtual ethernet to a real network adapter. The shared ethernet adapter must run in a virtual i/o server partit...
Page 48: 2.11 Boot Process
38 openpower 720 technical overview and introduction 2.10.1 service processor base the ppc405 core is 5-stage pipeline instruction processor and contains 32-bit general purpose registers. The flash rom contains a compressed image of a software load. The sp base unit offers the following connections:...
Page 49
Chapter 2. Architecture and technical overview 39 to set flags that affect the operation of the system, according to the provided password, such as auto power restart, to view information about the system (such as the error log and vpd), network environment access setup, and to control the system po...
Page 50
40 openpower 720 technical overview and introduction boot to server firmware: select the state for the server firmware: standby or running. When the server is in the server firmware standby state, partitions can be set up and activated 2.11.2 hardware management console depending on the model, the h...
Page 51
Chapter 2. Architecture and technical overview 41 – when a partition is activated, the hmc requires you to select the boot mode of the single partition. System profile the system profile option powers on the system according to a predefined set of profiles. The profiles are activated in the order in...
Page 52
42 openpower 720 technical overview and introduction – to enhance the flexibility to use the system within several different logical configuration, a system profile can be defined to collect more than one partition profile to provide the requested system behavior. 2.11.5 hardware requirements for pa...
Page 53
Chapter 2. Architecture and technical overview 43 the openpower 720 (or the logical partition) must be equipped with either a graphic adapter connected to a graphics display, keyboard, and mouse device, or an ascii display terminal connected to one of the native serial ports, or the attached hmc to ...
Page 54
44 openpower 720 technical overview and introduction reaches the sms menus, all of the necessary tests have been performed and the machine is scanning the bus for a boot source. Most system backplanes are designed such that the drive in the first slot spins up immediately after power-on, and other d...
Page 55
Chapter 2. Architecture and technical overview 45 maintenance performed, or stand-alone diagnostics performed. Scsi disk, and virtual scsi disk the more common method of booting the system is to use a disk situated in one of the hot-swap bays in the front of the machine. However, any external scsi-a...
Page 56
46 openpower 720 technical overview and introduction for the latest in ibm linux news, subscribe to the linux line. See: https://www6.Software.Ibm.Com/reg/linux/linuxline-i many of the features described in this document are operating system dependant and may not be available on linux. For more info...
Page 57: Ras and Manageability
© copyright ibm corp. 2004. All rights reserved. 47 chapter 3. Ras and manageability the following sections provide more detailed information about ibm sserver openpower design features that will help lower the total cost of ownership (tco). 3.
Page 58
48 openpower 720 technical overview and introduction 3.1 reliability, availability, and serviceability excellent quality and reliability are inherent in all aspects of the ibm sserver openpower design and manufacturing. The fundamental objective of the design approach is to minimize outages. The ras...
Page 59
Chapter 3. Ras and manageability 49 figure 3-1 schematic of fault isolation register implementation the firs are important because they enable an error to be uniquely identified, thus enabling the appropriate action to be taken. Appropriate actions might include such things as a bus retry, ecc corre...
Page 60
50 openpower 720 technical overview and introduction the operating system cannot program or access the temperature threshold using the sp. Epow events can, for example, trigger the following actions: temperature monitoring, which increases the fans speed rotation when ambient temperature is above a ...
Page 61
Chapter 3. Ras and manageability 51 redundant power supplies (optional) 3.1.6 fault masking if corrections and retries succeed and do not exceed threshold limits, the system remains operational with full resources, and no client or ibm customer engineer intervention is required. This technology is u...
Page 62
52 openpower 720 technical overview and introduction hardware, system firmware, and system interaction have been designed to allow transparent recovery of intermittent pci bus parity errors and graceful transition to the i/o device available state in the case of a permanent parity error in the pci b...
Page 63: 3.2 Manageability
Chapter 3. Ras and manageability 53 concurrent maintenance concurrent maintenance provides replacement of the following parts while the system remains running: disk drives cooling fans power subsystems pci-x adapter cards 3.2 manageability the functions and tools provided for ibm sserver openpower s...
Page 64
54 openpower 720 technical overview and introduction figure 3-2 advanced system management main menu 3.2.2 service agent service agent is an application program that operates on an openpower, p5, pseries or ibm rs/6000 computer and monitors them for hardware errors. It reports detected errors, assum...
Page 65: 3.3 Cluster 1600
Chapter 3. Ras and manageability 55 machines are defined by using the service agent user interface. After the machines are defined, they are registered with the ibm service agent server (sas). During the registration process, an electronic key is created that becomes part of your resident service ag...
Page 66
56 openpower 720 technical overview and introduction several openpower systems that are part of the cluster. If a openpower 720 is configured in partition mode (with physical or virtual resources) is part of the cluster, all partitions must be part of the cluster. (check with your ibm support repres...
Page 67
Chapter 3. Ras and manageability 57 the csm value points the csm allows the management of different hardware platforms from one single point of control and it has consistent interfaces to manage systems and logical partitions running both aix and linux. The management is achieved across multiple swi...
Page 68
58 openpower 720 technical overview and introduction.
Page 69: Related Publications
© copyright ibm corp. 2004. All rights reserved. 59 related publications the publications listed in this section are considered particularly suitable for a more detailed discussion of the topics covered in this redpaper. Ibm redbooks for information about ordering these publications, see “how to get...
Page 70: Online Resources
60 openpower 720 technical overview and introduction online resources these web sites and urls are also relevant as further information sources: ceramic column grid array (ccga), see ibm chip packaging http://www.Ibm.Com/chips/micronews copper circuitry http://www.Ibm.Com/chips/technology/technologi...
Page 71: Help From Ibm
Related publications 61 help from ibm ibm support and downloads ibm.Com/support ibm global services ibm.Com/services.
Page 72
62 openpower 720 technical overview and introduction.
Page 74: Red
® international technical support organization building technical information based on practical experience ibm redbooks are developed by the ibm international technical support organization. Experts from ibm, customers and partners from around the world create timely technical information based on ...