IBM HS22V BLADECENTER - X5670 FOR SPEC CPU2006 Specification

Summary of HS22V BLADECENTER - X5670 FOR SPEC CPU2006

  • Page 2

    2 this “read-me first” document provides detailed instructions on using ibm i on a power blade. It covers prerequisites, supported configurations, preparation for install, hardware and software install, firmware updates and post-install tasks such as backups. The document also contains links to many...

  • Page 3

    3 4.5.1. Storage concepts for js12 and js22 in bladecenter s 4.5.2. Storage concepts for js23, js43, ps700, ps701 and ps702 in bladecenter s 4.6. Best practices for bladecenter s and sas storage 4.6.1. Best practices when using the sas connectivity module 4.6.2. Best practices when using the sas rai...

  • Page 4

    4 6. Post-install tasks and considerations 6.1. Configure ibm i networking 6.2. Configure electronic customer support (ecs) over lan 6.3. How to perform ibm i operator panel functions 6.4. How to display the ibm i partition system reference code (src) history 6.5. Ibm i on power blade considerations...

  • Page 5

    5 1. Prerequisites 1.1. Review ibm i on power blade concepts 1.1.1. Ibm bladecenter ps701 express the ibm bladecenter ps701 express is a single-wide blade server based on the power7™ processor. The ps701 contains 1 socket and 8 power7™ cores, which use ibm’s 45-nm lithography and operate at 3 ghz. T...

  • Page 6

    6 the i/o options and chassis support for ibm i for the ps700 are the same as those for the ps701. 1.1.3. Ibm bladecenter ps702 express the ibm bladecenter ps702 express is a double-wide blade server based on the power7™ processor. The ps702 consists of the ps701 main blade unit and a symmetric mult...

  • Page 7

    7 1.1.5. Ibm bladecenter js43 express the ibm bladecenter js43 express is a double-wide blade server based on the power6™ processor. The js43 consists of the js23 main blade unit and a symmetric multiprocessing (smp) expansion unit, which occupies an adjacent blade bay in an ibm bladecenter. The js4...

  • Page 8

    8 1.1.6. Ibm bladecenter js22 the js22 power blade is a 4-core blade server based on the power6™ processor. The js22 fits in a standard ibm bladecenter chassis and has an integrated service processor (sp), two gigabit ethernet ports, sas and usb controllers and a sas disk drive. The embedded etherne...

  • Page 9

    9 1.1.7. Ibm bladecenter js12 the js12 power blade is a 2-core blade server based on the power6™ processor. Its hardware is very similar to that of the js22, with several important differences: • there is a single power6 socket with 2 processor cores • the processor cores operate at 3.8 ghz, instead...

  • Page 10

    10 note that all implementation instructions in the rest of the document apply to js12, js22, js23, js43, ps700, ps701 and ps702 unless explicitly stated otherwise. 1.1.8. Logical partitioning (lpar) like other power systems, power blades can be partitioned into separate environments, or logical par...

  • Page 11

    11 fibre channel storage and the cffv sas adapter to connect to sas storage. Ibm i on a blade supports fibre channel and/or sas storage (ibm ds3200) with bladecenter h, and bladecenter s internal sas storage and/or ds3200 with bladecenter s. Ibm i supports the sas raid controller i/o module in blade...

  • Page 12

    12 1.2. Review terminology bladecenter: the chassis containing the blade servers, i/o modules, amm, dvd-rom drive, power and fan modules. Advanced management module (amm): a control module residing in a special i/o bay in the bladecenter. The amm provides browser and command-line interfaces into the...

  • Page 13

    13 service processor (sp): the sp on the power blade is similar to the sp (sometimes called “fsp”) on other power6-based systems. It contains firmware to manage the hardware on the blade; the power hypervisor; and partition firmware (pfw). System firmware: as with other power6-based systems, this is...

  • Page 14

    14 1.4. Plan for necessary ip addresses you should plan to assign ip addresses to the following components for a minimum ibm i on blade configuration. All the addresses below are typically configured on the same subnet. • amm (this ip address is already assigned on an existing bladecenter) o the amm...

  • Page 15

    15 from a network perspective, one significant difference between the bladecenter h and bladecenter s is that in the bladecenter h, each embedded hea port on the power blade connects to the outside lan through a separate ethernet module in the chassis. The first hea port connects through i/o module ...

  • Page 16

    16 2. Prepare for the hardware installation 2.1. Verify or obtain bladecenter hardware if you have already purchased a bladecenter chassis, verify it is supported for ibm i on a power blade by consulting the supported environments document: http://www.Ibm.Com/systems/i/advantages/v6r1/blades/index.H...

  • Page 17

    17 3.2. Configure the advanced management module (amm) 3.2.1. Initial amm configuration at this time, the amm must have an ethernet cable plugged into its ethernet port. Plug the other end of this cable into the ethernet connector of a computer where you will open a browser session to the amm. In so...

  • Page 18

    18 3.4. Download bladecenter management module firmware • from the support for bladecenter - downloads page, in the refine results field, select advanced management module and click the go button • note that both functional and maintenance releases of the amm firmware are available for download. A f...

  • Page 19

    19 • choose bladecenter under choose support type and click the right arrow • select bladecenter s under product family and click go. This applies even if you are using one or both sas i/o modules in a bladecenter h • if using the standard sas i/o module, find the link to the most recent sas connect...

  • Page 20

    20 3.10. Update the firmware on the bladecenter i/o modules each of the i/o module’s software needs to be updated at this time. The procedure varies depending on the manufacturer of the i/o module. Refer to the readme file downloaded earlier along with the i/o module to complete this task. Make sure...

  • Page 21

    21 (internal drives and/or ds3200). Ibm i on all power blades supports the sas raid controller module in bladecenter s; that module is not supported in bladecenter h. Fibre channel storage in bladecenter s is not supported for ibm i. This section will examine storage concepts for bladecenter h first...

  • Page 22

    22 • log into the amm browser ui with an administrator id • click hardware vpd • locate the blade with which you are working • the cffh card will appear as a high speed expansion card with a description of cffh_ef hsec. Click it • click the ports tab • under high speed expansion card unique ids, id ...

  • Page 23

    23 both fibre channel and sas storage concepts for js23, js43, ps700, ps701 and ps702 in bladecenter h are similar to those for js12 and js22, with the following differences: • to connect to fibre channel storage, there are several ciov and one cffh expansion adapter options. Ciov and cffh fibre cha...

  • Page 24

    24 • once the luns that will be virtualized to ibm i have reported in vios, change their queue depth to improve performance. Start a telnet session to vios and log as padmin. Use the following command for each lun (hdisk1 in this example): o chdev -dev hdisk1 -perm -attr queue_depth=32 • another par...

  • Page 25

    25 js12 and js22 can achieve a level of redundancy with fibre channel storage by using both ports on the cffh adapter and a pair of msims and fibre channel switch modules. The i/o redundancy from the two ports on the adapter can be extended by connecting to separate external fibre channel switches o...

  • Page 26

    26 4.5.1. Storage concepts for js12 and js22 in bladecenter s the following diagram presents an overview of storage, optical and tape virtualization for ibm i on js12 and js22 in bladecenter s: js12 and js22 use the cffv sas expansion adapter to access the following storage resources: • sas drives i...

  • Page 27

    27 4.6. Best practices for bladecenter s and sas storage for performance information on ibm i in bladecenter s, see section 14.5 of the latest performance capabilities reference manual, available here: http://www.Ibm.Com/systems/i/solutions/perfmgmt/resource.Html. 4.6.1. Best practices when using th...

  • Page 28

    28 by ibm i production workloads. As with other storage subsystems, the number of physical drives in the raid array also plays a significant role, with a higher number of drives improving performance. 4.7. Configuring storage in bladecenter s using the sas connectivity module 4.7.1. Sas i/o modules ...

  • Page 29

    29 the choice among the remaining configurations depends on the number of blades (power and x86) in the chassis. For example, configuration #04/#05 provides the greatest number of arms for a single ibm i partition on the blade (12); however, it does not leave any drives in the chassis for other blad...

  • Page 30

    30 to install scm and create a custom sas i/o module configuration, follow the instructions in chapter 4.4 of the redpiece implementing the ibm bladecenter s chassis (redp-4357), available here: http://www.Redbooks.Ibm.Com/abstracts/redp4357.Html?Open. When installing scm, choose to install only the...

  • Page 31

    31 once scm is started, follow these steps to add your rssms to the interface: • sign on with a local windows id and password. You are not signing onto the rssms yet • expand bc-s sas raid module and then health • click all resources • click add sas raid modules • enter the ip address of the sas swi...

  • Page 32

    32 4.9. Using the dvd drive in the bladecenter with vios and ibm i as mentioned above, vios virtualizes the dvd drive in the media tray (mt) of the bladecenter to ibm i. When the mt is assigned to the blade using the steps described in section 5.2.1, the dvd drive becomes physically available only t...

  • Page 33

    33 as mentioned above, the ivm web browser interface creates a single virtual scsi client adapter per client partition and a corresponding virtual scsi server adapter in vios. The exception is for tape virtualization, as described in section 4.1.4. To create additional virtual scsi client adapters, ...

  • Page 34

    34 • mkvdev –vdev hdisk7 –vadapter vhost1 the lsmap command above will also show whether the physical dvd drive in the bladecenter (typically cd0) is already assigned to a client other partition. If so, a vtoptx device will exist under a virtual scsi server adapter (vhostx). To map the dvd drive to ...

  • Page 35

    35 disk or optical virtualization. However, the recommended approach to making tape drives available to ibm i is to use ivm. 4.11. Fibre channel over converged enhanced ethernet (fcocee) in october 2009, ibm announced the availability of fcocee for ibm i, aix and linux workloads on power blades. Fco...

  • Page 36

    36 note that power blades support only virtual scsi (vscsi) disk virtualization through fcocee. N_port id virtualization (npiv) via fcocee is not currently supported. 10gbe network connectivity for power blades is supported. Fcocee is not supported in bladecenter s for any blade servers, including p...

  • Page 37

    37 the ethernet ports can be virtualized to an ibm i client lpar using the same method as for host ethernet adapter (hea) or other ethernet ports, as described in sections 5.3 and 5.8. 5. Software installation 5.1. Obtain the vios and ibm i installation media and fixes vios is part of ibm powervm ed...

  • Page 38

    38 vios can be installed from a dvd image or from a network installation manager (nim) server. Installing from nim requires that a supported vios image is configured for this blade client on the nim server; that configuration is beyond the scope of this document. If you are going to install vios fro...

  • Page 39

    39 5.2.4. Accessing the sms menus • on the console for vios, once the pfw screen starts to load (see screenshot below), press 1 quickly to enter the system management services (sms) menu • if you miss the opportunity to press 1, pfw will attempt to boot the partition from the default boot device. If...

  • Page 40

    40 o gateway ip address: the gateway ip for this vios partition. O subnet mask: the correct subnet mask for the network segment of which vios is going to be a part. • once everything is filled in correctly, hit the esc key to go back a page and select 3.Ping test • select 1.Execute ping test to test...

  • Page 41

    41 when ibm i is implemented on js12, there are two drives available on the blade for vios installation. In a bladecenter h, vios can be installed on one drive on the blade and mirrored to the second; or installed entirely on the san. As with js22, if vios is installed entirely on the san, mpio shou...

  • Page 42

    42 • mktcpip -hostname -inetaddr -interface enx – netmask –gateway –nsrvaddr address> –nsrvdomain –start • write down the name of the physical adapter (such as ent0), as you will need it later to configure the virtual ethernet bridge (section 5.8). Several vios commands are available to check, remov...

  • Page 43

    43 5.5. Update vios (if necessary) updates to the vios software are released as fix packs, or rarely for important individual fixes, interim fixes (ifixes). A fix pack is cumulative and contains all fixes from previous fix packs. Each fix pack also includes information on the level of vios to which ...

  • Page 44

    44 • type exit and press enter • type diagmenu and press enter • press enter • use the arrow keys to select task selection and press enter • use the arrow keys to select microcode tasks and press enter • use the arrow keys to select download microcode and press enter • use the arrow keys to select t...

  • Page 45

    45 • click apply. 5.9. Memory recommendations for vios and the power hypervisor a minimum of 2 gb of memory is recommended for vios with an ibm i client. If you are running two or more ibm i partitions on the same power blade, consider increasing the vios memory to 4 gb. To change the amount of memo...

  • Page 46

    46 • to create an ibm i partition, click view/modify partitions • click create partition. Partition id will default to the next available partition number • enter a name for the partition • select environment: ibm i • click next • set the assigned (desired) memory value • click next • set the desire...

  • Page 47

    47 • select the ibm i partition and click activate (ivm defaults a new ibm i partition’s ipl source and type to d, manual) • use the lan console connection and the installation topic in the ibm i information center to perform the install: http://publib.Boulder.Ibm.Com/infocenter/systems/scope/i5os/i...

  • Page 48

    48 5.13.3. Identifying sas disk units in different dsms the two dsms in a bladecenter s can be distinguished by their serial numbers. Each sas drive, or hdisk in vios, carries a portion of its dsm serial number in its physical location code. To locate the serial numbers of the dsms: • start a browse...

  • Page 49

    49 • in ivm, identify two additional disk units from different dsms, as described in section 5.13.3 • on the same physical volumes screen in ivm, place a checkmark next to them and click modify partition assignment • select the correct ibm i lpar in the drop-down menu and click ok • in ibm i, add th...

  • Page 50

    50 6.5. Ibm i on power blade considerations and limitations consult the topic “considerations and limitations for ibm i client partitions on systems managed by the integrated virtualization manager” in the ibm i information center: http://publib.Boulder.Ibm.Com/infocenter/systems/scope/i5os/topic/rz...

  • Page 51

    51 for both backup options, the physical adapters connecting to the tape devices are owned by vios. A different type of i/o virtualization is used in each case, but the result is the same: the tape device is available in ibm i as though it were physically attached to the ibm i lpar. The single lto4 ...

  • Page 52

    52 a note on terminology: the ability of vios to directly virtualize sas-attached tape to client partitions is known as “vios virtual tape,” or just “virtual tape.” however, ibm i also has the concept of “virtual tape,” which refers to the capability of ibm i to use a virtual tape image catalog for ...

  • Page 53

    53 • the tape drive is physically connected to the sas i/o module • the sas zone configuration is correct • the blade has a cffv sas adapter • the tape drive is powered on • all requirements in section 7.2 of this document are met • if the tape drive is in defined state, consult section 7.3.2 7.2.4....

  • Page 54

    54 automatically, assigned the next available tapxx device description and varied on. Tape media is initialized in ibm i. 7.2.6. Error logs for tape virtualization errors associated with a virtualized ts2240 tape drive are logged in both vios and ibm i. To display the error log in vios, use the foll...

  • Page 55

    55 once the tape volume containing a save is available to ibm i, use your standard restore procedure or consult the ibm i information center’s “backup and recovery” topic at: http://publib.Boulder.Ibm.Com/infocenter/systems/scope/i5os/index.Jsp?Topic=/rzahg/rzahgbackup. Htm&tocnode=toc:rzahg/i5os/17...

  • Page 56

    56 servers since november 2008. In october 2009, ibm also made npiv available for ibm i and linux on power servers and for ibm i, aix and linux on power blades. To leverage npiv, an ibm i lpar must have a virtual fibre channel (vfc) client adapter created, which connects to a vfc server adapter in v...

  • Page 57

    57 7.3.2. Support statements and requirements for fc tape libraries there are three main hardware components of the npiv-based fc tape library solution – an npiv-capable adapter on the power blade, an npiv-capable fc switch module in bladecenter h and a fc-connected tape library. Npiv is not support...

  • Page 58

    58 20-port full-fabric switch; therefore, the ipm can be upgraded to one of the supported fc switch modules above by purchasing an additional license. Note that while all supported fc adapters and most supported fc switch modules operate at 8gb/s, the rest of the san does not have to operate at that...

  • Page 59

    59 powervm hypervisor until the create action is performed by clicking ok on the main window • select the correct physical port to map the new vfc client adapter to in the drop-down menu • click ok • click virtual fibre channel • select the physical port to which you mapped the new vfc client adapte...

  • Page 60

    60 o on the general partition properties tab, verify the vfc client adapter with the correct wwpns is selected in the alternate restart adapter drop-down menu o on the same tab, verify the ibm i partition is configured for a d-mode manual ipl • close the partition properties window • select the ibm ...

  • Page 61

    61 o type the following command and press enter, where x is the slot number of the power blade: env –t blade[x]. O type console and press enter to assign the vios console. • power on or restart the power blade. This can be done in a number of ways, including using the white power button on the front...

  • Page 62

    62 • on the select device type menu, type 2 and press enter to select tape. • on the select media type menu, type 4 and press enter to select sas..

  • Page 63

    63 • on the select device menu, type the device number for the tape device with the backup media loaded and press enter. • on the select task menu, type 2 and press enter for normal boot mode. • type 1 and press enter to confirm you want to exit the sms menus. It will take several minutes to boot fr...

  • Page 64

    64 • once you are past the welcome to the virtual i/o server screen, a screen prompting you to please define the system console will appear. Type 2 and press enter as the screen directs. Note that these keystrokes will not appear on the screen. • you may see a warning screen indicating the disks on ...

  • Page 65

    65 • on the welcome to base operating system – installation and maintenance menu, type 3 and press enter to select start maintenance mode for system recovery. • on the maintenance menu, type 6 and press enter to install from a system backup..

  • Page 66

    66 • on the choose mksysb device menu, type the number of the device with the backup tape mounted and press enter. The restore will now begin. A progress screen will be displayed until the restore is complete. Once the restore is complete, the vios will reboot from the just completed restore image. ...

  • Page 67

    67 9. Ibm i preinstall on bladecenter s 9.1. Ibm i preinstall overview in october 2008, ibm announced the capability to preinstall ibm i in a bladecenter s configuration with bladecenter js12 and js22. This greatly simplifies the implementation of ibm i in a bladecenter s environment and provides th...

  • Page 68

    68 • check that all requirements on the order are met • create one raid5 array (or storage pool) with three drives for each power blade with ibm i preinstall that is part of the order • create one 10-gb volume for vios on each array and assign the volume to the correct blade • create one 100-gb volu...

  • Page 69

    69 the following table shows the available feature codes for pre-defined sas zone configurations for bladecenter s: * not valid with 1 dsm ** not valid with js22, js23 or ps701 and 1 dsm 9.2.2. Requirements for rssm the following features are required in an ibm i preinstall configuration on bladecen...

  • Page 70

    70 • power on the blade by pressing the white button on its front (it is hidden behind a protective screen) • start the lan console connection on the pc the vios and ibm i partitions on the blade are configured to start automatically. However, because this is the first time the blade starts outside ...

  • Page 71

    71 type 1 and press enter to accept the license once vios boots, it will ask you to confirm the console screen: • type 2 and press enter • sign in with padmin and set a password • accept the vios license as described in section 5.2.7 • configure networking in vios as described in section 5.3 • confi...

  • Page 72

    72 the ibm i partition is now started and accessible through lan console. Further setup tasks may involve adding disk units to the system asp, configuring networking in ibm i, installing additional lpps, ptfs and applications, migrating data from an existing system, or creating users, similar to tho...

  • Page 73

    73 10.1.2. Flashcopy and volumecopy support statements the use of ds4000 or ds5000 flashcopy and volumecopy with ibm i as a client of vios is supported as outlined below. Please note that to implement and use this solution, multiple manual steps on the ds4000 or ds5000 storage subsystem, in vios and...

  • Page 74

    74 10.2.2 erm support statements the use of ds4000 or ds5000 enhanced remote mirroring with ibm i as a client of vios is supported as outlined below. Please note that to implement and use this solution, multiple manual steps on the ds4000 or ds5000 storage subsystem, in vios and in ibm i are require...

  • Page 75

    75 • synchronous erm (ds4000 or ds5000 metro mirror) is supported • asynchronous erm with write consistency group (ds4000 or ds5000 global mirror) is supported • asynchronous erm (ds4000 or ds5000 global copy) is not supported • full-system synchronous erm for a planned switchover (ibm i production ...

  • Page 76

    76 11. Additional resources 11.1. Bladecenter and blade servers • this document, online master version: http://www.Ibm.Com/systems/power/hardware/blades/ibmi.Html. • supported environments for ibm i on a power blade: http://www.Ibm.Com/systems/i/advantages/v6r1/blades/index.Html. • i edition express...

  • Page 77

    77 11.3. Vios and ivm • vios/ivm web site: http://www14.Software.Ibm.Com/webapp/set2/sas/f/vios/home.Html • powervm editions operations guide: http://publib.Boulder.Ibm.Com/infocenter/systems/index.Jsp?Topic=/iphdx/abstract_pv me_guide.Htm. • advanced power virtualization on ibm system p5: introduct...

  • Page 78

    78 • service vouchers for ibm i on power blade: http://www.Ibm.Com/systems/power/hardware/vouchers/index.Html. • implementing tape in i5/os (redbook): http://www.Redbooks.Ibm.Com/abstracts/sg247440.Html?Open. • apar for ptfs required for npiv virtualization of fibre channel tape libraries: http://ww...

  • Page 79

    79 12. Trademarks and disclaimers this document was developed for ibm offerings in the united states as of the date of publication. Ibm may not make these offerings available in other countries, and the information is subject to change without notice. Consult your local ibm business contact for info...

  • Page 80

    80 dfdsm, dfsort, ds4000 or ds5000, ds6000, ds8000, e-business (logo), e-business on demand, energyscale, enterprise workload manager, eserver, express middleware, express portfolio, express servers, express servers and storage, general purpose file system, gigaprocessor, gpfs, hacmp, hacmp/6000, ib...