1. DL manuals
  2. IBM
  3. Storage
  4. N Series
  5. Hardware Manual

IBM N Series Hardware Manual - 4.2  N7X50T Hardware

Other manuals for N Series: Hardware Manual
Manual is about: System storage

Summary of N Series

  • Page 1

    Ibm.Com/redbooks front cover ibm system storage n series hardware guide roland tretau jeff lin dirk peitzmann steven pemberton tom provost marco schwarz select the right n series hardware for your environment understand n series unified storage solutions take storage efficiency to the next level.

  • Page 3

    International technical support organization ibm system storage n series hardware guide may 2014 sg24-7840-03.

  • Page 4

    © copyright international business machines corporation 2012, 2014. All rights reserved. Note to u.S. Government users restricted rights -- use, duplication or disclosure restricted by gsa adp schedule contract with ibm corp. Fourth edition (may 2014) this edition applies to the ibm system storage n...

  • Page 5: Contents

    © copyright ibm corp. 2012, 2014. All rights reserved. Iii contents notices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Xi trademarks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ...

  • Page 6

    Iv ibm system storage n series hardware guide 3.3 n62x0 technical specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31 chapter 4. High-end systems. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33 4.1 over...

  • Page 7

    Contents v 6.2.2 multipath fibre channel cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68 6.3 multipath ha cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69 chapter 7. Highly available controller pai...

  • Page 8

    Vi ibm system storage n series hardware guide 9.1.3 administration and management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 130 9.2 stretch metrocluster with sas shelves and sas cables . . . . . . . . . . . . . . . . . . . . . . 131 9.2.1 before you begin . . . . . . . ...

  • Page 9

    Contents vii chapter 14. Designing an n series solution . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 187 14.1 primary issues that affect planning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 188 14.2 performance and throughput . . . . . . . . . . ....

  • Page 10

    Viii ibm system storage n series hardware guide 17.5.2 initiator group . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 234 17.5.3 mapping luns for windows clusters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 235 17.5.4 adding is...

  • Page 11

    Contents ix 21.1.2 adding a pci adapter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 296 21.1.3 upgrading a storage controller head. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 297 21.2 software upgrades . . . . . . . . . . . . . . . . ....

  • Page 12

    X ibm system storage n series hardware guide.

  • Page 13: Notices

    © copyright ibm corp. 2012, 2014. All rights reserved. Xi notices this information was developed for products and services offered in the u.S.A. Ibm may not offer the products, services, or features discussed in this document in other countries. Consult your local ibm representative for information ...

  • Page 14: Trademarks

    Xii ibm system storage n series hardware guide trademarks ibm, the ibm logo, and ibm.Com are trademarks or registered trademarks of international business machines corporation in the united states, other countries, or both. These and other ibm trademarked terms are marked on their first occurrence i...

  • Page 15: Preface

    © copyright ibm corp. 2012, 2014. All rights reserved. Xiii preface this ibm® redbooks® publication provides a detailed look at the features, benefits, and capabilities of the ibm system storage® n series hardware offerings. The ibm system storage n series systems can help you tackle the challenge o...

  • Page 16

    Xiv ibm system storage n series hardware guide dirk peitzmann is a leading technical sales professional with ibm systems sales in munich, germany. Dirk is an experienced professional and provides technical pre-sales and post-sales solutions for ibm server and storage systems. His areas of expertise ...

  • Page 17: Comments Welcome

    Preface xv comments welcome your comments are important to us! We want our books to be as helpful as possible. Send us your comments about this book or other ibm redbooks publications in one of the following ways: use the online contact us review redbooks form found at this website: http://www.Ibm.C...

  • Page 18

    Xvi ibm system storage n series hardware guide.

  • Page 19: Summary of Changes

    © copyright ibm corp. 2012, 2014. All rights reserved. Xvii summary of changes this section describes the technical changes that were made in this edition of the book and in previous editions. This edition might also include minor corrections and editorial changes that are not identified. Summary of...

  • Page 20

    Xviii ibm system storage n series hardware guide.

  • Page 21: Introduction to N Series

    © copyright ibm corp. 2012, 2014. All rights reserved. 1 part 1 introduction to n series hardware this part introduces the n series hardware, including the storage controller models, disk expansion shelves, and cabling recommendations. It also describes some of the hardware functions, including acti...

  • Page 22

    2 ibm system storage n series hardware guide.

  • Page 23: Introduction to Ibm System

    © copyright ibm corp. 2012, 2014. All rights reserved. 3 chapter 1. Introduction to ibm system storage n series the ibm system storage n series offers more choices to organizations that face the challenges of enterprise data management. The ibm system storage n series is designed to deliver high-end...

  • Page 24: 1.1  Overview

    4 ibm system storage n series hardware guide 1.1 overview this section introduces the ibm system storage n series and describes its hardware features. The ibm system storage n series provides a range of reliable, scalable storage solutions for various storage requirements. These capabilities are ach...

  • Page 25

    Chapter 1. Introduction to ibm system storage n series 5 maintains availability and productivity during upgrades. If outages are necessary, downtime is kept to a minimum. Easily and quickly implement nondisruptive upgrades. Create effortless backup and recovery solutions that operate in a common man...

  • Page 26

    6 ibm system storage n series hardware guide the hardware includes the following features and benefits: data compression: – transparent in-line data compression can store more data in less space, which reduces the amount of storage that you must purchase and maintain. – reduces the time and bandwidt...

  • Page 27

    Chapter 1. Introduction to ibm system storage n series 7 metrocluster: – offers an integrated high-availability and disaster-recovery solution for campus and metro-area deployments. – ensures high data availability when a site failure occurs. – supports fibre channel attached storage with san fibre ...

  • Page 28

    8 ibm system storage n series hardware guide snaplock: – write-protects structured application data files within a volume to provide write once read many (worm) disk storage. – provides storage, which enables compliance with government records retention regulations. Snapmanager: – provides host-base...

  • Page 29

    Chapter 1. Introduction to ibm system storage n series 9 for more information about n series software features, see ibm system storage n series software guide, sg24-7129, which is available at this website: http://www.Redbooks.Ibm.Com/abstracts/sg247129.Html?Open all n series systems support the sto...

  • Page 30

    10 ibm system storage n series hardware guide figure 1-4 provides an overview of the software structure that was introduced with the availability of data ontap 8.1. Figure 1-4 software structure for mid-range and enterprise systems to increase the business flow efficiencies, the seven-mode licensing...

  • Page 31

    Chapter 1. Introduction to ibm system storage n series 11 1.4 data ontap 8 supported systems figure 1-5 provides an overview of systems that support data ontap 8. The listed systems reflect the n series product portfolio as of june 2011, and some older n series systems that are suitable to run data ...

  • Page 32

    12 ibm system storage n series hardware guide.

  • Page 33: Entry-Level Systems

    © copyright ibm corp. 2012, 2014. All rights reserved. 13 chapter 2. Entry-level systems this chapter describes the ibm system storage n series 3000 systems, which address the entry-level segment. This chapter includes the following sections: overview n32x0 common features n3150 model details n3220 ...

  • Page 34: 2.1  Overview

    14 ibm system storage n series hardware guide 2.1 overview figure 2-1 shows the n3000 modular disk storage system, which is designed to provide primary and auxiliary storage for midsize enterprises. N3000 systems offer integrated data access, intelligent management software, and data protection capa...

  • Page 35: 2.2  N32X0 Common Features

    Chapter 2. Entry-level systems 15 2.2 n32x0 common features table 2-2 provides ordering information for n32x0 systems. Table 2-2 n3150 and n32x0 configurations table 2-3 provides ordering information for n32x0 systems with mezzanine cards. Table 2-3 n32x0 controller configuration table 2-4 provides ...

  • Page 36: 2.3  N3150 Model Details

    16 ibm system storage n series hardware guide 2.3 n3150 model details this section describes the n series 3150 models. 2.3.1 n3150 model 2857-a15 n3150 model a15 is a single-node storage controller. It is designed to provide cifs, nfs, internet small computer system interface (iscsi), and http suppo...

  • Page 37

    Chapter 2. Entry-level systems 17 figure 2-2 shows the front view of the n3150. Figure 2-2 n3150 front view figure 2-3 shows the n3150 single-controller in chassis (model a15) figure 2-3 n3150 single-controller in chassis figure 2-4 shows the n3150 dual-controller in chassis (model a25) figure 2-4 n...

  • Page 38: 2.4  N3220 Model Details

    18 ibm system storage n series hardware guide 2.4 n3220 model details this section describes the n series 3220 models. 2.4.1 n3220 model 2857-a12 n3220 model a12 is a single-node storage controller. It is designed to provide http, iscsi, nfs, cifs, and fcp support through optional features. Model a1...

  • Page 39: 2.5  N3240 Model Details

    Chapter 2. Entry-level systems 19 figure 2-6 shows the rear view of the n3220. Figure 2-6 n3220 rear view figure 2-5 shows the n3220 single-controller in chassis. Figure 2-7 n3220 dual-controller in chassis (including optional mezzanine card) 2.5 n3240 model details this section describes the n seri...

  • Page 40

    20 ibm system storage n series hardware guide 2.5.3 n3240 hardware based on the exn3000 expansion shelf 24 sata disk drives (minimum initial order of 12 disk drives) specifications (single node, 2x for dual node): – 4u, standard 19-inch rack mount enclosure (single or dual node) – one 1.73 ghz intel...

  • Page 41

    Chapter 2. Entry-level systems 21 figure 2-10 shows the front and rear view of the n3240 figure 2-10 n3240 dual-controller in chassis figure 2-11 shows the controller with the 8 gb fc mezzanine card option figure 2-11 controller with 8 gb fc mezzanine card option figure 2-12 shows the controller wit...

  • Page 42

    22 ibm system storage n series hardware guide 2.6 n3000 technical specifications table 2-5 provides an overview of the n32x0 specifications. Table 2-5 n32x0 specifications f or more information about n series 3000 systems, see this website: http://www.Ibm.Com/systems/storage/network/n3000/appliance/...

  • Page 43: Mid-Range Systems

    © copyright ibm corp. 2012, 2014. All rights reserved. 23 chapter 3. Mid-range systems this chapter describes the ibm system storage n series 6000 systems, which address the mid-range segment. This chapter includes the following sections: overview n62x0 model details n62x0 technical specifications 3.

  • Page 44: 3.1  Overview

    24 ibm system storage n series hardware guide 3.1 overview figure 3-1 shows the n62x0 modular disk storage system, which includes the following advantages: increase nas storage flexibility and expansion capabilities by consolidating block and file data sets onto a single multiprotocol storage platfo...

  • Page 45

    Chapter 3. Mid-range systems 25 integrated fibre channel, ethernet, and sas ports quad-port 4 gbps adapters (optional) up to four performance acceleration modules (flash cache) diagnostic led/lcd dual redundant hot-plug integrated cooling fans and autoranging power supplies 19 inch, rack-mountable u...

  • Page 46: 3.2  N62X0 Model Details

    26 ibm system storage n series hardware guide rlm design and internal ethernet switch on the controller the data ontap management interface (which is known as e0m) provides a robust and cost-effective way to segregate management subnets from data subnets without incurring a port penalty. On the n600...

  • Page 47

    Chapter 3. Mid-range systems 27 figure 3-2 ibm n6210/n6240 configuration flexibility all of the n62x0 controller modules provide the same type and number of onboard i/o ports and pci slots. The e xx models include the ioxm, which provides more pci slots. Figure 3-3 shows the ibm n62x0 controller i/o...

  • Page 48

    28 ibm system storage n series hardware guide ibm n62x0 i/o configuration flexibility is shown in figure 3-4. Figure 3-4 ibm n62x0 i/o configuration flexibility ibm n62x0 i/o expansion module (ioxm) is shown in figure 3-5 and features the following characteristics: components are not hot swappable: ...

  • Page 49

    Chapter 3. Mid-range systems 29 figure 3-6 shows the ibm n62x0 system board layout. Figure 3-6 ibm n62x0 system board layout figure 3-7 shows the ibm n62x0 usb flash module, which has the following features: it is the boot device for data ontap and the environment variables it replaces compactflash ...

  • Page 50

    30 ibm system storage n series hardware guide 3.2.2 ibm n62x0 metrocluster and gateway models this section describes the metrocluster feature. Supported metrocluster n62x0 configuration the following metrocluster two-chassis configurations are supported: each chassis single-enclosure stand-alone: • ...

  • Page 51

    Chapter 3. Mid-range systems 31 3.3 n62x0 technical specifications table 3-1 shows the n62x0 specifications. Table 3-1 n62x0 specifications for more information about n series 6000 systems, see this website: http://www.Ibm.Com/systems/storage/network/n6000/appliance/index.Html n6220 n6220 (with opti...

  • Page 52

    32 ibm system storage n series hardware guide.

  • Page 53: High-End Systems

    © copyright ibm corp. 2012, 2014. All rights reserved. 33 chapter 4. High-end systems this chapter describes the ibm system storage n series 7000 system, which addresses the high-end segment. This chapter includes the following sections: overview n7x50t hardware ibm n7x50t configuration rules n7000t...

  • Page 54: 4.1  Overview

    34 ibm system storage n series hardware guide 4.1 overview figure 4-1 shows the n7x50t modular disk storage systems, which provide the following advantages: high data availability and system-level redundancy support of concurrent block i/o and file serving over ethernet and fibre channel san infrast...

  • Page 55: 4.2  N7X50T Hardware

    Chapter 4. High-end systems 35 4.1.2 hardware summary the n7x50t modular disk storage systems contains the following hardware: up to 5760 tb raw storage capacity 96 gb - 192 gb of ram (random access memory) integrated fibre channel, ethernet, and sas ports support for 10 gbps ethernet port speed sup...

  • Page 56

    36 ibm system storage n series hardware guide figure 4-3 shows the ibm n series n7550t base components. Figure 4-3 ibm n series n7550t base components figure 4-4 shows the ibm n series n7950t configuration. Figure 4-4 ibm n series n7950t configuration 4.2.2 controller module components although they...

  • Page 57

    Chapter 4. High-end systems 37 figure 4-5 n7x50 controller figure 4-6 shows an internal view of the ibm n series n7x50t controller module. The n7550t and n7950t differ in number of processors and installed memory. Figure 4-6 n7x50 internal view.

  • Page 58

    38 ibm system storage n series hardware guide 4.2.3 i/o expansion module components the n7950t model always includes the i/o expansion module in the second bay in each of its two chassis. This provides another 20 pcie expansion slot (2x 10 slots) to the n7950t relative to the n7550t. The ioxm is not...

  • Page 59

    Chapter 4. High-end systems 39 4.3 ibm n7x50t configuration rules this section describes the configuration rules for n7x50 systems. 4.3.1 ibm n series n7x50t slot configuration this section describes the configuration rules for the vertical i/o slots and horizontal pcie slots. Vertical i/o slots the...

  • Page 60

    40 ibm system storage n series hardware guide 4.3.3 n7x50t cooling architecture the n7x50t cooling architecture includes the following features: six fan frus per chassis, which is paired three each for top and bottom bays (each fan fru has two fans) one failed fan is allowed per chassis bay: – contr...

  • Page 61

    Chapter 4. High-end systems 41 figure 4-9 shows the use of the sas card in i/o slot 1. Figure 4-9 using sas card in i/o slot 1 nvram8 and sas i/o system boards use the qsfp connector: – mixing the cables does not cause physical damage, but the cables do not work – label your ha and sas cables when y...

  • Page 62

    42 ibm system storage n series hardware guide figure 4-11 shows the 10 gbe sfp+ modules. Figure 4-11 10 gbe sfp+ modules.

  • Page 63

    Chapter 4. High-end systems 43 4.4 n7000t technical specifications table 4-1 provides the technical specifications of the n7x50t. Table 4-1 n7x50t specifications for more information about n series 7000 systems, see this website: http://www.Ibm.Com/systems/storage/network/n7000/appliance/index.Html ...

  • Page 64

    44 ibm system storage n series hardware guide.

  • Page 65: Expansion Units

    © copyright ibm corp. 2012, 2014. All rights reserved. 45 chapter 5. Expansion units this chapter describes the ibm n series expansion units, which also called disk shelves . This chapter includes the following sections: shelf technology overview expansion unit exn3000 expansion unit exn3200 expansi...

  • Page 66: 5.2  Expansion Unit Exn3000

    46 ibm system storage n series hardware guide 5.1 shelf technology overview this section gives an overview of the n series expansion unit technology. Figure 5-1 shows the shelf topology comparison. Figure 5-1 shelf topology comparison 5.2 expansion unit exn3000 the ibm system storage exn3000 sas/sat...

  • Page 67

    Chapter 5. Expansion units 47 the exn3000 is a 4u disk storage expansion unit. It can be mounted in any industry-standard 19-inch rack. The exn3000 includes the following features: dual redundant hot-pluggable integrated power supplies and cooling fans dual redundant disk expansion unit switched con...

  • Page 68: 5.3  Expansion Unit Exn3200

    48 ibm system storage n series hardware guide 5.2.2 supported exn3000 drives table 5-1 lists the drives that are supported by exn3000 at the time of this writing. Table 5-1 exn3000 supported drives 5.2.3 environmental and technical specifications table 5-2 shows the environmental and technical speci...

  • Page 69

    Chapter 5. Expansion units 49 5.3.1 overview the ibm system storage exn3200 sata expansion unit is available for attachment to all n series systems, except n3300, n3700, n5200, and n5500. The exn3000 provides low-cost, high-capacity, and sas sata disk storage for the ibm n series system storage. The...

  • Page 70

    50 ibm system storage n series hardware guide 7. Iom b and power supplies three and four 8. Four power supplies (each with integrated fans) 9. Power supply leds figure 5-6 exn3200 rear view 5.3.2 supported exn3000 drives table 5-3 lists the drives that are supported by exn3200 at the time of this wr...

  • Page 71: 5.4  Expansion Unit Exn3500

    Chapter 5. Expansion units 51 5.4 expansion unit exn3500 the exn3500 is a small form factor (sff) 2u disk storage expansion unit for mounting in any industry standard 19-inch rack. The exn3500 provides low-cost, high-capacity sas disk storage with slots for 24 hard disk drives for the ibm n series s...

  • Page 72

    52 ibm system storage n series hardware guide 5.4.1 overview the exn3500 includes the following hardware: dual, redundant, hot-pluggable, integrated power supplies and cooling fans dual, redundant, disk expansion unit switched controllers 24 sff hard disk drive slots diagnostic and status leds figur...

  • Page 73

    Chapter 5. Expansion units 53 figure 5-9 shows the iom differences. Figure 5-9 iom differences 5.4.2 intermix support exn3000 and exn3500 can be combined in the following configurations: intermix of exn3000 and exn3500 shelves: exn3000 and exn3500 shelves cannot be intermixed on the same stack. Only...

  • Page 74: 5.5  Self-Encrypting Drive

    54 ibm system storage n series hardware guide table 5-5 exn3500 supported drives 5.4.4 environmental and technical specification table 5-6 shows the environmental and technical specifications. Table 5-6 exn3500 environmental specifications 5.5 self-encrypting drive this section describes the fde 600...

  • Page 75

    Chapter 5. Expansion units 55 requires dot 8.1 minimum only allowed with ha (dual node) systems provides storage encryption capability (key manager interface) 5.5.2 sed overview storage encryption is the implementation of full disk encryption (fde) by using self-encrypting drives from third-party ve...

  • Page 76

    56 ibm system storage n series hardware guide 5.5.6 key management this section describes key management. Overview of key management interoperability protocol key management interoperability protocol (kmip) is an encryption key interoperability standard that was created by a consortium of security a...

  • Page 77

    Chapter 5. Expansion units 57 security key lifecycle manager obtaining that central point of control requires more than an open standard. It also requires a dedicated management solution that is designed to capitalize on it. Ibm security key lifecycle manager version 2 gives you the power to manage ...

  • Page 78

    58 ibm system storage n series hardware guide 5.6 expansion unit technical specifications table 5-7 provides the expansion shelf specifications. Table 5-7 expansion shelf specifications exn3000 exn3200 exn3500 machine type 2857-003 2857-306 2857-006 oem model ds4243 / ds4246 ds4486 ds2246 connectivi...

  • Page 79: Cabling Expansions

    © copyright ibm corp. 2012, 2014. All rights reserved. 59 chapter 6. Cabling expansions this chapter describes the multipath cabling of expansions and includes the following sections: exn3000 and exn3500 disk shelves cabling exn4000 disk shelves cabling multipath ha cabling 6.

  • Page 80

    60 ibm system storage n series hardware guide 6.1 exn3000 and exn3500 disk shelves cabling this section describes cabling the disk shelf sas connections and the optional acp connections for a new storage system installation. Cabling the exn3500 is similar to the exn3000. As a result, the information...

  • Page 81

    Chapter 6. Cabling expansions 61 connecting the quad-port sas hbas adhere to the following rules for connecting to sas shelves: hba port a and port c always connect to the top storage expansion unit in a stack of storage expansion units. Hba port b and port d always connect to the bottom storage exp...

  • Page 82

    62 ibm system storage n series hardware guide figure 6-3 shows how the sas shelves are interconnected for two stacks with three shelves each. Figure 6-3 sas shelf interconnect.

  • Page 83

    Chapter 6. Cabling expansions 63 6.1.3 top connections the top ports of the sas shelves are connected to the ha pair controllers, as shown in figure 6-4. Figure 6-4 sas shelf cable top connections.

  • Page 84

    64 ibm system storage n series hardware guide 6.1.4 bottom connections the bottom ports of the sas shelves are connected to the ha pair controllers, as shown in figure 6-5. Figure 6-5 sas shelf cable bottom connections figure 6-5 is a fully redundant example of sas shelf connectivity. No single cabl...

  • Page 85

    Chapter 6. Cabling expansions 65 2. Review the output and perform the following tasks: – if the output lists all of the ioms, the ioms have connectivity. Return to the cabling procedure for your storage configuration to complete the cabling steps. – ioms might not be shown because the iom is cabled ...

  • Page 86

    66 ibm system storage n series hardware guide enable acp on the storage system by entering the following command at the console: options acp.Enabled on verify that the acp cabling is correct by entering the following command: storage show acp for more information about cabling sas stacks and acp to ...

  • Page 87

    Chapter 6. Cabling expansions 67 6.2.1 non-multipath fibre channel cabling figure 6-7 shows exn4000 disk shelves that are connected to a ha pair with non-multipath cabling. A single fibre channel cable or shelf controller failure might cause a takeover situation. Figure 6-7 exn4000 dual controller n...

  • Page 88

    68 ibm system storage n series hardware guide 6.2.2 multipath fibre channel cabling figure 6-8 shows four exn4000 disk shelves in two separate loops that are connected to an ha pair with redundant multipath cabling. No single fibre channel cable or shelf controller failure causes a takeover situatio...

  • Page 89: 6.3  Multipath Ha Cabling

    Chapter 6. Cabling expansions 69 6.3 multipath ha cabling a standard n series clustered storage system has multiple single-points-of-failure on each shelf that can trigger a cluster failover (see example 6-1). Cluster failovers can disrupt access to data and put an increased workload on the survivin...

  • Page 90

    70 ibm system storage n series hardware guide.

  • Page 91

    © copyright ibm corp. 2012, 2014. All rights reserved. 71 chapter 7. Highly available controller pairs ibm system storage n series highly available (ha) pair configuration consists of two nodes that can take over and fail over their resources or services to counterpart nodes. This function assumes t...

  • Page 92: 7.1  Ha Pair Overview

    72 ibm system storage n series hardware guide 7.1 ha pair overview an ha pair is two storage systems (nodes) whose controllers are connected to each other directly. The nodes are connected to each other through an nvram adapter, or, in the case of systems with two controllers in a single chassis, th...

  • Page 93

    Chapter 7. Highly available controller pairs 73 nondisruptive hardware maintenance: when you halt one node and allow takeover, the partner node continues to serve data for the halted node. You can then replace or repair hardware in the node you halted. Figure 7-2 shows an ha pair where controller a ...

  • Page 94

    74 ibm system storage n series hardware guide they own their spare disks, spare array luns (or both) and do not share them with the other node. They each have mailbox disks or array luns on the root volume: – two if it is an n series controller system (four if the root volume is mirrored by using th...

  • Page 95

    Chapter 7. Highly available controller pairs 75 table 7-1 configuration types certain terms have the following particular meanings when they are used to refer to ha pair configuration: an ha pair configuration is a pair of storage systems that are configured to serve data for each other if one of th...

  • Page 96

    76 ibm system storage n series hardware guide iscsi network-attached topologies are topologies in which the hosts are attached to storage controllers through ethernet switches. Networks can contain multiple ethernet switches in any configuration. Mirrored ha pair configuration is similar to the stan...

  • Page 97

    Chapter 7. Highly available controller pairs 77 figure 7-3 shows a standard ha pair with native disk shelves without multipath storage. Figure 7-3 standard ha pair with native disk shelves without multipath storage in the example that is shown in figure 7-3, cabling is configured without redundant p...

  • Page 98

    78 ibm system storage n series hardware guide disks and disk shelf compatibility: – fibre channel, sas, and sata storage are supported in standard ha pair configuration if the two storage types are not mixed on the same loop. – one node can have only fibre channel storage and the partner node can ha...

  • Page 99

    Chapter 7. Highly available controller pairs 79 if you are using third-party storage, paths to an array lun must be redundant. License requirements the following licenses must be enabled on both nodes: cf syncmirror_local 7.2.3 stretched metrocluster stretch metrocluster includes the following chara...

  • Page 100

    80 ibm system storage n series hardware guide a stretch metrocluster can be cabled to be redundant or non-redundant, and aggregates can be mirrored or unmirrored. Cabling for stretch metrocluster follows the same rules as for a standard ha pair. The main difference is that a stretch metrocluster spa...

  • Page 101

    Chapter 7. Highly available controller pairs 81 the back-end switches are configured with two independent and redundant fibre channel switch fabrics. Each fabric can have a single or dual inter-switch link (isl) connection that operates at up to 8 gbps. With a fabric-attached metrocluster, the dista...

  • Page 102

    82 ibm system storage n series hardware guide node requirements nodes include the following requirements: the nodes must be one of the following system models that are configured for mirrored volume use. Each node in the pair must be the same model: – n5000 series systems, except for the n5500 and n...

  • Page 103

    Chapter 7. Highly available controller pairs 83 7.3.1 configuration variations for standard ha pair configurations the following configuration variations are supported for standard ha pair configurations: asymmetrical configurations: in an asymmetrical standard ha pair configuration, one node has mo...

  • Page 104

    84 ibm system storage n series hardware guide example 7-1 example of /etc/rc files /etc/rc on itsotuc1: hostname itsotuc1 ifconfig e0 `hostname`-e0 mediatype 100tx-fd netmask 255.255.255.0 vif create multi vif1 e3a e3b e3c e3d ifconfig vif1 `hostname`-vif1 mediatype 100tx-fd netmask 255.255.255.0 pa...

  • Page 105

    Chapter 7. Highly available controller pairs 85 example 7-4 shows where the vif is configured in setup. Configure a multimode vif, which is the default, by using all four ethernet ports of the n series controller. Example 7-4 configuring a multimode vif do you want to configure virtual network inter...

  • Page 106

    86 ibm system storage n series hardware guide configuring dedicated interfaces with setup a dedicated network interface for the local controller whether the controller is in takeover mode. A network interface performs this role if it has a local ip address but not a partner ip address. You can assig...

  • Page 107

    Chapter 7. Highly available controller pairs 87 complete the following steps to check the options: 1. View and note the values of the options on the local and partner nodes by using the following command on each console: options the current option settings for the node are displayed on the console. ...

  • Page 108

    88 ibm system storage n series hardware guide 5. Give back the partner node by entering the following command: cf giveback the local node releases the partner node, which reboots and resumes normal operation. The following message is displayed on the console when the process is complete: giveback co...

  • Page 109

    Chapter 7. Highly available controller pairs 89 7.4 managing an ha pair configuration this section describes the considerations and activities that are related to managing an ha pair configuration. The following methods can be used to manage resources and to perform takeover or giveback from one nod...

  • Page 110

    90 ibm system storage n series hardware guide halting a node without takeover performing a takeover for more information about managing an ha pair configuration, see ibm system storage n series data ontap 8.0 7-mode high-availability configuration guide, which is available at this website: http://ww...

  • Page 111

    Chapter 7. Highly available controller pairs 91 copyright (c) 2000,2001,2002,2003 broadcom corporation. Portions copyright (c) 2002-2006 network appliance, inc. Cpu type 0xf29: 2800mhz total memory: 0x80000000 bytes (2048mb) cfe> the same result can be accomplished by using the command cf disable fo...

  • Page 112

    92 ibm system storage n series hardware guide sat apr 9 02:00:33 gmt-7 [itsonas2: cf.Fsm.Statetransit:warning]: cluster monitor: up --> takeover sat apr 9 02:00:33 gmt-7 [itsonas2: cf.Fm.Takeoverstarted:warning]: cluster monitor: takeover started sat apr 9 02:00:33 gmt-7 [itsonas1/itsonas2: coredump...

  • Page 113

    Chapter 7. Highly available controller pairs 93 in the example, the n series itsonas1 rebooted when you ran the cf takeover command. When one n series storage system node is in takeover mode, the partner n series node does not reboot until the cf giveback command is run. Starting giveback by using t...

  • Page 114

    94 ibm system storage n series hardware guide tue apr 12 03:17:11 gmt-7 [itsonas2/itsonas1: scsitgt.Ha.State.Changed:debug]: stio ha state : in takeover --> giving back after 5060 seconds. Tue apr 12 03:17:11 gmt-7 [itsonas2/itsonas1: fcp.Service.Shutdown:info]: fcp service shutdown tue apr 12 03:17...

  • Page 115

    Chapter 7. Highly available controller pairs 95 complete the following steps: 1. As shown in figure 7-6, you can perform the takeover by using system manager and clicking active/active configuration takeover. Figure 7-6 system manager initiating takeover tip: under normal conditions, you do not need...

  • Page 116

    96 ibm system storage n series hardware guide 2. Figure 7-7 shows the active/active takeover wizard step 1. Click next to continue. Figure 7-7 system manager initiating takeover: step 1 3. Figure 7-8 shows the active/active takeover wizard step 2. Click next to continue. Figure 7-8 system manager in...

  • Page 117

    Chapter 7. Highly available controller pairs 97 4. Figure 7-9 shows the active/active takeover wizard step 3. Click finish to continue. Figure 7-9 system manager initiating takeover: step 3 5. Figure 7-10 shows the active/active takeover wizard final step where takeover was run successfully. Click c...

  • Page 118

    98 ibm system storage n series hardware guide figure 7-11 shows that system manager now displays the status of the takeover. The only option at this stage to perform giveback. Figure 7-11 system manager itsonas2 taken over by itsonas1 starting giveback by using system manager figure 7-12 shows how t...

  • Page 119

    Chapter 7. Highly available controller pairs 99 figure 7-13 shows a successfully completed giveback. Figure 7-13 system manager giveback successful figure 7-14 shows that system manager now reports the systems back to normal after a successful giveback. Figure 7-14 system manager with systems back t...

  • Page 120

    100 ibm system storage n series hardware guide 7.4.4 ha pair configuration failover basic operations when a failover occurs, the running partner node in the ha pair configuration takes over the functions and disk drives of the failed node. It does so by creating an emulated storage system that runs ...

  • Page 121

    Chapter 7. Highly available controller pairs 101 failover because of disk mismatch communication between ha pair nodes is first established through the ha pair configuration interconnect adapters. At this time, the nodes exchange a list of disk shelves that are visible on the a loop and b loop of ea...

  • Page 122

    102 ibm system storage n series hardware guide.

  • Page 123: Metrocluster

    © copyright ibm corp. 2012, 2014. All rights reserved. 103 chapter 8. Metrocluster this chapter describes the metrocluster feature. This integrated, high-availability, business continuance solution allows clustering of two n6000, or n7000 storage controllers at distances up to 100 kilometers. The pr...

  • Page 124

    104 ibm system storage n series hardware guide 8.1 overview of metrocluster ibm n series metrocluster, as shown in figure 8-1, is a solution that combines n series local clustering with synchronous mirroring to deliver continuous availability. Metrocluster expands the capabilities of the n series po...

  • Page 125

    Chapter 8. Metrocluster 105 metrocluster technology is an important component of enterprise data protection strategies. In a failure in one location (the local node or the disks are failing), metrocluster provides automatic failover to the remaining node. This failover allows access to the data copy...

  • Page 126

    106 ibm system storage n series hardware guide figure 8-2 logical view of metrocluster syncmirror geographical separation of n series nodes is implemented by physically separating controllers and storage, which creates two metrocluster halves. For distances under 500 m (campus distances), long cable...

  • Page 127: 8.3  Stretch Metrocluster

    Chapter 8. Metrocluster 107 8.2 business continuity solutions the n series offers several levels of protection with several different options. Metrocluster is one of the options that is offered by the n series. Metrocluster fits into the campus-level distance requirement of business continuity, as s...

  • Page 128

    108 ibm system storage n series hardware guide 8.3.1 planning stretch metrocluster configurations for planning and sizing stretch metrocluster environments, remember the following considerations: use multipath ha (mpha) cabling. Use fibrebridges with sas shelves (exn3000 & exn3500). N62x0 and n7950t...

  • Page 129

    Chapter 8. Metrocluster 109 mixed sata and fc configurations are allowed if the following requirements are met: – there is no intermixing of fibre channel and sata shelves on the same loop. – mirrored shelves must be of the same type as their parents. The stretch metrocluster heads can have a distan...

  • Page 130

    110 ibm system storage n series hardware guide if you use sas shelves (exn3000 and exn3500), you must use fibrebridges. Starting with data ontap 8.1, exn3000 (sas or sata) and exn3500 are supported on stretch metrocluster (and fabric metrocluster) through sas fc bridge (fibrebridge). The fibrebridge...

  • Page 131

    Chapter 8. Metrocluster 111 8.4.1 planning fabric metrocluster configurations when you are planning and sizing fabric metrocluster environments, remember the following these considerations: use fibrebridges with sas shelves (exn3000 & exn3500). Provide enough ports or loops to satisfy performance (p...

  • Page 132

    112 ibm system storage n series hardware guide take care in planning n6210 metrocluster configurations because the n6210 has only two fibre channel initiator onboard ports and two pci expansion slots. Because you use one slot for the fc/vi adapter, you have only one remaining slot for a fibre channe...

  • Page 133

    Chapter 8. Metrocluster 113 8.4.2 cabling fabric metroclusters figure 8-7 shows an example of a fabric metrocluster with two exn4000 fc shelves on each site. Figure 8-7 fabric metrocluster cabling with exn4000 fabric metrocluster configurations use fibre channel switches as the means to separate the...

  • Page 134

    114 ibm system storage n series hardware guide this process allows sas disks to display as luns in a metrocluster fabric. You need at least four fibrebridges (minimum is two per stack) in a metrocluster environment, as shown in figure 8-8. Enables connectivity between fibre channel initiators and sa...

  • Page 135

    Chapter 8. Metrocluster 115 figure 8-9 synchronous mirroring syncmirror is used to create aggregate mirrors. When you are planning for syncmirror environments, remember the following considerations: aggregate mirrors must be on the remote site (geographically separated) in normal mode (no takeover),...

  • Page 136

    116 ibm system storage n series hardware guide raid disk device ha shelf bay chan pool type rpm used (mb/blks) phys (mb/blks) --------- ------ ------------- ---- ---- ---- ----- -------------- -------------- dparity 0c.25 0c 1 9 fc:b 1 fcal 15000 136000/278528000 137104/280790184 parity 0c.24 0c 1 8...

  • Page 137

    Chapter 8. Metrocluster 117 partner 0a.28 0a 1 12 fc:a 1 fcal 15000 0/0 137104/280790184 partner 0a.24 0a 1 8 fc:a 1 fcal 15000 0/0 137104/280790184 partner 0c.19 0c 1 3 fc:b 0 fcal 15000 0/0 274845/562884296 8.5.2 syncmirror without metrocluster syncmirror local (without metrocluster) is a standard...

  • Page 138

    118 ibm system storage n series hardware guide 8.6 metrocluster zoning and ti zones traditional san has great flexibility in connecting devices to ports if the ports are configured correctly and any zoning requirements are met. However, a metrocluster expects certain devices to be connected to speci...

  • Page 139

    Chapter 8. Metrocluster 119 you can benefit from using two isls per fabric (instead of one isl per fabric) to separate out high-priority cluster interconnect traffic from other traffic. This configuration prevents contention on the back-end fabric, and provides additional bandwidth in some cases. Th...

  • Page 140: 8.7  Failure Scenarios

    120 ibm system storage n series hardware guide figure 8-13 shows an example of ti in a fabric metrocluster environment. Vi traffic (orange) is separated from data/backend traffic (black) by ti zones. Figure 8-13 ti zones in metrocluster environment 8.7 failure scenarios this section describes some p...

  • Page 141

    Chapter 8. Metrocluster 121 8.7.1 metrocluster host failure in this scenario, n series n1 (node 1) failed. Cfo/metrocluster takes over the services and access to its disks, as shown in figure 8-14. The fabric switches provide the connectivity for the n series n2 and the hosts to continue to access d...

  • Page 142

    122 ibm system storage n series hardware guide 8.7.3 metrocluster interconnect failure in this scenario, the fabric switch interconnects failed, as shown in figure 8-16. Although this is not a critical failure, it must be resolved promptly before a more critical failure occurs. Figure 8-16 interconn...

  • Page 143

    Chapter 8. Metrocluster 123 8.7.4 metrocluster site failure in this scenario, a site disaster occurred and all switches, storage systems, and hosts are lost, as shown in figure 8-17. To continue data access, a cluster failover must be started by using the cfo -d command. Both primaries now exist at ...

  • Page 144

    124 ibm system storage n series hardware guide 8.7.5 metrocluster site recovery after the hosts, switches, and storage systems are recovered at data center 1, a recovery can be performed. A cf giveback command is run to resume normal operations, as shown in figure 8-18. Mirrors are resynchronized an...

  • Page 145

    © copyright ibm corp. 2012, 2014. All rights reserved. 125 chapter 9. Metrocluster expansion cabling this chapter describes two options for using metrocluster with sas connected expansion shelves. This chapter includes the following sections: fibrebridge 6500n stretch metrocluster with sas shelves a...

  • Page 146: 9.1  Fibrebridge 6500N

    126 ibm system storage n series hardware guide 9.1 fibrebridge 6500n the atto fibrebridge 6500n provides an innovative bridging solution between the fibre channel and sas protocols. It is an fc/sas bridge in exn3000 (2857-003) and exn3500 (2857-006) storage expansion units that are attached to ibm s...

  • Page 147

    Chapter 9. Metrocluster expansion cabling 127 table 9-1 shelf combinations in a fibrebridge stack the fc-sas00 fibrebridge product has the following specifications: two 8 gbps fc ports (optical sfp+ modules included) (4x) 6 gbps sas ports (only one sas port used) dual 100/1000 rj-45 ethernet ports s...

  • Page 148

    128 ibm system storage n series hardware guide a sample cabling diagram is shown in figure 9-3. Figure 9-3 fibrebridge stack of sas shelves the normal platform spindle limits apply to the entire metrocluster configuration. However, because each controller sees all storage, the platform spindle limit...

  • Page 149

    Chapter 9. Metrocluster expansion cabling 129 figure 9-4 shows an example of an n series stretch metrocluster environment. Fibre channel ports of the n series nodes are connected to the fibre channel ports on the fibrebridge (fc1 and fc2). Sas ports of the first and last shelf in a stack are connect...

  • Page 150

    130 ibm system storage n series hardware guide figure 9-5 shows an example of a fabric metrocluster that uses fibrebridges to connect to sas disk shelves. Each of the two nodes connects through four fibre channel links to the san fabrics for data traffic plus two more fibre channel links that are in...

  • Page 151

    Chapter 9. Metrocluster expansion cabling 131 the fibrebridge has the following environmental specifications: power consumption is 55w: 110v, 0.5a/220v, 0.25a input 85-264 vac, 1a, 47-63 hz btu: 205 btu/hr weight: 8.75 lbs the fibrebridge has the following operating environment specifications: tempe...

  • Page 152

    132 ibm system storage n series hardware guide if you are using sas optical multimode breakout cables, the following parameters apply: – you can use these cables for controller-to-shelf and shelf-to-shelf connections. – if you use multimode breakout cables for a shelf-to-shelf connection, you can us...

  • Page 153

    Chapter 9. Metrocluster expansion cabling 133 about these procedures the following general information applies to the procedures that are described in this ibm redbooks® publication: the use of sas optical cables in a stack that is attached to fibrebridge 6500n bridges is not supported. Disk shelves...

  • Page 154

    134 ibm system storage n series hardware guide 3. Install the disk shelves, power them on, and set the shelf ids. For more information, see the installation and service guide that came with your disk shelf. 4. Create a port list to assign disk drives to the pools appropriately. 5. Cable the shelf-to...

  • Page 155

    Chapter 9. Metrocluster expansion cabling 135 c. Compare the firmware information in the command output with the disk shelf firmware information at the ibm n series support site to determine the most current disk shelf firmware version. 13.The next step depends on how current the disk shelf firmware...

  • Page 156

    136 ibm system storage n series hardware guide the configuration is listed in the system storage configuration field. It should be the fourth line of output. 2. If you are replacing sas copper cables with sas optical cables, verify that the disk shelves in the storage system have the latest version ...

  • Page 157

    Chapter 9. Metrocluster expansion cabling 137 the output should be the same as step 1; the system should be multi-path ha, and the sas port and attached disk shelf information should be the same. If the output is something other than multi-path ha, you must identify the cabling error, correct it, an...

  • Page 158

    138 ibm system storage n series hardware guide about this task disk shelves do not need to be grounded; grounding is done through the power cords. Complete the following steps: 1. Properly ground yourself. 2. Install the two-post telco tray kit or the four-post rail kit for your disk shelf model by ...

  • Page 159

    Chapter 9. Metrocluster expansion cabling 139 for more information, see “changing the disk shelf id” in the disk shelf installation and service guide. Cabling the hot-added disk shelf cabling the hot-added disk shelf involves cabling the sas connections and, if applicable, assigning disk drive owner...

  • Page 160

    140 ibm system storage n series hardware guide b. Enter the following command to verify that all disk drives can be seen by the system: sasadmin shelf adapter_name the system displays a representation of your disk shelf that is populated with all the disk drives it sees. C. Enter the following comma...

  • Page 161

    Chapter 9. Metrocluster expansion cabling 141 if there is similar output, disk drives with downrev firmware were detected and the firmware is updated automatically. Go to the next step. If there is no similar output, wait for an hourly message on the console and take the applicable following action:...

  • Page 162

    142 ibm system storage n series hardware guide before you begin, verify that the following prerequisites were met: you ordered and received the appropriate type, number, and length of sas optical cables that are required for your configuration. Your ordered and received the appropriate number and ty...

  • Page 163

    Chapter 9. Metrocluster expansion cabling 143 figure 9-6 stretch metrocluster using fibrebridge and sas copper cables figure 9-7 on page 144 is an example of how a 62xx looks after the system is cabled with sas optical cables (which were replaced the fibrebridge 6500n bridges and sas copper cables)..

  • Page 164

    144 ibm system storage n series hardware guide figure 9-7 stretch metrocluster using sas optical cables complete the following steps: 1. Complete the sas cabling worksheet in the universal sas and acp cabling guide. You must know the controller sas ports that you plan to use to cable your system (wi...

  • Page 165

    Chapter 9. Metrocluster expansion cabling 145 c. Compare the firmware information in the command output with the disk shelf firmware information at the n series support site to determine the most current disk shelf firmware version. 4. The next step depends on how current the disk shelf firmware is:...

  • Page 166

    146 ibm system storage n series hardware guide 14.Boot the nodes by entering the following command on either node: boot_ontap 15.Verify that you correctly replaced the sas cables by entering the following command on the console of either node: sysconfig the output should be the same as step 2: the s...

  • Page 167: Data Protection With Raid

    © copyright ibm corp. 2012, 2014. All rights reserved. 147 chapter 10. Data protection with raid double parity this chapter provides an overview of raid double parity (raid-dp) and describes how it dramatically increases the data fault tolerance of various disk failure scenarios. Other key areas tha...

  • Page 168: 10.1  Background

    148 ibm system storage n series hardware guide 10.1 background in this chapter, the term volume , when used alone, is defined to mean both traditional volumes and aggregates. Data ontap volumes have the following distinct versions: traditional volumes virtual volumes, which are called flexvols flexv...

  • Page 169: 10.2  Why Use Raid-Dp

    Chapter 10. Data protection with raid double parity 149 10.2 why use raid-dp traditional single-parity raid offers adequate protection against a single event. This event can be a complete disk failure or a bit error during a read. In either event, data is re-created by using parity data and data tha...

  • Page 170

    150 ibm system storage n series hardware guide 10.2.1 single-parity raid using larger disks the various options to extend the ability of single-parity raid to protect data as disks continue to get larger are unattractive. The first option is to continue to buy and implement storage that uses the sma...

  • Page 171: 10.3  Raid-Dp Overview

    Chapter 10. Data protection with raid double parity 151 figure 10-4 raid-dp raid-dp significantly increases the fault tolerance from failed disk drives over traditional raid. Based on the standard mean time to data loss (mttdl) formula, raid-dp is approximately 10,000 times more reliable than single...

  • Page 172

    152 ibm system storage n series hardware guide better system performance read/write operations are faster over large raid groups than over smaller raid groups. Advantages of small raid groups small raid group configurations offer the following advantages: shorter disk reconstruction times during dis...

  • Page 173

    Chapter 10. Data protection with raid double parity 153 10.4.1 internal structure of raid-dp with raid-dp, the traditional raid 4 horizontal parity structure is still employed and becomes a subset of the raid-dp construct; that is, how raid 4 works on storage is not modified with raid-dp. Data is wr...

  • Page 174

    154 ibm system storage n series hardware guide 10.4.3 adding raid-dp double-parity stripes figure 10-8 adds one diagonal parity stripe, which is denoted by the blue shaded blocks, and a second parity disk, which is denoted with a dp in the sixth column. These are added to the existing raid 4 group f...

  • Page 175

    Chapter 10. Data protection with raid double parity 155 omitting the one diagonal stripe does not affect raid-dp’s ability to recover all data in a double-disk failure as shown in the reconstruction example. The same raid-dp diagonal parity conditions that are described n this example are true in re...

  • Page 176

    156 ibm system storage n series hardware guide with this in mind, traverse the blue series diagonal blocks in figure 10-10 on page 155. Notice that only one of the five blue series blocks are missing. With four out of five elements available, raid-dp has all of the information that is needed to reco...

  • Page 177

    Chapter 10. Data protection with raid double parity 157 the algorithm continues determining whether more diagonal blocks can be re-created. The upper left block is re-created from row parity, and raid-dp can proceed in re-creating the gray diagonal block in column two, row two, as shown in figure 10...

  • Page 178

    158 ibm system storage n series hardware guide as noted earlier, the white diagonal stripe is not stored, and no other diagonal blocks can be re-creating on the existing chain. Raid-dp continues to search for a new chain to start re-creating diagonal blocks. In this example, the procedure determines...

  • Page 179

    Chapter 10. Data protection with raid double parity 159 after the missing block in the horizontal row is re-created, reconstruction switches back to diagonal parity to re-creating a missing diagonal block. Raid-dp can continue in the current chain on the red stripe, as shown in figure 10-17. Figure ...

  • Page 180

    160 ibm system storage n series hardware guide creating raid-dp aggregates and traditional volumes to create an aggregate or traditional volume with raid-dp–based raid groups, select that option in filerview when storage is provisioned. You can also add the –t raid_dp switch to the traditional aggr ...

  • Page 181

    Chapter 10. Data protection with raid double parity 161 when the command is entered, the aggregate or traditional volumes (as in the following examples) are instantly denoted as raid-dp. However, all diagonal parity stripes still must be calculated and stored on the second parity disk. Figure 10-21 ...

  • Page 182

    162 ibm system storage n series hardware guide figure 10-23 shows a completed conversion to raid-dp volume. Figure 10-23 the itso volume completed raid-dp conversion successfully converting existing aggregates and traditional volumes back to raid4 aggregates and traditional volumes can be converted ...

  • Page 183: 10.5  Hot Spare Disks

    Chapter 10. Data protection with raid double parity 163 raid-dp volume management from a management and operational perspective, raid-dp aggregates and traditional volumes work exactly as their raid4 counterparts. The same practices and guidelines work for raid4 and raid-dp. Therefore, little to no ...

  • Page 184

    164 ibm system storage n series hardware guide during disk failure, the storage system replaces the failed disk with a spare and reconstructs data. If a disk fails, the storage system runs the following actions: 1. The storage system replaces the failed disk with a hot spare disk. If raid-dp is enab...

  • Page 185: Core Technologies

    © copyright ibm corp. 2012, 2014. All rights reserved. 165 chapter 11. Core technologies this chapter describes n series core technologies, such as the wafl file system, disk structures, and non-volatile ram (nvram) access methods. This chapter includes the following sections: write anywhere file la...

  • Page 186

    166 ibm system storage n series hardware guide 11.1 write anywhere file layout write anywhere file layout (wafl) is the n series file system. At the core of data ontap is wafl, which is n series proprietary software that manages the placement and protection of storage data. Integrated with wafl is n...

  • Page 187: 11.2  Disk Structure

    Chapter 11. Core technologies 167 the first best available is always going to be a complete stripe across an entire raid group that uses the least amount of head movement to access. That is arguably the most important criterion for choosing where wafl is going to locate data on a disk. Data ontap ha...

  • Page 188

    168 ibm system storage n series hardware guide the n series reduces this penalty by buffering nvram-protected writes in memory, and then writing full raid stripes plus parity whenever possible. This process makes reading parity data before writing unnecessary, and requires only a single parity calcu...

  • Page 189

    Chapter 11. Core technologies 169 11.4 intelligent caching of write requests caching writes were used as a means of accelerating write performance since the earliest days of storage. The n series uses a highly optimized approach to write caching that integrates closely with the data ontap operating ...

  • Page 190

    170 ibm system storage n series hardware guide improves response times. Both block-oriented san protocols (fibre channel protocol, iscsi, and fcoe) and file-oriented nas storage protocols (cifs and nfs) require an acknowledgement from the storage system that a write was completed. To reply to a writ...

  • Page 191

    Chapter 11. Core technologies 171 the goal of wafl is to write data in full stripes across the storage media. To write the data, it holds write requests in nvram while it chooses the best location for the data. It then completes raid calculations, parity calculations, and gathers enough data to writ...

  • Page 192

    172 ibm system storage n series hardware guide 11.5 n series read caching techniques the random read performance of a storage system depends on drive count (total number of drives in the storage system) and drive rotational speed. Unfortunately, adding more drives to boost storage performance also m...

  • Page 193

    Chapter 11. Core technologies 173 answers to these questions can be determined in large part based on the following types of data and how it got into memory in the first place: write data write workloads tend not to be read back after writing. They are often already cached locally on the system that...

  • Page 194

    174 ibm system storage n series hardware guide.

  • Page 195: Flash Cache

    © copyright ibm corp. 2012, 2014. All rights reserved. 175 chapter 12. Flash cache this chapter provides an overview of flash cache and all of its components. This chapter includes the following sections: about flash cache flash cache module how flash cache works 12.

  • Page 196: 12.1  About Flash Cache

    176 ibm system storage n series hardware guide 12.1 about flash cache flash cache (previously called pam ii) is a set of solutions that combine software and hardware within ibm n series storage controllers. It increases system performance without increasing the disk drive count. Flash cache is imple...

  • Page 197

    Chapter 12. Flash cache 177 12.3.1 data ontap disk read operation in data ontap before flash cache, when a client or host needed data and it was not in the system’s memory, a disk read resulted. Essentially, the system asked itself if it had the data in ram and when the answer was no, it went to the...

  • Page 198

    178 ibm system storage n series hardware guide figure 12-3 clearing memory before flash cache is introduced 12.3.3 saving useful data in flash cache with the addition of flash cache modules, the data that was cleared previously is now placed in the module. Data is always read from disk into memory a...

  • Page 199

    Chapter 12. Flash cache 179 12.3.4 reading data from flash cache when the data is stored in the module, data ontap can check to see whether the data is there the next time it is needed, as shown in figure 12-5. Figure 12-5 read request with flash cache module installed when the data is there, access...

  • Page 200

    180 ibm system storage n series hardware guide.

  • Page 201: Disk Sanitization

    © copyright ibm corp. 2012, 2014. All rights reserved. 181 chapter 13. Disk sanitization this chapter describes disk sanitization and the process of physically removing data from a disk. This process involves overwriting patterns on the disk in a manner that precludes the recovery of that data by an...

  • Page 202: 13.2  Data Confidentiality

    182 ibm system storage n series hardware guide 13.1 data ontap disk sanitization ibm n series data ontap includes disk sanitization with a separately licensable, no-cost solution as a part of every offered system. When enabled, this feature logically deletes all data on one or more physical disk dri...

  • Page 203

    Chapter 13. Disk sanitization 183 sanitization is the process of preventing the retrieval of information from the erased media by using normal system functions or software. The data might still be recoverable, but not without special laboratory techniques. This level of security is typically achieve...

  • Page 204

    184 ibm system storage n series hardware guide by using data ontap, ibm system storage n series offers an effective sanitization method that reduces costs and risks. The disk sanitization algorithms are built into data ontap and require only licensing. No other software installation is required. 13....

  • Page 205

    Chapter 13. Disk sanitization 185 if you must cancel the sanitization process, use the disk sanitize abort command. If the specified disks are undergoing the disk formatting phase of sanitization, the abort does not occur until the disk formatting is complete. At that time, data ontap displays a mes...

  • Page 206

    186 ibm system storage n series hardware guide sanitization aborted by user. Tue jun 24 03:22:41 disk 8a.32 [s/n 43208987] cycle 2 pattern write of 0x47 completed in 00:11:16. Tue jun 24 03:22:41 disk sanitization on drive 8a.32 [s/n 43208987] completed. The sanitization process can take a long time...

  • Page 207

    © copyright ibm corp. 2012, 2014. All rights reserved. 187 chapter 14. Designing an n series solution this chapter describes the issues to consider when you are sizing an ibm system storage n series storage system to your environment. The following topics are addressed: a complete explanation is bey...

  • Page 208

    188 ibm system storage n series hardware guide 14.1 primary issues that affect planning you must determine the following questions during the planning process: which model ibm system storage n series to use. What amount of storage is required on the ibm system storage n series. Which optional featur...

  • Page 209

    Chapter 14. Designing an n series solution 189 to add to the confusion, these suffixes often were applied in different ways across different technologies. For example, network bandwidth is always decimal (100 mbps = 100 x 10^6 bits). Memory is always binary, but is not usually shown as “gib” (4 gb =...

  • Page 210

    190 ibm system storage n series hardware guide the minimum acceptable practice is to allocate one spare drive, per drive type, per controller head. In our example, this results in two disks because it is a two-node cluster. Raid: when a drive fails, it is the following raid information that allows t...

  • Page 211

    Chapter 14. Designing an n series solution 191 checksums for data integrity there are two checksum types that are available: bcs (block) and azcs (advanced zoned). Both checksum types provide the same resiliency capabilities. – block checksum (bcs): • fibre channel (fc) and sas disks these disks nat...

  • Page 212

    192 ibm system storage n series hardware guide table 14-2 right-sized disk capacities effect of the aggregate when the disks are added to an aggregate, they are automatically assigned to raid groups. Although this process can be tuned manually, there is no separate step to create raid groups within ...

  • Page 213

    Chapter 14. Designing an n series solution 193 dot 7.X in earlier versions on ontap, the aggregate had a default aggregate snapshot reserve of 5%. However, the modern administration tools (such as nsm) use a default of 0%. This default often was used only in a metrocluster or syncmirror configuratio...

  • Page 214

    194 ibm system storage n series hardware guide to return to reconciling usable storage to raw storage, this example suggests that 65% or 55% of raw capacity is available for storing user data. The percentage depends on how you classify the snapshot reserve. In general, larger environments tend to re...

  • Page 215

    Chapter 14. Designing an n series solution 195 14.2.3 capacity overhead versus performance there is considerable commercial pressure to make efficient use of the physical storage media. However, there are also times when the use of more disk spindles is beneficial. Consider the following example win...

  • Page 216

    196 ibm system storage n series hardware guide where possible, a good practice from the beginning is to try to avoid fully populating disk shelves. It is much more flexible to install a new storage system with two half-full disk shelves that are attached to it rather than a single full shelf. The ad...

  • Page 217

    Chapter 14. Designing an n series solution 197 enterprise applications direct-attached storage (das) architectures that are used to deploy enterprise applications have significantly different requirements than the home directory environment. It is common for the emphasis to be on performance, uptime...

  • Page 218

    198 ibm system storage n series hardware guide mailbox limit the mailbox limit usually represents the quota that is assigned to users for their mailboxes. If you have multiple quotas for separate user groups, this limit represents the average. This average, which is multiplied by the number of users...

  • Page 219

    Chapter 14. Designing an n series solution 199 14.2.8 backup servers protecting and archiving critical corporate data is increasingly important. Deploying servers for this purpose is becoming more common, and these configurations call for their own planning guidelines. A backup server generally is n...

  • Page 220

    200 ibm system storage n series hardware guide rate at which stored data is modified data that does not change much (for example, archive repositories) does not need to be synchronized as often, and each operation takes less time. Use and effect of third-party backup facilities (for example, ibm tiv...

  • Page 221

    Chapter 14. Designing an n series solution 201 you also must consider the service level agreement for response time, data access, and application performance. How long can your customers work within a degraded performance environment? If the answer is not long at all, the initial sizing of each node...

  • Page 222: 14.3  Summary

    202 ibm system storage n series hardware guide 14.3 summary this chapter provided a high-level set of guidelines for planning only. Consideration of the issues that are described maximizes the likelihood for a successful initial deployment of an ibm system storage n series storage system. Other sour...

  • Page 223: Installation and

    © copyright ibm corp. 2012, 2014. All rights reserved. 203 part 2 installation and administration this part provides guidance and checklists for planning the initial hardware installation and software setup. To help perform the initial hardware and software setup, it also describes the following adm...

  • Page 224

    204 ibm system storage n series hardware guide.

  • Page 225: Preparation and Installation

    © copyright ibm corp. 2012, 2014. All rights reserved. 205 chapter 15. Preparation and installation this chapter describes the n series system manager tool. By using this tool, you can manage the n series storage system even with limited experience and knowledge of the n series hardware and software...

  • Page 226

    206 ibm system storage n series hardware guide 15.1 installation prerequisites this section describes, at a high level, some of the planning and prerequisite tasks that must be completed for a successful n series implementation. For more information, see the n series introduction and planning guide,...

  • Page 227

    Chapter 15. Preparation and installation 207 sufficient people to safely install the equipment into a rack: – two or three people are required, depending on the hardware model – see the specific hardware installation guide for your equipment 15.2 configuration worksheet before you power on your stor...

  • Page 228

    208 ibm system storage n series hardware guide ethernet interfaces interface name ipv4 address ipv4 subnet mask ipv6 address ipv6 subnet prefix length partner ip address or interface media type (network type) are jumbo frames supported? Mtu size for jumbo frames flow control e0m interface (if availa...

  • Page 229

    Chapter 15. Preparation and installation 209 cifs windows domain wins servers (1, 2, 3) multiprotocol or ntfs only filer? Should cifs create default /etc/passwd and /etc/group files? Enable nis group caching? Hours to update the nis cache? Cifs server name (if different from default) user authentica...

  • Page 230

    210 ibm system storage n series hardware guide 15.3 initial hardware setup the initial n series hardware setup includes the following steps: 1. Hardware rack and stack: storage controllers, disk shelves, and so on 2. Connectivity: – storage controller to disk shelves – ethernet connectivity 3. Ontap...

  • Page 231

    Chapter 15. Preparation and installation 211 15.4 troubleshooting if the system does not boot this section is an excerpt from the data ontap 8.1 7-mode software setup guide. If your system does not boot when you power it on, you can troubleshoot the problem by completing the following steps: 1. Look...

  • Page 232

    212 ibm system storage n series hardware guide e. Exit the diagnostic monitor by entering 99 at the prompt. F. Run the exit command to return to loader. G. Start data ontap by entering autoboot at the prompt. 11.Try starting your system again. Table 15-3 shows the next possible steps that you can ta...

  • Page 233

    © copyright ibm corp. 2012, 2014. All rights reserved. 213 chapter 16. Basic n series administration this chapter describes how to perform basic administration tasks on ibm system storage n series storage systems. This chapter includes the following sections: administration methods starting, stoppin...

  • Page 234

    214 ibm system storage n series hardware guide 16.1 administration methods the following methods can be used to administer an n series storage system: command-line interface (cli) n series system manager oncommand 16.1.1 filerview interface earlier versions on the n series controllers supported a bu...

  • Page 235

    Chapter 16. Basic n series administration 215 enter command> help for a list of the available options of the specified command, as shown in figure 16-1. Figure 16-1 the help and ? Commands the manual pages can be accessed by entering the man command. Figure 16-2 shows a detailed description of a com...

  • Page 236

    216 ibm system storage n series hardware guide 16.1.3 n series system manager system manager provides setup and management capabilities for san and nas environments from a microsoft windows system. You can use system manager to quickly and efficiently set up storage systems that are in a single node...

  • Page 237

    Chapter 16. Basic n series administration 217 16.2.1 starting the ibm system storage n series storage system the ibm system storage n series boot code is on a compactflash card. After the system is turned on, ibm system storage n series boots automatically from this card. You can enter an alternativ...

  • Page 238

    218 ibm system storage n series hardware guide common internet file system (cifs) services the cifs sessions command reports open sessions to the ibm system storage n series storage system, as shown in example 16-3. Example 16-3 list open cifs sessions itsosj-n1> cifs sessions server registers as 'i...

  • Page 239

    Chapter 16. Basic n series administration 219 you can select single workstations for which the cifs service should stop, as shown in example 16-5. Example 16-5 the cifs terminate command for a single workstation itsosj-n1> cifs terminate -t 3 workstation_01 3 minutes left until termination (^c to ab...

  • Page 240

    220 ibm system storage n series hardware guide you can verify whether cifs is running by using the cifs sessions command. If cifs is not running, a message is displayed, as shown in example 16-7. Example 16-7 checking whether cifs is running on the n series itsosj-n1> cifs sessions cifs not running....

  • Page 241

    Chapter 16. Basic n series administration 221 netboot boots from a data ontap version that is stored on a remote http or tftp server. The netboot option enables you to boot an alternative kernel if the compact flash card becomes damaged. You can upgrade the boot kernel for several devices from a sin...

  • Page 242

    222 ibm system storage n series hardware guide add net default: gateway 192.186.101.57: network unreachable wed aug 31 12:01:02 pdt [rc:alert]: timed: time daemon started wed aug 31 12:01:03 pdt [itsosj-n1: mgr.Boot.Disk_done:info]: data ontap release 7.1h1 boot complete. Last disk update written at...

  • Page 243: Client Hardware

    © copyright ibm corp. 2012, 2014. All rights reserved. 223 part 3 client hardware integration this part describes the functions and installation of the host utility kit software. It also describes how to configure a client system to san boot from an n series, and provides a high-level description of...

  • Page 244

    224 ibm system storage n series hardware guide.

  • Page 245: Host Utilities Kits

    © copyright ibm corp. 2012, 2014. All rights reserved. 225 chapter 17. Host utilities kits this chapter provides an overview of the purpose, contents, and functions of host utilities kits (huks) for ibm n series storage systems. It describes why huks are an important part of any successful n series ...

  • Page 246: 17.1  Host Utilities Kits

    226 ibm system storage n series hardware guide 17.1 host utilities kits host utilities kits (huks) are a set of software programs and documentation that enable you to connect host servers to ibm n series storage systems. The n series host utilities enable connection and support from host computers t...

  • Page 247

    Chapter 17. Host utilities kits 227 huks are available that support the following programs: aix with fibre channel protocol (fcp) and iscsi linux with fcp/iscsi hp-ux with fcp/iscsi solaris platform edition (sparc and x86) with fcp/iscsi vmware esx with fcp/iscsi windows with fcp/iscsi 17.3 host uti...

  • Page 248

    228 ibm system storage n series hardware guide 17.4.2 preparation before you install the host utilities, verify that the host utilities version supports your host and storage system configuration. Verifying your host and storage system configuration the interoperability matrix lists all supported co...

  • Page 249

    Chapter 17. Host utilities kits 229 next, verify your cabling. For more information, see the fc and iscsi configuration guide, which is available at this website: http://www.Ibm.Com/storage/support/nas/ configuring fibre channel hbas and switches complete the following steps to install and configure...

  • Page 250

    230 ibm system storage n series hardware guide the iscsi software initiator provides excellent performance. In fact, an iscsi software initiator provides better performance than an iscsi hba in most configurations. The iscsi initiator software for windows is available from microsoft for no charge. I...

  • Page 251

    Chapter 17. Host utilities kits 231 install a supported dsm before you install the windows host utilities. Select from the following choices: data ontap dsm for windows mpio veritas dmp dsm microsoft iscsi dsm (part of the iscsi initiator package) microsoft msdsm (included with windows server 2008 a...

  • Page 252

    232 ibm system storage n series hardware guide c. Select the n series software that you want to download, and then select the download view. D. Click software packages on the website that is shown and follow the online instructions to download the software. 3. Run the executable file, and then follo...

  • Page 253

    Chapter 17. Host utilities kits 233 the wwpn resembles the following example: wwpn: 10:00:00:00:c9:73:5b:90 for windows server 2008 or windows server 2008 r2, use the windows storage explorer application to display the wwpns. For windows server 2003, use the microsoft fcinfo.Exe program. You also ca...

  • Page 254: 17.5  Setting Up Luns

    234 ibm system storage n series hardware guide host utilities sets registry values to optimize performance that are based on your selections during installation, including windows mpio, data ontap dsm, or the use of fibre channel hbas. On systems that use fibre channel, the host utilities installer ...

  • Page 255

    Chapter 17. Host utilities kits 235 for iscsi connections, create an iscsi igroup that uses the iscsi node name of the host. For systems that use both fc and iscsi connections to the same lun, create two igroups: one for fc and one for iscsi. Then, map the lun to both igroups. There are many ways to...

  • Page 256

    236 ibm system storage n series hardware guide 17.5.5 accessing luns on hosts this section addresses how to make luns on n series storage subsystems accessible to hosts. Accessing luns on hosts that use veritas storage foundation to enable the host that runs veritas storage foundation to access a lu...

  • Page 257: Boot From San

    © copyright ibm corp. 2012, 2014. All rights reserved. 237 chapter 18. Boot from san storage area network (san) boot is a technique that allows servers to use an operating system (os) image that is installed on external san-based storage to boot. The term san booting means the use of a san-attached ...

  • Page 258: 18.1  Overview

    238 ibm system storage n series hardware guide 18.1 overview fcp san boot, remote boot, and root boot refer to a configuration in which the operating system is installed on a logical drive that is not local to the server chassis. San boot has the following primary benefits over booting the host os f...

  • Page 259

    Chapter 18. Boot from san 239 reduce overall cost of servers locating server boot images on external san storage eliminates the need for a local disk in the server. This configuration helps lower costs and allows san boot users to purchase servers at a reduced cost while still maintaining the same f...

  • Page 260

    240 ibm system storage n series hardware guide the infrastructure and equipment that is used in the examples consists of the hardware and software that is listed in table 18-1. Table 18-1 hardware and software configuration 18.2.2 preferred practices the following guidelines help you get the most ou...

  • Page 261

    Chapter 18. Boot from san 241 – depending on the device configuration, paging to a san device might be slower than paging to local storage. This issue is unlikely because paging operations benefit from the write cache and multiple disk spindles that are available from enterprise-class san storage sy...

  • Page 262

    242 ibm system storage n series hardware guide deploy microsoft cluster services on a windows server 2003 platform by using storport drivers. With this configuration, the boot disks and shared cluster disks can be accessed through the same hba, as shown in figure 18-1. A registry entry is required t...

  • Page 263

    Chapter 18. Boot from san 243 4. Load the boot sector: the first sector of the boot device, which contains the mbr (master boot record), is loaded. The mbr contains the address of the bootable partition on the disk where the operating system is located. 18.2.4 configuring san booting before installi...

  • Page 264

    244 ibm system storage n series hardware guide 3. Select the appropriate adapter and press enter, as shown in figure 18-2. Figure 18-2 emulex bios utility bootbios displays the configuration information for the hba, including the wwpn, as shown in figure 18-3. Figure 18-3 adapter 02 panel 4. Record ...

  • Page 265

    Chapter 18. Boot from san 245 3. Bootbios displays a menu of available adapters. Select the appropriate hba and press enter, as shown in figure 18-4. Figure 18-4 selecting host adapter 4. The fast!Util options are displayed. Select configuration settings and press enter, as shown in figure 18-5. Fig...

  • Page 266

    246 ibm system storage n series hardware guide 5. Select adapter settings and press enter, as shown in figure 18-6. Figure 18-6 configuration settings panel the adapter settings are displayed including the wwpn, as shown in figure 18-7. Figure 18-7 enabling host adapter bios in adapter settings menu...

  • Page 267

    Chapter 18. Boot from san 247 bootbios firmware is disabled by default. To configure san booting, you must first enable bootbios firmware and then configure it to boot from a san disk. You can enable and configure bootbios on the hba by using one of the following tools: emulex lp6dutil.Exe the defau...

  • Page 268

    248 ibm system storage n series hardware guide 4. From the configure adapter’s parameters menu, select 1 to enable the bios, as shown in figure 18-10. Figure 18-10 configure the adapter’s parameters panel 5. This panel shows the bios disabled. Select 1 to enable the bios, as shown in figure 18-11. F...

  • Page 269

    Chapter 18. Boot from san 249 the bios is now enabled, as shown in figure 18-12. Figure 18-12 enable bios success panel 6. Press esc to return to the configure adapter’s parameters menu, as shown in figure 18-13. Figure 18-13 configure adapter’s parameters panel.

  • Page 270

    250 ibm system storage n series hardware guide 7. Press esc to return to the main configuration menu. You are now ready to configure your boot devices. Select 1 to configure the boot devices, as shown in figure 18-14. Figure 18-14 adapter 02 panel 8. The eight boot entries are zero by default. The p...

  • Page 271

    Chapter 18. Boot from san 251 9. At initialization, emulex scans for all possible targets or boot devices. If the hba is attached to a storage array, the storage device is visible. To view the luns, select the storage array controller. Figure 18-16 shows two arrays within the entry field. Select 01 ...

  • Page 272

    252 ibm system storage n series hardware guide 11.Bootbios displays a menu of bootable devices. The devices are listed in boot order. The primary boot device is the first device that is listed. If the primary boot device is unavailable, the host boots from the next available device in the list. In t...

  • Page 273

    Chapter 18. Boot from san 253 13.After this process is complete, pressx to exit and save your configuration, as shown in figure 18-20. Your hba’s bootbios is now configured to boot from a san on the attached storage device. Figure 18-20 exit emulex boot utility and saved boot device panel 14.Press y...

  • Page 274

    254 ibm system storage n series hardware guide enabling and configuring qlogic bootbios complete the following steps to configure qlogic bootbios: 1. Power on or reboot your host. 2. Press ctrl+q or alt+q to enter the bios configuration utility, as shown in figure 18-22. Figure 18-22 pressing ctrl+q...

  • Page 275

    Chapter 18. Boot from san 255 4. Select configuration settings and press enter, as shown in figure 18-24. Figure 18-24 configuration settings for qle2462 adapter panel 5. Select adapter settings and press enter, as shown in figure 18-25. Figure 18-25 adapter settings panel.

  • Page 276

    256 ibm system storage n series hardware guide 6. Scroll to host adapter bios, as shown in figure 18-26. If this option is disabled, press enter to enable it. If this option is enabled, go to the next step. Figure 18-26 enabling host adapter bios 7. Press esc to return to the configuration settings ...

  • Page 277

    Chapter 18. Boot from san 257 8. Scroll to selectable boot, as shown in figure 18-28. If this option is disabled, press enter to enable it. If this option is enabled, go to the next step. Figure 18-28 enabling selectable boot in selectable boot settings panel 9. Select the entry in the (primary) boo...

  • Page 278

    258 ibm system storage n series hardware guide 11.Press esc to return to the previous panel. Press esc again and you are prompted to save the configuration settings, as shown in figure 18-31. Select save changes and press enter. Figure 18-31 saving the configuration settings 12.The changes are saved...

  • Page 279

    Chapter 18. Boot from san 259 ibm bios there can be slight differences within the system bios configuration and setup utility, depending on the server model and bios version that are used. Knowledge of bios and rom memory space usage can be required in certain situations. Some older pc architecture ...

  • Page 280

    260 ibm system storage n series hardware guide 3. Select start options, as shown in figure 18-34. Figure 18-34 selecting start options in configuration/setup utility panel 4. Scroll to the pci device boot priority option and select the slot in which the hba is installed, as shown in figure 18-35. Fi...

  • Page 281

    Chapter 18. Boot from san 261 5. Scroll up to startup sequence options and press enter. Make sure that the startup sequence option is configured, as shown in figure 18-36. Figure 18-36 selecting hard disk 0 in startup sequence options panel phoenix bios 4 release 6 to configure phoenix bios to boot ...

  • Page 282

    262 ibm system storage n series hardware guide – for qlogic, select the appropriate hba, click windows server 2003, and download the stor miniport microsoft certified boot from the san driver package from this website: http://driverdownloads.Qlogic.Com/qlogicdriverdownloads_ui/default.Aspx 2. Copy t...

  • Page 283

    Chapter 18. Boot from san 263 mass deployment of boot images requires automated deployment services (ads): windows does not support mass distribution of boot images. Although cloning of boot images can help here, windows does not have the tools for distribution of these images. In enterprise configu...

  • Page 284

    264 ibm system storage n series hardware guide figure 18-37 centralizing storage to reduce power consumption to install the windows server 2008 full installation option, complete the following steps: 1. Insert the appropriate windows server 2008 installation media into your dvd drive. Reboot the ser...

  • Page 285

    Chapter 18. Boot from san 265 figure 18-39 selecting the language to install, regional options, and keyboard input 3. Click install now to begin the installation process, as shown in figure 18-40. Figure 18-40 selecting install now.

  • Page 286

    266 ibm system storage n series hardware guide 4. Enter the product key and click next, as shown in figure 18-41. Figure 18-41 entering the product key 5. Select i accept the license terms and click next, as shown in figure 18-42. Figure 18-42 accepting the license terms.

  • Page 287

    Chapter 18. Boot from san 267 6. Click custom (advanced) as shown in figure 18-43. Figure 18-43 selecting the custom installation option 7. If the window that is shown in figure 18-44 does not show any hard disk drives, or if you prefer to install the hba device driver now, click load driver. Figure...

  • Page 288

    268 ibm system storage n series hardware guide 8. As shown in figure 18-45, insert appropriate media that contains the hba device driver files and click browse. Figure 18-45 load driver window 9. Click ok next. 10.Click next again to leave the windows creates the partition automatically window, or c...

  • Page 289

    Chapter 18. Boot from san 269 12.After you are logged on as the administrator, a configuration wizard window is displayed. Use the wizard for naming and basic networking setup. 13.Use the microsoft server 2008 roles and features functions to set up the server to your specific needs. 18.2.7 red hat e...

  • Page 290

    270 ibm system storage n series hardware guide os kernel after a kernel is selected, the second stage boot loader locates the kernel binary and loads into memory the initial ram disk image. The kernel then checks and configures hardware and peripherals, and extracts the initial ram disk image into l...

  • Page 291

    Chapter 18. Boot from san 271 18.3 boot from san and other protocols this section describes the other protocols that you can boot. Implementing them is similar to the boot from san with fibre channel. 18.3.1 boot from iscsi san iscsi boot is a process in which the os is initialized from a storage di...

  • Page 292

    272 ibm system storage n series hardware guide.

  • Page 293: Host Multipathing

    © copyright ibm corp. 2012, 2014. All rights reserved. 273 chapter 19. Host multipathing this chapter introduces the concepts of host multipathing. It addresses the installation steps and describes the management interface for the windows, linux, and ibm aix operating systems. This chapter includes ...

  • Page 294: 19.1  Overview

    274 ibm system storage n series hardware guide 19.1 overview multipath i/o (mpio) provides multiple storage paths from hosts (initiators) to their ibm system storage n series targets. The multiple paths provide redundancy against failures of hardware, such as cabling, switches, and adapters. They al...

  • Page 295

    Chapter 19. Host multipathing 275 when multiple paths to a lun are available, a consistent method of the use of those paths must be determined. This method is called the load balance policy . The following five standard policies in windows server 2008 apply to multiconnection sessions and mpio. Othe...

  • Page 296

    276 ibm system storage n series hardware guide 19.2.2 native multipathing solution native multipathing solutions are packaged as part of the operating system. As of the time of this writing, windows, esx, linux, hp-ux, solaris, and aix provide native multipathing solutions. Native multipathing solut...

  • Page 297

    Chapter 19. Host multipathing 277 with the implicit alua style, the host multipathing software can monitor the path states but cannot change them, either automatically or manually. Of the active paths, a path can be specified as preferred (optimized in t10), and as non-preferred (non-optimized). If ...

  • Page 298

    278 ibm system storage n series hardware guide.

  • Page 299: Performing Upgrades

    © copyright ibm corp. 2012, 2014. All rights reserved. 279 part 4 performing upgrades this part describes the design and operational considerations for nondisruptive upgrades on the n series platform. It also provides some high-level example procedures for common hardware and software upgrades. This...

  • Page 300

    280 ibm system storage n series hardware guide.

  • Page 301: Designing For Nondisruptive

    © copyright ibm corp. 2012, 2014. All rights reserved. 281 chapter 20. Designing for nondisruptive upgrades nondisruptive upgrade (ndu) began as the process of upgrading data ontap software on the two nodes in an ha pair controller configuration without interrupting i/o to connected client systems. ...

  • Page 302: 20.1  System Ndu

    282 ibm system storage n series hardware guide 20.1 system ndu system ndu is a process that uses ha pair controller technology to minimize client disruption during an upgrade of data ontap or controller firmware. System ndu entails a series of takeover and giveback operations. These operations allow...

  • Page 303

    Chapter 20. Designing for nondisruptive upgrades 283 20.1.2 supported data ontap upgrades support for system ndu differs slightly according to the protocols that are in use on the system. The following sections describe those protocols. Support for nfs environments table 20-1 shows the major and min...

  • Page 304

    284 ibm system storage n series hardware guide support for deduplication and compression you can perform major and minor nondisruptive upgrades when deduplication and compression are enabled. However, avoid active deduplication processes during the planned takeover or planned giveback. Consider the ...

  • Page 305

    Chapter 20. Designing for nondisruptive upgrades 285 table 20-3 maximum number of flexvols for ndu the maximum flexvol volume limit of 500 per controller matches the native data ontap flexvol volume limit. Fields that contain n/a in this column indicate platforms that are not supported by data ontap...

  • Page 306

    286 ibm system storage n series hardware guide table 20-4 shows the maximum number of dense volumes, snapshot copies, luns, and vfiler units that are supported for ndu. Table 20-4 maximum limits for ndu 20.1.5 prerequisites for a system ndu the following sections describe the tasks that must be comp...

  • Page 307

    Chapter 20. Designing for nondisruptive upgrades 287 when autosupport is enabled, failed drives are detected automatically and replacement drives are shipped for installation at the administrator's convenience. Generally, enable autosupport for all storage systems. Removing all old core files clear ...

  • Page 308: 20.2  Shelf Firmware Ndu

    288 ibm system storage n series hardware guide system and firmware ndu support for stretch metrocluster minor and major version ndu is supported in a stretch metrocluster environment. Stretch metrocluster is essentially an ha pair configuration, so the same limits and qualifications apply. System an...

  • Page 309

    Chapter 20. Designing for nondisruptive upgrades 289 20.2.1 types of shelf controller module firmware ndus supported shelf controller module firmware ndu is supported or not supported as shown in table 20-5. Table 20-5 shelf firmware ndu support 20.2.2 upgrading the shelf firmware the following sect...

  • Page 310: 20.3  Disk Firmware Ndu

    290 ibm system storage n series hardware guide normal approach the storage download shelf process requires 5 minutes to download the code to all a shelf modules. During this time, i/o can occur. When the download completes, all a shelf modules are rebooted. This process incurs up to a 70-second disr...

  • Page 311

    Chapter 20. Designing for nondisruptive upgrades 291 20.3.1 overview of disk firmware ndu beginning with data ontap 7.0.1, nondisruptive disk firmware upgrades occur automatically in the background. This process occurs when the disks are members of volumes or aggregates of the following types: raid-...

  • Page 312: 20.4  Acp Firmware Ndu

    292 ibm system storage n series hardware guide firmware updates for disks in raid 4 volumes are performed disruptively upon controller boot unless the disk firmware is removed from the /etc/disk_fw directory beforehand. Raid 4 volumes can be temporarily (or permanently) upgraded to raid-dp to automa...

  • Page 313: 20.5  Rlm Firmware Ndu

    Chapter 20. Designing for nondisruptive upgrades 293 the ndu happens automatically. You do not need to use the storage download acp command. The ndu can take 3 - 4 minutes to complete with up to five acp modules running an ndu in parallel. 20.4.2 upgrading acp firmware manually to upgrade acp firmwa...

  • Page 314

    294 ibm system storage n series hardware guide.

  • Page 315

    © copyright ibm corp. 2012, 2014. All rights reserved. 295 chapter 21. Hardware and software upgrades this chapter describes high-level procedures for some common hardware and software upgrades. This chapter includes the following sections: hardware upgrades software upgrades 21.

  • Page 316: 21.1  Hardware Upgrades

    296 ibm system storage n series hardware guide 21.1 hardware upgrades the following hardware upgrades or additions can be performed non-disruptively: replacing the head (controller), if you are replacing it with the same type, and with the same adapters replacing the system board replacing or adding...

  • Page 317: 21.2  Software Upgrades

    Chapter 21. Hardware and software upgrades 297 the storage system automatically recognizes the new expansion adapter. 21.1.3 upgrading a storage controller head an n series controller can be upgraded from an older hardware controller model without the need to migrate any data (“data in place”). For ...

  • Page 318

    298 ibm system storage n series hardware guide 21.2.1 upgrading to data ontap 7.3 to identify the compatible ibm system storage n series hardware for the supported releases of data ontap, see the ibm system storage n series data ontap matrix that is available at this website: http://www.Ibm.Com/stor...

  • Page 319

    Chapter 21. Hardware and software upgrades 299 21.2.2 upgrading to data ontap 8.1 before you upgrade to dot 8.1 7-mode, inspect your system, including installed hardware and software. Upgrade all software to the most current release. Only migrations from 7.3.X to dot 8.1 7-mode provide the possibili...

  • Page 320

    300 ibm system storage n series hardware guide revert considerations the n series does not support ndu for the revert process for dot 8 7-mode. The following restrictions apply to the revert process: user data is temporarily offline and unavailable during the revert. You must plan when the data is o...

  • Page 321

    Chapter 21. Hardware and software upgrades 301 example 21-3 shows output from the revert process. First, all 64-bit aggregates were removed, all snapshots were deleted for all volumes and aggregates (as shown in the command in example 21-3), and snapshot schedules were disabled. Snapmirror also was ...

  • Page 322

    302 ibm system storage n series hardware guide if you use this optional parameter, you do not need a fully qualified domain name in the netboot server url. You need the server’s host name only. 3. Set up the boot environment, as shown in the following example: set-defaults setenv ontap_ng true seten...

  • Page 323

    Chapter 21. Hardware and software upgrades 303 example 21-4 sysconfig command n6070a> sysconfig -a data ontap release 7.3.7: thu may 3 04:32:51 pdt 2012 (ibm) system id: 0151696979 (n6070a); partner id: 0151697146 (n6070b) system serial number: 2858133001611 (n6070a) system rev: a1 system storage co...

  • Page 324

    304 ibm system storage n series hardware guide the directory /etc/software hosts installable ontap releases (see figure 21-1). The installation images were copied from a windows client by using the administrative share \\filer_ip\c$ . Figure 21-1 windows client share starting with dot 8, software im...

  • Page 325

    Chapter 21. Hardware and software upgrades 305 figure 21-2 boot loader next, run the autoboot command and perform another reboot if dot 8 did not load immediately after the flash update. After the boot process is complete, verify the version by running the version and sysconfig commands, as shown in...

  • Page 326

    306 ibm system storage n series hardware guide.

  • Page 327: Appendixes

    © copyright ibm corp. 2012, 2014. All rights reserved. 307 part 5 appendixes part 5.

  • Page 328

    308 ibm system storage n series hardware guide.

  • Page 329: Getting Started

    © copyright ibm corp. 2012, 2014. All rights reserved. 309 appendix a. Getting started this appendix provides information to help you document, install, and set up your ibm system storage n series storage system. This appendix includes the following sections: preinstallation planning start with the ...

  • Page 330: Preinstallation Planning

    310 ibm system storage n series hardware guide preinstallation planning successful installation of the ibm system storage n series storage system requires careful planning. This section provides information about this preparation. Collecting documents n series product documentation is available at t...

  • Page 331

    Appendix a. Getting started 311 table a-1 provides a worksheet for setting up the node. Table a-1 initial worksheet types of information your values storage system host name if the storage system is licensed for the network file system (nfs) protocol, the name can be no longer than 32 characters. If...

  • Page 332

    312 ibm system storage n series hardware guide ethernet interfaces ip address subnet mask partner ip address if your storage system is licensed for controller takeover, record the interface name or ip address of the partner that this interface takes over during an active/active configuration takeove...

  • Page 333

    Appendix a. Getting started 313 machine location business name address city state country code (value must be two uppercase letters) postal code cifs windows domain wins servers multiprotocol or ntfs only storage system should cifs create default etc/passwd and etc/group files? Enter y here if you h...

  • Page 334: Start With The Hardware

    314 ibm system storage n series hardware guide start with the hardware for more information about the appropriate installation and setup instructions for your model, see this website: https://www-947.Ibm.Com/support/entry/myportal/overview/hardware/system_storage/ne twork_attached_storage_(nas)/ che...

  • Page 335: Power On N Series

    Appendix a. Getting started 315 to connect an ascii terminal console to the n series system, complete the following steps: 1. Set the communications parameters of your system that are shown in table a-2. For example, you can use hyperterminal or putty for windows users and for linux users you can us...

  • Page 336

    316 ibm system storage n series hardware guide the storage system console then displays the boot environment prompt. The boot environment prompt can be cfe> or loader>, depending on your storage system, as shown in example a-1. Example a-1 n series halt n3300a> halt cifs local server is shutting dow...

  • Page 337

    Appendix a. Getting started 317 d. At the 1-5 special boot menu, choose option 4 or option4a. Option 4 creates a raid 4 traditional volume. Selecting option 4a creates a raid-dp aggregate with a root flexvol. The size of the root flexvol is dependant upon platform type, as shown in example a-3. Exam...

  • Page 338

    318 ibm system storage n series hardware guide . . Please enter the new hostname []: g. Complete the initial setup. See example a-6 for the initial setup. H. Install the full operating system. Filerview can be used after the full operating system is installed. The full installation procedure is simi...

  • Page 339: Updating Data Ontap

    Appendix a. Getting started 319 2-character country code (required) []: us postal code where business resides []: the root volume currently contains 2 disks; you may add more disks to it later using the "vol add" or "aggr add" commands. Now apply the appropriate licenses to the system and install th...

  • Page 340

    320 ibm system storage n series hardware guide upgrading data ontap software requires several prerequisites, installing system files, and downloading the software to the system compactflash. Required procedures might include the following steps: update the system board firmware (system firmware). To...

  • Page 341

    Appendix a. Getting started 321 3. Select the data ontap version. 4. Select the installation kit that you want to download. Select and confirm the license agreement to start downloading the software. Installing data ontap system files you can install data ontap system files from a unix client, windo...

  • Page 342

    322 ibm system storage n series hardware guide n3300a*> cif wed may 2 04:25:30 gmt [nbt.Nbns.Registrationcomplete:info]: nbt: all cifs name registrations have completed for the local server. C. Give share access for c$. This access must be set again later for security purposes. Use the following com...

  • Page 343

    Appendix a. Getting started 323 b. Enter the network mapping address, as shown in figure a-2. Figure a-2 mapping address c. Enter a user name and password to access the storage system, as shown in figure a-3. Figure a-3 storage access.

  • Page 344

    324 ibm system storage n series hardware guide the drive is now mapped, as shown in figure a-4. Figure a-4 drive mapping example 3. Complete the following steps to run the data ontap installer: a. Go to the drive to which you previously downloaded the software (see “obtaining the data ontap software...

  • Page 345

    Appendix a. Getting started 325 c. In the winzip dialog box, enter the letter of the drive to which you mapped the storage system. For example, if you chose drive y, replace drive:\etc with the following path, as shown in figure a-6: y:\etc figure a-6 extract path d. Ensure that the following option...

  • Page 346

    326 ibm system storage n series hardware guide g. Check the script output for minimum requirements, as shown in figure a-9. Figure a-9 script output downloading data ontap to the storage system the following steps describe the standard update method for data ontap. For more information about the non...

  • Page 347

    Appendix a. Getting started 327 2. Check whether your system requires a firmware update. At the console of each storage system, enter the following command to compare the installed version of system firmware with the version on the compactflash card, as shown in example a-12: sysconfig -a example a-...

  • Page 348

    328 ibm system storage n series hardware guide 4. Shut down the system by using the halt command. After the storage system shuts down, the firmware boot environment prompt is displayed, as shown in example a-14. Example a-14 halting process n3300a*> halt cifs local server is shutting down... Waiting...

  • Page 349: Changing The Ip Address

    Appendix a. Getting started 329 changing the ip address to change the ip address of a filer, complete the following steps: 1. List the contents of the /etc/hosts file to note the n series name and associated ip address. For example, in the listing that is shown in example a-16, the filer’s name is n...

  • Page 350: Setting Up The Dns

    330 ibm system storage n series hardware guide figure a-11 shows the changes to the /etc/rc file. Figure a-11 /etc/rc file setting up the dns to set up dns, perform these steps: 1. Create or update the ‘ /etc/resolv.Conf file. Then, add or update these entries to the following add name server, as sh...

  • Page 351

    Appendix a. Getting started 331 example a-18 updating dns domain name #---check the dns domainname--- n3300a> options dns.Domainname dns.Domainname (value might be overwritten in takeover) #---update n3300a> options dns.Domainname itso.Tucson.Ibm.Com you are changing option dns.Domainname which appl...

  • Page 352

    332 ibm system storage n series hardware guide 4. To make this change persistent after filer reboot, update the /etc/rc file to ensure that the name server exists, as shown in figure a-13. Figure a-13 the /etc/rc file.

  • Page 353: Operating Environment

    © copyright ibm corp. 2012, 2014. All rights reserved. 333 appendix b. Operating environment this appendix provides information about the physical environment and operational environment specifications of n series controller and disk shelves. This appendix includes the following sections: n3000 entr...

  • Page 354: N3000 Entry-Level Systems

    334 ibm system storage n series hardware guide n3000 entry-level systems this section lists n3000 entry-level specifications. N3400 the ibm system storage n3400 features the following physical specifications: width: 446 mm (17.6 in) depth: 569 mm (22.4 in) height: 88.5 mm (3.5 in) weight: 19.5 kg (4...

  • Page 355

    Appendix b. Operating environment 335 weight: 25.4 kg (56 lb) (two controllers) the ibm system storage n3220 model a12/a22 features the following operating environment specifications: temperature: – maximum range: 10 - 40 degrees c (50 - 104 degrees f) – recommended: 20 - 25 degrees c (68 - 77 degre...

  • Page 356: N6000 Mid-Range Systems

    336 ibm system storage n series hardware guide relative humidity: – maximum operating range: 20% - 80% (non-condensing) – recommended operating range: 40% - 55% – non-operating range: 10% - 95% (non-condensing) – maximum wet bulb: 29 degrees c – maximum altitude: 3000 m (10,000 ft.) wet bulb (calori...

  • Page 357

    Appendix b. Operating environment 337 wet bulb (caloric value): 1553 btu/hr maximum electrical power: 100 - 240 v ac, 12 - 8 a per node, 50 - 60 hz nominal electrical power: – 100 - 120 v ac, 4.7 a; – 200 - 240 v ac, 2.3 a, 5 0- 60 hz noise level: – 55.5 dba @ 1 m @ 23 degrees c – 7.5 bels @ 1 m @ 2...

  • Page 358: N7000 High-End Systems

    338 ibm system storage n series hardware guide n6270 the n6270 models c22, e12, and e22 feature the following physical specifications: width: 44.7 cm (17.6 in.) depth: – 71.3 cm (28.1 in.) with cable management arms – 64.6 cm (25.5 in.) without cable management arms height: 13 cm (5.12 in.) (times 2...

  • Page 359: N Series Expansion Shelves

    Appendix b. Operating environment 339 weight: 117.2 kg (258.4 lb) the ibm system storage n7950t model e22 features the following operating environment specifications: temperature: – maximum range: 10 - 40 degrees c (50 - 104 degrees f) – recommended: 20 - 25 degrees c (68 - 77 degrees f) – non-opera...

  • Page 360

    340 ibm system storage n series hardware guide the exn3000 sas/sata expansion unit features the following operating environment specifications: temperature: – maximum range: 10 - 40 degrees c (50 - 104 degrees f) – recommended: 20 - 25 degrees c (68 - 77 degrees f) – non-operating: -40 - 70 degrees ...

  • Page 361

    Appendix b. Operating environment 341 maximum wet bulb: 28 degrees c maximum altitude: 3050 m (10,000 ft.) wet bulb (caloric value): 1,724 btu/hr (fully loaded shelf) maximum electrical power: 100 - 240vac, 12-5.9 a nominal electrical power: – 100 - 120vac, 3.6 a; – 200 - 240vac 1.9 a, 50/60 hz nois...

  • Page 362

    342 ibm system storage n series hardware guide.

  • Page 363: Related Publications

    © copyright ibm corp. 2012, 2014. All rights reserved. 343 related publications the publications that are listed in this section are considered particularly suitable for a more detailed discussion of the topics that are covered in this book. Bm redbooks the following ibm redbooks publications provid...

  • Page 364: Other Publications

    344 ibm system storage n series hardware guide other publications the following publications are also relevant as further information sources: network-attached storage: http://www.Ibm.Com/systems/storage/network/ ibm support: documentation: http://www.Ibm.Com/support/entry/portal/documentation ibm s...

  • Page 365: Ibm System Storage N Series

    (0.5” spine) 0. 475”0.87 3 ” 250 459 pages ibm system storage n series hardware guide ibm system storage n series hardware guide ibm system storage n series hardware guide ibm system storage n series hardware guide.

  • Page 366: Ibm System Storage N Series

    Ibm system storage n series hardware guide ibm system storage n series hardware guide.

  • Page 368: Ibm System Storage

    ® sg24-7840-03 isbn 0738439401 international technical support organization building technical information based on practical experience ibm redbooks are developed by the ibm international technical support organization. Experts from ibm, customers and partners from around the world create timely te...