Shared Storage Pool

Common Tagung VIOS, 9. Mai 2012

Virtual I/O Server Shared Storage Pools (Phase 2) René Akeret IBM Switzerland

© 2012 IBM Corporation

Agenda

1

PowerVM Editions

2

Cluster Aware AIX (CAA)

3

Shared Storage Pools (SSP)

4

Summary

Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation

PowerVM Editions PowerVM Editions Concurrent VMs

Express

Standard

Enterprise

2 per server

10 per core (up to 1000)

10 per core (up to 1000)

Virtual I/O Server NPIV Suspend/Resume Shared Processor Pools Live Partition Mobility Active Memory Sharing Shared Storage Pools (Phase 2) Active Memory De-duplication** Network Balancing Live Partition Mobility Performance Improvements ** Requires POWER7 System with eFW7.4

Q4 2011 Features Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation

New PowerVM Features 4Q 2011 Feature

Function

Benefit

Shared Storage Pools

Creates pools of storage that can be used by virtualized workloads. This facility enables key functions like linked clones, snapshot / rollback and storage mobility.

Improves storage utilization, reduces storage infrastructure costs, decreases time to provision new VMs and reduces administration costs.

Active Memory De-duplication

Detects and removes duplicate memory pages in Active Memory Sharing configurations.

Optimizes physical memory usage for LPARs in Active Memory Sharing configurations. Allows more partitions to fit on a system if memory is constrained.

Network Balancing

Network traffic is balanced across multiple shared Ethernet adapters in HA environments

Improved utilization of shared Ethernet adapters in HA environments and better performance.

Live Partition Mobility Performance Improvements

Improvements in network components and this doubles the number of data movers from 8 to 16.

Allows Live Partition Mobility to operate faster which enables quicker system evacuation for maintenance activities. Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation

New features requiring FW 7.4 Firmware 7.4 Is required for new selected Power enhancements Is available only new on MTM… 710 / 730: E1C & E2C 720 / 740: E4C & E6C 770 / 780: MMC & MHC No FW 7.4 support for older Power Systems

Product Feature

Express

Standard

Enterprise

Requires EFW 7.4

PowerVM: Active Memory De-duplication PowerSC: Trusted Boot

-Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation

PowerSC Editions PowerSC Express

PowerSC Editions

Express

Standard

Basic compliance for AIX Security and Compliance Automation

PowerSC Standard Security and compliance for virtual & cloud environments

Trusted Logging Trusted Boot** Trusted Network Connect and Patch Management ** Requires POWER7 System with eFW7.4


Agenda

1

PowerVM Editions

2


3


4

Summary


Cluster Aware AIX (CAA) Exploiters IBM Director

DB2

TSA

RSCT Consumers IBM Storage

HMC

Legacy RSCT

PowerHA System Mirror

HPC

RSCT With Cluster Aware AIX

Bundled Resource Managers Group Services

VIOS

Resource Mgr Services

Messaging API

Monitoring API

Cluster Admin UI

Cluster Messaging

Cluster Monitoring

Cluster CFG Repository

Bundled Resource Managers Group Services Messaging API

Resource Mgr Services Monitoring API

Cluster Admin UI

Cluster Layers Integrated Cluster to CAA Cluster CFG Redesigned Capabilities Messaging

Monitoring

Repository

Cluster Aware AIX CAA APIs and UIs

Legacy AIX Cluster Repository

Cluster Monitoring

Cluster Messaging

Cluster Events

RSCT and Cluster Aware AIX together provide the foundation of strategic Power Systems SW RSCT integration with CAA extends simplified cluster management along with optimized and robust cluster monitoring, failure detection, and recovery to RSCT exploiters on Power / AIX


Agenda

1

PowerVM Editions

2


3


4

Summary


VIOS Storage Options Shared Storage Pool

Whole local Disk & SAN LUN

SAN LUN

Logical Volume from VG Pool

LPAR

LPAR

LPAR

NPIV LUN

LPAR

VIOS

File backed from a file system

Power HyperVisor

vSCSI NPIV over vFC


Extending Integrated Storage Virtualization Beyond a Single System

PowerVM

PowerVM with Shared Storage Pools

VIOS

LPAR

LPAR

LPAR

Power HyperVisor

VIOS

LPAR

LPAR

LPAR

Predominant PowerVM usage model today

LPAR

SAN

VIOS

Storage Pool

Power HyperVisor

LPAR

Storage Pool

LPAR

Storage Pool

LPAR

Power HyperVisor

LPAR

Power HyperVisor

VIOS

LPAR

LPAR

LPAR

LPAR

VIOS

LPAR

LPAR

LPAR

LPAR

VIOS

VIOS

LPAR

LPAR

LPAR

VIOS

Power HyperVisor

Power HyperVisor

Shared Storage Pool

SAN

High value extension of today’s model Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation

VIOS Shared Storage Pool Clustering Model Ethernet

VIOS nodes are joined together to form a cluster

LPAR

LPAR

Power HyperVisor

Shared Storage Pool

SAN

Non managers communicate meta-data access and update via the ethernet Cluster-wide concurrent access to namespace and data available from any node

LPAR

LPAR

Power HyperVisor

VIOS

VIOS

LPAR

LPAR

Power HyperVisor

LPAR

VIOS

LPAR

LPAR

LPAR

One or more VIOS nodes are meta-data managers for sub-units of each storage pool

LPAR

All VIOS nodes are eligible to read and write user data via the SAN

VIOS

All VIOS nodes see all disks for storage pools they access

LUN

LUN

LUN

Based on Cluster Aware AIX (CAA), SF-Store and RSCT functions Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation

VIOS Shared Storage Pool Motivation Simplify the aggregation of large numbers of disks Better utilize on a percentage basis the available storage

/pool1/vdev1:

/pool1/vdev2:

Simplify administration

A set of one or more disks managed as a block of storage that multiple file systems can reside within Managed as one entity with disks entering, leaving, and being managed thru a simplified set of commands File systems share this common storage pool unit Better storage utilization than the traditional dedicated storage that a (perhaps improperly sized) file system would necessitate Notion of a “file system quota” (follow-on)

Shared Storage Pool

Addressable on the VIOS thru a directory namespace rooted at /


Thin or Thick Provisioning Motivation Storage utilization LPAR

LPAR

LPAR

LPAR

VIOS

A Client vSCSI device can be presented as a thinly or thickly partitioned device

Power HyperVisor

Thin provisioned device May present a much larger image than the current actual physical use Not fully backed by physical storage if the blocks are not in actual use

Thin

Thick

Storage Pool

Thick provisioned device Fully backed by physical storage no matter what the actual usage Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation

Snapshots on VM disks and Cloning

Persistently saved snapshot of a point in time, rollback to prior snapshot

LPAR #1

LPAR #2

Consistency group snapshots Sub-second creation No practical limit on the number of snapshots that can be persisted

Block virtualization /pool1/vdev1.0

/pool1/vdev1.1

/pool1/vdev1.2

Basis for: Capture / deploy Disaster Recovery Consolidated Backup / Restore

VIOS Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation

Live Storage Mobility Storage Mobility is a new function that allows data to be moved to new storage devices within Shared Storage Pools. Virtual machines remain completely active and available. This ability to move data to new devices can improve performance and allow for the retirement of old storage devices without incurring any application outages. Examples: Move I/O to newly acquired disk subsystem More evenly spread I/O load across devices Move the data to a different location (remote site) Remove data from retiring subsystem Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation

Live Storage Mobility (Replace Disk)

Ugly “other” vendor

Neat IBM

Fibre Channel

LPAR

LPAR

LPAR

vSCSI

LPAR

Power HyperVisor

VIOS

LPAR

LPAR

LPAR

LPAR

vSCSI

VIOS

LPAR

LPAR

LPAR

LPAR

VIOS

Power HyperVisor

Power HyperVisor

vSCSI


Live Storage Mobility (Disk Space Move)* Storage Pool A

Storage Pool B Mirror Blocks

Move Blocks

Fibre Channel

LPAR

LPAR

LPAR

vSCSI

LPAR

Power HyperVisor

VIOS

LPAR

LPAR

LPAR

*Not on Phase 2

LPAR

vSCSI

VIOS

LPAR

LPAR

LPAR

LPAR

VIOS

Power HyperVisor

Power HyperVisor

vSCSI


Shared Storage Pool Requirements Platforms: POWER6 & POWER7 only (includes Power Blades) VIOS Storage Pool (minimums): Direct fibre-channel attached LUNs: 1 for repository ~10 GB 1 or more for data, 10 GB in practice lots more [like 1TB+]

Pool Storage Redundancy: Repository & pool storage must be RAIDed VIOS name resolution to resolve hostnames Virtual I/O Server(s): Minimum CPU: 1 (shared, uncapped is good) Minimum Memory: 4 GB

Read the Release Notes http://www-01.ibm.com/support/docview.wss?rs=0&uid=isg400000876


Shared Storage Pool Limits (Phase 2) Max nodes:

4 VIOS nodes

Max physical disks in a pool:

256

Max virtual disks (LUs) in a cluster:

1024

Number of Client LPARs per VIOS (that is, 40 clients per VIOS, or 40 clients per VIOS pair)

1 to 40

Storage Pool

40

40

Storage Pool

40

40

40

10GB to 128TB

Capacity of each Virtual Disk (LU) in Pool

1GB to 4TB

Number of Repository Disks

1 to 1 (CAA limit)

LPAR

Storage Capacity of Storage Pool (total)

VIOS

5GB to 4TB

VIOS

LPAR

VIOS

VIOS

LPAR

VIOS

LPAR

VIOS

LPAR

VIOS

LPAR

VIOS

Capacity of Physical Disks in Pool (each)

40


Shared Storage Pools Dedicated Virtual Device

Shared Pool Virtual Devices

Dedicated Virtual Device

Power HyperVisor

Power HyperVisor

VIOS

VIOS block virtualization

/bar/l1:

/foo/f1:

block virtualization

/bar/f2:

SFStore Meta-Data

/foo/f3:

/bar/f4:

/bar/l2:

Store Shared Pool Dedicated LUN **

Dedicated LUN **

Store Storage Pool Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation

**Not currently supported

User Interface Command line Some feature will remain command line only

like: cluster –create

cfgassist This is the VIOS version of smitty Menu driven interface for CLI Fully covers SSP functions

Graphical User Interface HMC (V7 R7.4)

System Director - Future release Already has Storage Pools concept and features Shared Storage Pool is just another storage pool type Then may adds new unique items – like VMControl appliance deploy to SSP disk space or cloning Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation

Agenda

1

PowerVM Editions

2


3


4

Summary


Shared Storage Pools transforming the datacenter

Dynamic Flexibility All operations online

Improved utilization Thin Provisioning Greater utilization percentage

LifeCycle Management (first time power is applied to the server’s retirement) Image Management: capture, deploy Agility (linked-clones)

Provisioning time Location transparency Availability Backup / Restore & Disaster Recovery Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation

Technical Information Announcement letter http://www-01.ibm.com/common/ssi/cgi-bin/ssialias?infotype=AN&subtype= CA&htmlfid=897/ENUS211-354&appname=USN

Release notes http://www-01.ibm.com/support/docview.wss?rs=0&uid=isg400000876

VIOS 2.2 User Guide http://publib.boulder.ibm.com/infocenter/powersys/v3r1m5/topic/p7hb1/ p7hb1.pdf

Technical Hands-On Movies http://tinyurl.com/AIXmovies Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation

René Akeret IBM Switzerland [email protected] Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation

Cluster Aware AIX (CAA) – What is it? A set of services/tools embedded in AIX to help manage a cluster of AIX nodes and/or help run cluster software on AIX IBM cluster products (including RSCT, PowerHA, and the VIOS) will use and/or call CAA services/tools. CAA services can assist in the management and monitoring of an arbitrary set of nodes and/or running a third-party cluster.

CAA does not form a cluster by itself. It is a tool set. There is no notion of quorum. (If 20 nodes of a 21 node cluster are down, CAA still runs on the remaining node). CAA does not eject nodes from a cluster. CAA provides tools to fence a node but never fences a node and will continue to run on a fenced node.


Cluster Aware AIX (CAA) and RSCT


Shared Storage Pools (SSP) SSP is a server based storage virtualizer that is clustered across multiple Power servers It’s an extension of PowerVM’s existing storage virtualization (VIOS vSCSI) Combines existing SCSI emulation with clustering technology and a distributed data object repository Distributed data object repository is an advanced filesystem-like function developed specifically for storage virtualization

SSP provides the same standard vSCSI Target interface to client host VIOS 2.2.1.0


Why Shared Storage Pools? Fibre-Channel LUN & NPIV is complex SAN switch, SAN disk subsystem = hard work & weird GUI !! Typical LUN lead time: 4 minutes, 4 hours, 4 days, 4 weeks? With rapidly changing needs with mandatory responsiveness it is simply not good enough! Many smaller computer rooms have no dedicated SAN guy LPM hard work as most people don’t pre-Zone the target so have to Zone before the move = complexity, slow, error prone LPM = zero outage for Hardware & Firmware upgrades

Shared Storage Pool Allocate LUNs to the Virtual I/O Servers once One VIOS command to allocate space to a VM Or use: cfgassist (VIOS’s smitty) Or use: HMC Virtual Storage Management GUI LPM any time you like


Shared Storage Pool Configuration (Phase 2)

Feature

Min

Max

Number of VIOS Nodes in Cluster

1

4

Number of Physical Disks in Pool

1

256

Number of Virtual Disks (LUs) Mappings in Pool

1

1204

Number of Client LPARs per VIOS node

1

40

Capacity of Physical Disks in Pool

5GB

4TB

Storage Capacity of Storage Pool

10GB

128TB

Capacity of a Virtual Disk (LU) in Pool

1GB

4TB

1

1

Number of Repository Disks


Shared Storage Pool Software Stack


IBM Systems Director offers end-to-end platform management Other Systems Management Software

Enterprise Service Management Integrated Service Management

IBM® Systems Director Editions

Configuration

Automation

Update

System x & Blade Center

Status

Remote Access

System z

Virtualization

Core Director Services

Power Systems

Discovery

Configuration

Storage Configuration

Storage Control

Additional Plug-Ins

WPAR Manager

VMControl Image Manager

Service & Support Manager

BOFM

Transition Mgr for HP SIM

Network Control

Active Energy Manager

VMControl

$$

Advanced Managers & Priced Plug-Ins

Base Systems Director Managers & Hardware Platform Managers Resource Management Managed virtual and physical environments

Hardware

IBM and non-IBM hardware
