Hitachi Lighting 9900 Series Architecture Manual

Hitachi lightening system architecture guide
Hide thumbs Also See for Lighting 9900 Series:
Table of Contents

Quick Links

Table of Contents
loading

Summary of Contents for Hitachi Lighting 9900 Series

  • Page 3 Hitachi Data Systems...
  • Page 4: Table Of Contents

    Bandwidth of Supported Host Interfaces ...14 Number of Host Interfaces Supported ...14 Types of Hosts Supported by Direct Fibre Channel Host Attachment by the Lightning 9900 Series...14 Chapter 4 – Hi-Star Architecture – An Internal Switched Hierarchial Star Network The Internal Hi-Star Architecture ...15 The Cache Hierarchical Star Network ...15...
  • Page 5 Unmatched Competitive Advantage in RAID Choices ...29 Chapter 8 – Performance Considerations __________________________________________________31 Truly Scalable Performance ...31 The Advantages of the Lightning 9900 Series Hi-Star Architecture Over a Shared Bus Architecture ...31 Internal Switching Overcomes the Limitations of Shared Bus Architectures ...32 Test Results ...32...
  • Page 6 Chapter 9 – The Lightning 9900 Series Software Solutions Are the Best in the World ______________33 Increased IT service levels in availability and performance through Business Continuity Planning (BCP) software and services...34 Remote Copy, Data Duplication, Data Migration Defined ...35 Remote Copy ...35...
  • Page 7 Continuous Availability Service ...47 On-line Data Migration Service ...47 SAN Services ...47 Hitachi Data Systems Interoperability Laboratory Service ...48 Enterprise storage and availability management services ...48 Software Portfolio Review and Analysis Service ...48 Appendix A – System Configurations for the Performance Experiment __________________________49...
  • Page 8: Table Of Figures

    Figure 14 A shared-bus architecture is limited to two simultaneous I/O operations..17 Figure 15 The Lightning 9900 Series Hi-Star architecture allows for 16 parallel I/Os to cache through four interconnecting cache switches...17 Figure 16 Separate redundant control memory handles the exchange of control information between processors and cache memory about the status, location, and configuration of data.
  • Page 9 System Capacities and Number of disk drives for various configurations..23 Table 4 Summary of Hitachi Freedom Storage software products and the business objectives they serve..33 Table 5 Hitachi copy products provide Remote Copy, Data Duplication and Data Migration..36 viii...
  • Page 10: Chapter 1 - Introduction

    ® S/390 mainframe network and system management tools in addition to Freedom Storage management software. ™ Hitachi offers optional robust dial-in capability that provides world class experts to diagnose problems if they occur. Lightning 9900 ™ Series Product Offerings The Lightning 9900 Series is offered in two models –...
  • Page 11: An Overview Of The Hitachi Lightning 9900 Series Architecture

    9910 provides for managed growth and open system exploitation. An Overview of the Hitachi Lightning 9900 The most powerful storage system in the storage system in the industry today. The new architecture used in the Lightning 9900 Series is specifically designed for the brutal I/O demands of open systems environments.
  • Page 12: Figure 2 The Hitachi Lightning 9960 Series' Hi-Star Internal Switched-Fabric Architecture

    Series’ enormous capacity for throughput lies ™ Series are the Array Control ™ ™ Introduction Figure 2 – The Hitachi Lightning 9960 Hi-Star ™ internal switched-fabric architecture. network by ™...
  • Page 13: Comparison To The Shared Bus Architecture Of The Hitachi Freedom Storage 7700E

    • High-availability, custom designed disk drives. Some competitive products do not have dual cache like the Hitachi Lightning 9900 is an unrecoverable error in cache, there is no duplicate backup copy. With these products there is an increased risk of lost data, especially if the loss occurs in the hardware status area.
  • Page 14: Other Information Sources Available From Hitachi Data Systems

    EMC and IBM and drills down into specifics. Since storage today is more than just hardware and software, additional information will be available in a third report titled the Hitachi Enterprise Solutions Guide. This report contains information and on the world-class services and solutions available from...
  • Page 15 Hitachi Data Systems...
  • Page 16: Chapter 2 - The Lightning 9900 Series Packaging

    The Lightning 9900 Series Packaging Model 9960 Packaging The Lightning 9960 is available in a two to seven cabinet configuration (as shown on ™ the cover of this guide), depending on connectivity and capacity needs. A Control Frame serves as the control center of each system and manages up to six Array Frames that are connected via high speed Fibre Channel links.
  • Page 17: Model 9960 Array Frames

    Hitachi Data Systems Model 9960 Array Frames and communication interfaces to the Control Frame. Array frames 5-6 contain up to 64 drives for a total of 512 drives for a maximum configured system. An Array Frame is shown in Figure 5.
  • Page 18: Model 9910 Packaging

    Frame of a Lightning 9960. The back end contains four HDD arrays housing up to 48 disks in a 70.5 inch high, 27.6 inch wide, and 31.5 inch deep footprint. This is shown in Figure 7. The Lightning 9900 Series Packaging Series models to connect ™...
  • Page 19: The System Monitoring Network Of The Lightning 9900 Series

    Service Processor (SVP) or remotely by the Hitachi Resource Manager 9000 private LAN on a UNIX via SNMP or S/390 SIMs. System status and alerts are also sent to Hitachi Data Systems Customer Support Centers via the Hi-Track The Lightning 9900 Series systems are designed with a system-monitoring network.
  • Page 20: Chapter 3 - Front-End Design Of The Hitachi Lightning 9900 Series

    Front-end Design of the Hitachi Lightning 9900 Series CHIPs Support Fibre Channel Host and ESCON and Scalability The Lightning 9900 Series supports both Fibre Channel for open systems and ™ ESCON ® or FICON for S/390 ® compatible platforms as shown in Figure 8.
  • Page 21: About The Fibre Channel Interface Boards

    Hitachi Data Systems About the Fibre Channel Interface Boards Processors Figure 9 – A Fibre Channel host adapter board and its major hardware components. Each Fibre Channel Interface Board, as shown in Figure 9, has four Interface for management of connectivity to the host.
  • Page 22: Figure 10 An Escon Host Adaper Board And Its Major Hardware Components

    This is shown in Figure 12. Front-end Design of the Hitachi Lightning 9900 Series Figure 10 – An ESCON host adapter board and its major hardware components.
  • Page 23: Bandwidth Of Supported Host Interfaces

    Hitachi Data Systems Figure 11 – A 9960 system connected to Mainframes and Open Systems hosts. Bandwidth of Supported Host Interfaces Table 2. Table 2 – Bandwidth of supported interfaces of the Lightning 9900 ™ Series. Number of Host Interfaces Supported to 24 on the 9910.
  • Page 24: Chapter 4 - Hi-Star Architecture - An Internal Switched Hierarchial Star Network

    Hi-Star Architecture – An Internal Switched Hierarchical Star Network The Internal Hi-Star Architecture The internal Hi-Star architecture consists of two separate networks, the Cache Hierarchical Star Network (C-HSN) and the Control Memory Hierarchical Star Network (CM-HSN). The Cache Hierarchical Star Network The C-HSN is the network used for transferring data to and from the main global data cache.
  • Page 25: The Cache Switch Provides Non-Blocking Switched Access To Cache

    Hitachi Data Systems The Cache Switch Provides Non-blocking Switched Access to Cache The CSW is at the heart (in the 9960) form the internal start using parallel switch fabric bus (PSFB) of the C-HSN. of the Lightning 9900 ™ The CSW is a specially designed crossbar switch that functions as a combination MUX, Series.
  • Page 26: Figure 14 A Shared-Bus Architecture Is Limited To Two Simultaneous I/O Operations

    In a shared bus storage system, the number of internal simultaneous processor operations that can occur is equal to the number of buses on the backplane. The shared buses are used by all host channels to communicate between the processors on the host adapters and cache memory.
  • Page 27: The 9960 Provides 32Gb Of Fully Addressable Cache

    A portion of cache real time. Read and write functions are then performed at cache speeds, with no disk memory can be allocated latency delay. With Hitachi FlashAccess to specific data. specific data. Administrators can add, delete, or change FlashAccess time, quickly and easily.
  • Page 28: Figure 16 Separate Redundant Control Memory Handles The Exchange Of Control Information Between Processors And Cache Memory About The Status, Location, And Configuration Of Data

    control memory in its “split” configuration. Again, control memory is mirrored. This path topology is used to facilitate this mirrored architecture. Either way the bandwidth is calculated in the CM-HSM, the bandwidth is 3.2GB/sec total when all of the processor modules are installed. 4 bits clocked at 100MHz equals 50MB/sec per path multiplied by 64 ports is 3.2GB/sec bandwidth.
  • Page 29 Hitachi Data Systems...
  • Page 30: Chapter 5 - High Performance Back-End Design

    DRR circuit. (See also Figure 2). Basically, the number of processors and DRR circuits in the back end of the Lightning 9900 Series has increased to 32 (for the Lightning 9960 compared to the 7700E’s 16. The diagram of a Lightning 9900 in Figure 17 and Figure 18.
  • Page 31: Maximum Configuration Of Acps And Disks

    Hitachi Data Systems technology built into the ACP pair, allow the back end of the Lightning 9900 use all eight FC-AL paths in an ACP pair for both performance and fault tolerance. However, no one disk or array group can use both paths simultaneously. The ACPs monitor the activity and the utilization of the paths.
  • Page 32: Chapter 6 - Capacities And Raid Architecture

    Non-volatile RAM on each controller accelerates RAID functions, particularly disk writes. RAID-1+ With the announcement of the Lightning 9900 Series RAID-1+ was introduced. RAID-1+ is a 2 Data + 2 Data disk arrangement (four disks total) in a RAID-1+0 configuration with a twist – a rotating copy.
  • Page 33: High-Density Disk Drive Assemblies (Hdds)

    RAID-5 arrays. High-density Disk Drive Assemblies (HDDs) Each drive has the high availability and performance by Hitachi Limited. Each drive has the industry unique industry unique feature feature of supporting dual active ports. This provides significantly increased performance. of supporting dual active ports.
  • Page 34: Chapter 7 - Hitachi High-Availability Software Improves Application Service Levels

    5,000/(5,000 + 2) = 99.96%. This would correspond to a Level 3 rating using the Scale of 9s. Software products contribute to High-Availability Computing Many factors can cause unplanned downtime. The Hitachi Freedom Storage ™ Lightning 9900...
  • Page 35: Open Systems High-Availability Middleware Support

    Open systems server vendors and third-party software vendors such as VERITAS Some competitive products do not have dual cache like the Hitachi Lightning 9900 is an unrecoverable error in cache, there is no duplicate backup copy. With these products there is an increased risk of lost data, especially if the loss occurs in the hardware status area.
  • Page 36: Alternate Pathing Middleware Switches The I/O Load In The Event Of Path Failure

    2 . Hitachi Dynamic Link Manager balancing Hitachi Dynamic Link Manager software utilities that are server-based as shown in Figure 22. Hitachi Dynamic Link Manager ™ enhances the availability of RAID systems by providing automatic error recovery and path failover from server-to-RAID connection failures.
  • Page 37: Parallel Database Clustering

    Hitachi Data Systems Figure 22 - Hitachi Dynamic Link Manager ™ automatically provides path failover and load balancing for open systems. Clustering middleware supports distributed lock management. Standard Hot-swap and Redundant Power Supplies uninterrupted power and cooling to all chassis in the system – supporting full system power in the event of a power supply failure.
  • Page 38: Standard Redundant Fans For Cooling

    Lightning 9900 Series system. For example, a single Lightning 9900 ™ can configure both RAID-1+ and RAID-5. Hitachi High Availability Software Improves Application Service Levels Series RAID protection for disk drives is ™ Series system ™...
  • Page 39 Hitachi Data Systems...
  • Page 40: Chapter 8 - Performance Considerations

    Performance Considerations Truly Scalable Performance Based on the internal switched-fabric Hi-Star shows unmatched performance scalability. The more capacity and connectivity added to the 9960, the more total bandwidth increases. As stated previously, the 6.4GB/sec internal bandwidth is reached when all 16 modules are installed and functioning. When new application workloads are added to a 9960 system with an existing workload, neither the new nor the existing workloads will suffer performance degradations from the sharing of internal resources and bandwidth.
  • Page 41: Internal Switching Overcomes The Limitations Of Shared Bus Architectures

    Hitachi Data Systems Internal Switching Overcomes the Limitations of Shared Bus Architectures Bottleneck-free the shared bus architecture of the 7700E system. This occurs at Point 1, when the DSS performance with the application begins at about 45 minutes into the test. It depicts the effect that the DSS Lightning 9900 ™...
  • Page 42: Chapter 9 - The Lightning 9900 Series Software Solutions Are The Best In The World

    Software Solutions Are the Best in the World Customers and analysts regard the Hitachi Freedom Storage Lightning 9900 the most advanced products in the enterprise storage system market. The Software Solutions Guide discusses the advantages of this suite of leading-edge software products that enhances the Lightning 9900 Series product lines.
  • Page 43: Increased It Service Levels In Availability And Performance Through Business Continuity Planning (Bcp) Software And Services

    Hitachi Data Systems support an enterprise’s strategic goal of accessing any information, on any computer, located anywhere, at any time. The many advanced functions available on Lightning 9900 Series hardware are initiated, managed, and controlled through these powerful software programs.
  • Page 44: Remote Copy, Data Duplication, Data Migration Defined

    To this already robust platform, Hitachi Data Systems adds a number of solutions to ensure quick recovery from acts of nature, human errors, application errors, and malicious attacks. In the world of e-commerce, it is no longer enough to have a backup copy of one’s data;...
  • Page 45: Business Goals Served By Hitachi Copy Software

    2) to rapidly deploy new IT and warehousing. applications for business intelligence, data warehousing/OLAP, for data center relocation, or for new application testing. Table 5 - Hitachi copy products provide Remote Copy, Data Duplication, and Data Migration.
  • Page 46: Chapter 10 - Centralized And Open Systems Management Software Simplifies It Operations

    Customers have the freedom to choose the precise solution–or combination of solutions–appropriate for their environment. HiCommand ™ allows systems management of Hitachi storage and software through the enterprise’s vendor of choice Hitachi Data Systems software and hardware solutions are managed through the ®...
  • Page 47: Figure 25 Hicommand Allows Management Of Virtually All Hitachi Hardware And Software From The Customer's Platform Of Choice

    Both Hitachi and their software alliance partners believe this open architecture will best benefit customers by allowing them to manage their Hitachi storage through the enterprise’s vendor of choice. HiCommand is an important Hitachi management tool in that it provides a ™...
  • Page 48: The Components Of Hicommand

    The complexities of heterogeneous computing environments make storage management a daunting task. Hitachi Data Systems offers the ideal solution to this difficult challenge, Hitachi Resource Manager management offering brings together Hitachi Graph-Track...
  • Page 49: Hitachi Resource Manager 9000

    ™ 9000 The following is a summary list of the many ways in which the Hitachi Resource can simplify IT operations, improve availability and performance service levels ™ Service Level Management •...
  • Page 50: Hitachi Lun Manager Simplifies Configuration Management And Reduces Staffing Costs

    LUNs, the reconfiguration of LUN-to-port assignments, or the viewing of the Lightning 9900 Hitachi LUN Manager can assign multiple paths to a single LUN, support of alternate path failover, path load balancing, and clustered systems is possible. Running on a standard Windows ®...
  • Page 51: Hitachi Virtual Logical Volume Image Manager Allows Very Large To Very Small Virtual Volume Configuration

    With Hitachi FlashAccess performance. can be allocated to specific data. Users can add, delete, or change Hitachi FlashAccess managed data at any time quickly and easily. (LUN) for open systems, cache data can be as small as a single track or as large as an entire volume.
  • Page 52: Storage Maximizer

    Storage administrators can “fill it up and max it out,” confident that they can meet performance requirements all the way to 88+ TB raw capacity on a Lightning 9900 using 180 GB drives. Hitachi CruiseControl ™ eliminates “hot spots,” thereby automating performance to service level objectives, while...
  • Page 53 Hitachi Data Systems...
  • Page 54: Chapter 11 - Professional Services And Support

    This service can help identify the cost, benefit, and ROI in the enterprise’s computing infrastructure to reduce outage windows and the impact of an outage. Hitachi findings and recommendations will be in accordance with the enterprise’s business drivers and in clear terms that IT executives can take to their executive team.
  • Page 55: Data Protection Services Lab

    After a clear understanding of requirements, a detailed professional services proposal is presented and reviewed with the enterprise. Hitachi Data Systems uses “best of breed” consulting techniques and has an excellent reference list of satisfied clients that may be contacted prior to beginning of the engagement.
  • Page 56: Continuous Availability Service

    Recommendations are then discussed to improve availability and reduce the risk of data loss. On-line Data Migration Service The Hitachi Data Migration Service helps migrate data from existing systems to newly installed systems while minimizing the impact on mission-critical applications. Hitachi Data Migration Service features a four-phase approach that includes assessment, planning, migration, and post-migration support.
  • Page 57: Hitachi Data Systems Interoperability Laboratory Service

    Laboratory Service not be limited to the use of these proven interoperable SAN elements. To assure that a wide provides clients with the variety of components will operate effectively in Hitachi Data Systems knowledge of pre-tested Hitachi Data Systems components of a SAN.
  • Page 58: Appendix A - System Configurations For The Performance Experiment

    The only resource shared by the application is the storage controller (cache, paths, etc.), and two ACP pairs (there are four ACP pairs total). The comparison is between the Hitachi Freedom Storage architectures, and the Lightning 9960 system, representing a switched fabric architecture.
  • Page 59 Hitachi Data Systems differences between the 7700E and the Lightning 9960 workload; • The 7700E used all 6GB drives. • The Lightning 9960 system used a mix of 18GB and 47GB drives. ™ system for the DSS ™...
  • Page 60: Glossary Of Terms

    Glossary of Terms 10BaseT Ethernet with a data transfer rate of 10Mbits/sec. 100BaseT Also known as Fast Ethernet with a data transfer rate of 100Mbits/sec. Array Group. Array Control Processor. The group of processors on a PCB that performs the physical access of the disk drives across four FC-AL loops.
  • Page 61 Hitachi Data Systems Availability Back end Business Continuity Planning (BCP) Business Impact Analysis (BIA) Business Interruption communication is an exactly timed stream of bits when the start of a character is located by using a clocking mechanism such as bipolar encoding. See also Synchronous, Hitachi TrueCopy ™...
  • Page 62 CARB Cache memory Arbitrator circuit. Hitachi designed logical circuit in the Cache Switch (CSW) used to arbitrate access to cache. Cache Cache (pronounced cash) can be either on-chip memory circuits in a microprocessor (e.g. L2 processor cache), a reserved section of main memory (e.g. system or server cache), or an independent, high-speed disk storage device (e.g.
  • Page 63 CORA is a unique, software-based risk management system developed initially for the insurance industry by International Security Technology (IST) Inc. of New York City. In an alliance with IST, Hitachi Data Systems (Business Continuity Planning) industry as a professional service. See also Business Continuity Planning.
  • Page 64 Disk Director. Data Duplication Software that duplicates data as in remote copy or Point-in-Time (PiT) snapshots. Data duplication is differentiated from data migration in that with data duplication at the end of the process there are two copies of data and with data migration there is only one.
  • Page 65 Hitachi Data Systems EBCDIC Electronic vaulting ESA/390 ESCON ESCON Director Ethernet Fabric Abbreviation of Extended Binary-Coded Decimal Interchange Code. Pronounced eb-sih-dik, EBCDIC is an IBM code for representing characters as numbers. ® Although it is widely used on large IBM PCs and Macintoshes ®...
  • Page 66 ™ technology and offers organizations the freedom of choice in deploying data-access and data-sharing capabilities across the enterprise through Hitachi Data System implementation of Storage Area Networks (SANs). With FDN, customers gain a powerful new tool that enables the consolidation of servers and storage, increased data availability, centralized storage management, and the ability to back up and migrate data without affecting the performance of enterprise networks.
  • Page 67 Enterprise Resource Planning (ERP) applications are optional. Client support is available for Windows platforms. High-speed data transfer is also available using Hitachi RapidXchange other channel-based technologies. This software utility provides automatic, reliable, and secure data transfer between...
  • Page 68 ™ FlashAccess ™ is a Hitachi feature that allows specified (usually high access) data sets to be “pegged” or permanently placed in cache memory so they are not managed by the data movement algorithms of the Freedom Storage feature in the Lightning 9900 ™...
  • Page 69 See also ShadowImage Hitachi LUN Manager is a software utility in the Resource Manager 9000 allows for complete systems management of LUNs. See also LUN and Resource Manager ™...
  • Page 70 Hitachi TrueCopy Hitachi TrueCopy provides synchronous or asynchronous remote copy capability for open system and S/390 computers. This allows remote copies over virtually unlimited distances. Operating systems that are supported include MVS, HP/UX, AIX, Sun Solaris ™...
  • Page 71 Hitachi Data Systems HXRC (Hitachi Extended Remote Copy) HYPERtape Java Journaling Hierarchical Star Network. The technical term used to describe the combined internal networks (the C–HSN and the CM–HSN) of the Lightning 9900 A common connection point for devices in a Fibre Channel network. A hub contains multiple ports.
  • Page 72 Lightning 9900 Series ™ The Lightning 9900 Series was announced in June 2000 (Lightning 9960 ™ November (Lightning 9910 ). It represents a major advance in enterprise-class storage ™ systems with its Hierarchical Star Network switched internal architecture, which provides for many times more simultaneous transfers to and from the host compared to shared bus architectures.
  • Page 73 Hitachi Data Systems MBCP MIPS Meta-data Mirrored pair Mirroring MPLF Master Business Continuity Professional. The highest level of professional certification of the Disaster Recovery Institute (DRI). The master level targets an individual with a minimum of five years of experience as a business continuity/disaster recovery planner.
  • Page 74 See MTBF. NanoCopy NanoCopy is a feature of the Hitachi Lightning 9900 ™ time-consistent snapshots to be taken without stopping applications to flush in-flight data to disk. Since there is no system impact in taking a NanoCopy snapshots can be made more frequently for faster recovery in the event of a failure.
  • Page 75 Hitachi Data Systems On-line system Open system Operating System Out of band Parity Port/Port ID An interactive computer system supporting users over a network of computer terminals. A system whose characteristics comply with standards made available throughout the industry, and therefore can be connected to other systems that comply with the same standards.
  • Page 76 RAID Controllers RAID controllers provide a highly optimized scheme for securely managing RAID configurations on storage systems. Hitachi RAID controllers allow RAID arrays to be expanded online, and support conversion of an array from one RAID level to another. Recovery Time The period from the disaster declaration to the recovery of the critical functions.
  • Page 77 Hitachi Data Systems SCSI Snapshot SNMP Solaris SPARC Stripe SWAN Switch Small Computer System Interface. An intelligent bus-level interface that defines a standard I/O bus and a set of high-level I/O commands. There are currently many flavors of SCSI defined by different bus widths and clock speeds. The seven major variations of SCSI are SCSI 1, SCSI 2 (Fast/Narrow), SCSI 2 (Fast/Wide), Ultra SCSI (Fast/Narrow), Ultra SCSI (Fast/Wide) –...
  • Page 78 Synchronous Synchronous communications occurs when the transmission of data between two devices is synchronized with a clocking scheme or other technique. The sender and receiver need to synchronize with one another before data is sent. In synchronous communication the bit stream and the clock pulse are synchronized by a special bit transition pattern in the digital signal creating an exactly timed stream of bits from the sending device to the receiving device.
  • Page 79 I/O workload refers to the pattern of I/Os presented to the Lightning 9900 system or to a disk drive. Extended Remote Copy. IBM’s implementation of a software asynchronous Remote Copy technique that preserves data integrity. See also HXRC and Hitachi TrueCopy. Series ™...
  • Page 80 U.S.A. (408) 970-1000 [email protected] Hitachi Data Systems is registered with the U.S. Patent and Trademark Office as a trademark and service mark of Hitachi, Ltd. The Hitachi Data Systems logotype is a trademark and service mark of Hitachi, Ltd. Hi-Star, Freedom Storage, Lightning 9900, FlashAccess, NanoCopy, Graph-Track,...

This manual is also suitable for:

9960

Table of Contents