SPARC Enterprise M8000/M9000 Servers Overview Guide Part No.
Copyright © 2007, 2010, FUJITSU LIMITED. All rights reserved. Oracle and/or its affiliates provided technical input and review on portions of this material. Oracle and/or its affiliates and Fujitsu Limited each own or control intellectual property rights relating to products and technology described in this document, and such products, technology and this document are protected by copyright laws, patents, and other intellectual property laws and international treaties.
Copyright © 2007, 2010, FUJITSU LIMITED. Tous droits réservés. Oracle et/ou ses sociétés affiliées ont fourni et vérifié des données techniques de certaines parties de ce composant. Oracle et/ou ses sociétés affiliées et Fujitsu Limited détiennent et contrôlent chacune des droits de propriété intellectuelle relatifs aux produits et technologies décrits dans ce document.
Contents Preface 1. ix System Overview 1–1 1.1 Product Overview 1.2 System Specifications 1.3 1–1 1–8 1.2.1 Environmental Specifications 1.2.2 Power Specifications 1.2.3 M8000 Server Components 1.2.4 M9000 Server Components (Base Cabinet Only) 1.2.5 M9000 Server Components (With an Expansion Cabinet) 1.2.6 Operator Panel Overview Server Components 1–11 1–12 1–13 1–15 1–17 1–18 1–21 1.3.1 CPU Module 1–21 1.3.2 CPU/Memory Board Unit 1.3.3 I/O Unit 1.3.4 FAN Unit 1.3.
XSCF Unit 1.3.10 Internal Drive Units 1–24 Component Mounting Conditions 1.5 Optional Products 1.5.2 External I/O Expansion Unit 1.5.3 M9000 Server (Expansion Cabinet) Option Software Features 2.4 1–27 CPU 2–1 2–1 Mounted Processors and CPU Operational Modes 2.1.2 Memory Subsystem 2.1.3 I/O Subsystem 2.1.4 System Bus 2.1.5 System Control 2–5 2–5 2–5 2–7 2–7 2.2.1 Features 2.2.2 Domain Hardware Requirements 2.2.3 Domain Configuration 2–7 Resource Management 2–10 2–12 2.
2.4.3 3. Serviceability About Software 3.1 3.2 3–1 Oracle Solaris OS Functions 3.1.1 Domain Management 3.1.2 PCI Hot-plug 3.2.2 XSCF Features 3–1 3–2 3–2 XSCF Firmware Function 3.2.1 Index 2–15 3–2 3–2 3.2.1.1 Command Line-based User Interface (XSCF Shell) 3.2.1.2 Browser-Based User Interface (XSCF Web) XSCF Functional Overview 3–3 3–4 3–4 3.2.2.1 System Management 3–4 3.2.2.2 Security Management 3.2.2.3 System Status Management 3.2.2.4 Error Detection and Management 3.2.
viii SPARC Enterprise M8000/M9000 Servers Overview Guide • December 2010
Preface This overview guide describes system features, system configurations, hardware functions, and software functions of the SPARC Enterprise M8000/M9000 servers from Oracle and Fujitsu. References herein to the M8000 server or M9000 server are references to the SPARC Enterprise M8000 or SPARC Enterprise M9000 server.
Book Titles Sun/Oracle Fujitsu 819-4203 C120-H014 821-3049 C120-E323 SPARC Enterprise M8000/M9000 Servers Overview Guide 819-4204 C120-E324 SPARC Enterprise M3000/M4000/M5000/M8000/M9000 Servers Important Legal and Safety Information* 821-2098 C120-E633 SPARC Enterprise M8000/M9000 Servers Safety and Compliance Guide 819-4201 C120-E326 External I/O Expansion Unit Safety and Compliance Guide SPARC Enterprise M8000/M9000 Servers Site Planning Guide SPARC Enterprise M8000/M9000 Servers Getting
Text Conventions This manual uses the following fonts and symbols to express specific types of information. Fonts/symbols Meaning Example AaBbCc123 What you type, when contrasted with on-screen computer output. This font represents the example of command input in the frame. XSCF> adduser jsmith AaBbCc123 The names of commands, files, and directories; on-screen computer output. This font represents the example of command input in the frame.
Documentation Feedback If you have any comments or requests regarding this document, go to the following web sites. ■ For Oracle users: http://docs.sun.com ■ For Fujitsu users in U.S.A., Canada, and Mexico: http://www.computers.us.fujitsu.com/www/support_servers.shtml?s upport/servers ■ For Fujitsu users in other countries, refer to this SPARC Enterprise contact: http://www.fujitsu.com/global/contact/computing/sparce_index.
CHAPTER 1 System Overview This chapter provides an overview of features, specifications, and configurations of the SPARC Enterprise M8000/M9000 servers. 1.1 ■ Section 1.1, “Product Overview” on page 1-1 ■ Section 1.2, “System Specifications” on page 1-8 ■ Section 1.3, “Server Components” on page 1-21 ■ Section 1.4, “Component Mounting Conditions” on page 1-25 ■ Section 1.5, “Optional Products” on page 1-26 ■ Section 1.
Each server consists of a cabinet containing various mounted components, a front door, rear door, and side panels as parts of the server structure. An operator panel is mounted on the front door and is always accessible. Take special care in handling and storing the dedicated key that is provided for the front door and the operator panel. FIGURE 1-1 through FIGURE 1-3 show exterior views of the servers.
M9000 Server Appearance (Base Cabinet Only) FIGURE 1-2 M9000 Server (Base Cabinet Only) RFID tag Operator panel Chapter 1 System Overview 1-3
M9000 Server Appearance (With an Expansion Cabinet) The expansion cabinet is an M9000 option connected to the M9000 (type for the base cabinet only).
M8000/M9000 servers have the following features: ■ Multicore SPARC64 VI/SPARC64 VII/SPARC64 VII+ gigahertz processors These processors provide superior performance, due to their high scalability allowing expansion to up to 64 dual-core CPU modules, and technologies enabling high-speed arithmetic operations and data transfers. Reliability and availability are enhanced with Error Checking and Correction (ECC) data protection and instruction retry.
■ The main components, power supply units, and FAN units support active (hot) replacement/addition Component replacement and addition during system operation supported for the main components, such as a power supply unit, FAN unit, hard disk drive, system control facility (board), system board, and PCI card, with some exceptions. Dynamic reconfiguration (DR) is used for active replacement and addition of CPU/memory board unit and I/O unit configuring the system board.
■ Terminal server (or a touch panel connected to a terminal server) Note – For the console connection method, see the SPARC Enterprise M8000/M9000 Servers Installation Guide. ■ Partitioning function One high-end server can be divided into multiple areas, or domains, for more effective scalability. Each domain manages resources in linkage with the XSCF. A domain may consist of optimized resources depending on its intended use, enabling more efficient system configurations.
1.2 System Specifications This section describes the specifications and the environmental conditions of both high-end servers, shows names of server components, and provides an overview of the operator panel. Note – Contact your sales representative for tape drive unit options on M8000/M9000 servers.
TABLE 1-1 Main Unit Specifications (Continued) M9000 Server M8000 Server Tape drive unit 1 drive can be mounted (option) 2 drives can be mounted (option) FAN unit 4 units (type A) 8 units (type B) 16 units (type A) 32 units (type A) Power supply unit (Maximum number of mounted units) (single phase, one system) 9 units 15 units 30 units Redundant configuration Power supply unit, FAN unit, XSCF, power system (dual power feed option), and clock supply system Components that can be active replac
TABLE 1-1 Main Unit Specifications (Continued) M9000 Server Item M8000 Server Frequency Write data Read range (reference)‡ Base Cabinet Only Base Cabinet + Expansion Cabinet 860 - 960 MHz††† EPCglobal GIAI-96 format‡‡‡ 1. 902 - 928 MHz Fixed reader with a maximum output of 4 Watt EIRP: Up to 1.8 m (6 ft) Handheld reader with a maximum output of 2 Watt EIRP: Up to 90 cm (3 ft) 2. 865.6 - 867.6 MHz Fixed reader with a maximum output of 3.2 Watt EIRP: Up to 1.
1.2.1 TABLE 1-2 Environmental Specifications Environmental Specifications Operating Range Non-Operating Range Optimum Ambient temperature 5°C to 32°C (41°F to 89.6°F) Unpacked: 0°C to 50°C (32°F to 122°F) Packed: -20°C to 60°C (-4°F to 140°F) 21°C to 23°C (70°F to 74°F) Relative humidity* 20% RH to 80% RH to 93% RH 45% RH to 50% RH Altitude restriction† 3,000 m (10,000 ft) 12,000 m (40, 000 ft) Temperature conditions 5°C to 32°C (41°F to 89.
1.2.2 Power Specifications Two power input modes are available; single-phase power feed and three-phase power input. To use a three-phase power source, a three-phase power feed option and a power supply cabinet for mounting the option are required. The three-phase power feed has two connection options: a star connection that connects a neutral line and each phase, and a delta connection that connects each phase. For details, see the SPARC Enterprise M8000/M9000 Servers Site Planning Guide.
1.2.3 M8000 Server Components FIGURE 1-4 and FIGURE 1-5 show the front and rear views of the M8000 server with a power cabinet connected. The names of server components are shown in each figure. The dual power feed option and three-phase power feed option can be mounted in the power cabinet. One power cabinet is connected to the M8000 server.
FIGURE 1-5 M8000 Server and Power Cabinet Rear View Power cabinet AC section Power supply unit FAN Unit unit AC section I/O unit 1-14 SPARC Enterprise M8000/M9000 Servers Overview Guide • December 2010
1.2.4 M9000 Server Components (Base Cabinet Only) FIGURE 1-6 and FIGURE 1-7 show the front and rear views of the M9000 server (base cabinet only) with a power cabinet connected. The names of server components are shown in each figure. One power cabinet is connected to the M9000 server (base cabinet only).
FIGURE 1-7 M9000 Server (Base Cabinet Only) and Power Cabinet Rear View Power cabinet FAN unit CPU memory board unit Power supply unit I/O unit AC section * * Three-phase 1-16 SPARC Enterprise M8000/M9000 Servers Overview Guide • December 2010
1.2.5 M9000 Server Components (With an Expansion Cabinet) FIGURE 1-8 and FIGURE 1-9 show the front and rear views of the M9000 server with an expansion cabinet and power cabinets connected. The names of server components are shown in each figure. One power cabinet is connected to each of M9000 server base cabinet and expansion cabinet.
FIGURE 1-9 M9000 Server (With an Expansion Cabinet) and Power Cabinet Rear View Power cabinet Power cabinet FAN unit Power supply unit CPU memory board unit I/O unit AC section * * Three-phase Expansion cabinet 1.2.6 Base cabinet Operator Panel Overview The operator panel has LEDs indicating different states of the M8000 and M9000 servers, a power switch for power control, and a mode switch for setting the operation mode. The operator panel is mounted on the front panel.
Operator Panel Appearance FIGURE 1-10 shows the operator panel. FIGURE 1-10 Operator Panel Locked Service POWER (LED) STANDBY (LED) CHECK (LED) POWER switch MODE switch Operator Panel LEDs TABLE 1-4 lists the operating states indicated by the LEDs on the operator panel. TABLE 1-4 LEDs Operator Panel LEDs Name Light color Description of function and operating state POWER Green Indicates whether the main unit power is on. If this LED is on, the power is on.
Operator Panel Switches The switches on the operator panel include the mode switch for setting the operation mode and the POWER switch for turning on and off the server. To switch between system operation mode and maintenance mode, insert the dedicated key of the highend server and change the mode switch setting. TABLE 1-5 lists functions of the switches on the operator panel. TABLE 1-5 Switch 1-20 Operator Panel Switches Name Function POWER switch Controls the main unit power.
1.3 Server Components This section describes the components of both high-end servers. For details on each, see the SPARC Enterprise M8000/M9000 Servers Service Manual. 1.3.
1.3.2 CPU/Memory Board Unit The CPU/memory board unit (CMU) contains CPUMs, memory modules, and a DDC. The CMU with an I/O unit can be combined to construct one or more domains. The CMU has the following features: 1.3.3 ■ Contains an interconnect LSI module that uses the latest LSI process. ■ Uses Double Data Rate (DDR)II DIMM memory.
1.3.4 FAN Unit The FAN unit is used to cool the server, and has the following features: 1.3.5 ■ A redundant fan configuration enables continuous system operation even if a fan fails during system operation. ■ Active (hot) system maintenance or replacement of a faulty FAN unit can be performed during system operation. Power Supply Unit The power supply unit (PSU) feeds power to each unit, and has the following features: 1.3.
The operations of switches on the operator panel can be limited by switching the operation mode with the dedicated key supplied for the panel. 1.3.9 XSCF Unit The XSCF unit (XSCFU) includes a dedicated processor, which operates independently from the main unit processors. The XSCFU in the servers adopts a duplicated configuration to increase fault tolerance. The XSCFU is equipped with hardware interfaces for network connections to remote devices such as personal computers and workstations.
FIGURE 1-11 Types of CD-RW/DVD-RW Drive Unit Slot-loading type Tray-loading type Note – The locations of LED and button may vary depending on the servers. The CD-RW/DVD-RW drive unit cannot be directly shared by multiple domains in a server. However, if the multiple domains are connected to one another through a LAN and a certain function of the Oracle Solaris OS is used, the CD-RW/DVD-RW drive unit can be shared by the domains.
1.5 Optional Products The following products are the main options available for the M8000/M9000 servers. 1.5.1 ■ Power Supply Options ■ External I/O Expansion Unit ■ M9000 Server (Expansion Cabinet) Option Power Supply Options The power cabinet and the rack-mountable dual power feed option for the M8000 server are offered as power supply options. The power cabinet enables dual power feed or three-phase power feed.
TABLE 1-6 Specifications of the Power Cabinet and M8000/M9000 Dual Power Feed Option Rack-mountable Dual Power Feed options Item Outside dimensions Width [mm] Depth [mm] Height [mm] Weight [kg] Power Cabinet 489 1003 278(6U) 317 1244 1800 350 75 Input power: Single-phase power input Voltage [V] Number of phases Frequency [Hz] AC200 to 240 ± 10% Single phase 50/60 +2%, -4% Note – For specifications of the three-phase power feed option, see the SPARC Enterprise M8000/M9000 Servers Site Planning G
FIGURE 1-12 1.5.3 External I/O Expansion Unit M9000 Server (Expansion Cabinet) Option An M9000 server (base cabinet) configuration can contain up to 32 CPU modules (64 cores for SPARC64 VI processors, 128 cores for SPARC64 VII/SPARC64 VII+ processors), up to 2 TB of memory, and up to 224 PCI slots. A configuration containing more components than described above would require the expansion cabinet option of the M9000 server.
CHAPTER 2 System Features This chapter explains the following technical aspects, including features and structures. 2.1 ■ Section 2.1, “Hardware Configuration” on page 2-1 ■ Section 2.2, “Partitioning” on page 2-7 ■ Section 2.3, “Resource Management” on page 2-12 ■ Section 2.4, “RAS” on page 2-13 Hardware Configuration This section explains the hardware configuration, which includes the following items: 2.1.
The M8000 server, M9000 server, and the M9000 server with expansion cabinet take advantage of system scalability by supporting up to 16, 32, or up to 64 CPU modules, respectively. CPU modules running at different clock frequencies can be used in a single system. The latest CPUs can therefore be installed when improved processing performance is required. The SPARC64 VII processor extends the 64-bit integer multiply-accumulate operation function and the hardware barrier function.
FIGURE 2-1 shows an example of a mixed configuration of SPARC64 VI and SPARC64 VII processors. FIGURE 2-1 CPUs on CPU/Memory Board Unit (CMU) and Domain Configuration Example Different types of processors can be mounted on a single CMU, as shown in CMU#2 and CMU#3 in FIGURE 2-1. And a single domain can be configured with different types of processors, as shown in Domain 2 in FIGURE 2-1.
For the settings of the CPU operational mode, see the SPARC Enterprise M3000/M4000/M5000/M8000/M9000 Servers XSCF User’s Guide or the SPARC Enterprise M3000/M4000/M5000/M8000/M9000 Servers XSCF Reference Manual. There are restrictions on the DR operation depending on whether the Oracle Solaris OS operates in the SPARC64 VII enhanced mode or in the SPARC64 VI compatible mode. For DR operation, see the SPARC Enterprise M4000/M5000/M8000/M9000 Servers Dynamic Reconfiguration (DR) User’s Guide.
2.1.2 Memory Subsystem The memory subsystem controls memory access and cache memory. The M8000/M9000 servers use DDR-II DIMM memory. Each CMU has thirty-two memory slots. Also, the M8000 server, M9000 server, and M9000 server with expansion cabinet can mount up to 128, 256, or 512 DIMMs, respectively. The memory subsystems use up to eight-way interleaving, providing higher-speed memory access. Memory mirror mode is supported for every pair of memory buses in a CMU.
FIGURE 2-2 2-6 Main Component Connections SPARC Enterprise M8000/M9000 Servers Overview Guide • December 2010
Note – The SC is the system controller that controls CPUs and memory and handles communication with the XB. 2.1.5 System Control System control of the M8000/M9000 servers refer to the system control contained within the XSCFU that runs the XSCF and every component controlled by the XSCF. As long as input power is being supplied to the server, the XSCF constantly monitors the server even if all domains are powered off.
Partitioning enables arbitrary assignment of resources in the server. Partitioning also enables flexible domain configurations to be used according to the job load or processing amount. An independent Oracle Solaris OS can run in a domain. Each domain is protected by hardware so that it is not affected by other domains. For example, a software-based problem, such as an OS panic, in one domain does not directly affect jobs in the other domains.
FIGURE 2-3 shows the partitioning division types.
2.2.3 Domain Configuration Any XSBs in the server can be combined to configure a domain, regardless of whether the divided XSB is the Uni-XSBs or Quad-XSBs. These XSBs can be used in any combination for a flexible domain configuration. Also, the quantity of resources for one XSB can be adjusted according to the division type of a PSB. Thus, a domain can be configured based on the quantity of resources required for job operations. XSCF user interfaces are used to configure a domain.
FIGURE 2-4 shows the domain configuration.
2.3 Resource Management This section explains the following functions that support dynamic reconfiguration of domain resources during system operation: 2.3.1 ■ Dynamic Reconfiguration ■ PCI Hot-plug ■ Capacity on Demand ■ Oracle Solaris Zones Dynamic Reconfiguration Dynamic reconfiguration (DR) enables hardware resources on system boards to be added and removed dynamically without stopping system operation. DR thus enables optimal relocation of system resources.
2.3.2 PCI Hot-plug The PCI hot-plug function enables PCI cards to be added or removed under the Oracle Solaris OS without a system reboot. Examples of uses for the PCI hot-plug function are as follows: ■ Replacing or removing a faulty PCI card or one that will probably become faulty, during system operation ■ Adding a PCI card during system operation For details on the PCI hot-plug function, see the SPARC Enterprise M8000/M9000 Servers Service Manual. 2.3.
RAS for M8000/M9000 servers minimize system downtime by providing for error checking at appropriate locations and by providing centralized monitoring and control of error checking. Also M8000/M9000 servers can be configured with clustering software or centralized management software to enhance the RAS function. Any scheduled system halt, such as a periodic maintenance or system configuration change can also be performed without affecting operating resources. This can improve service uptime significantly.
Hardware and software faults in the system cannot be completely eliminated. To provide high availability, the system must include mechanisms that enable continuous system operation even if a failure occurs in hardware, such as components and devices, or in software, such as the OS, or application software. M8000/M9000 servers provide the functions listed below to obtain high availability. Higher availability can also be obtained by combining the server with clustering software or management software. 2.4.
M8000/M9000 servers provide the following solution to realize high serviceability: 2-16 ■ Status LEDs mounted on the operator panel, indicating the main replaceable components and the components to which active replacement is applicable ■ Remote recognition of the device operating status and remote maintenance using the XSC ■ LED blinking function for indicating the maintenance target (CHECK LED, which is also called a locator) ■ Notes and cautions marked on different types of labels provided for t
CHAPTER 3 About Software This chapter explains the following software functions. 3.1 ■ Section 3.1, “Oracle Solaris OS Functions” on page 3-1 ■ Section 3.2, “XSCF Firmware Function” on page 3-2 Oracle Solaris OS Functions The Oracle Solaris OS has the following features: ■ Reliability that has been built over the years ■ Affinity that fully brings out the hardware performance of the SPARC architecture.
3.1.1 Domain Management In the M8000/M9000 servers, a physical system board (PSB) can be logically divided into one part (no division) or four parts by a partitioning function unique to the system. A PSB that is logically divided into one part (no division) is called a Uni-XSB, and a PSB that is logically divided into four parts is called a Quad-XSB. The physical unit configuration of each divided part of a PSB is called an extended system board (XSB).
The XSCFU has a serial port and LAN port as external interfaces. A terminal such as a personal computer or workstation can be connected to the XSCF through a serial connection or Ethernet connection. The servers can be operated and managed from the command line-based XSCF Shell or browser-based XSCF Web provided by the XSCF. Only the XSCF Shell can be used through the serial connection. Both the XSCF Shell and XSCF Web can be used through the Ethernet connection.
3.2.1.2 Browser-Based User Interface (XSCF Web) XSCF Web is a browser-based user interface that can be used from a terminal, such as a personal computer or workstation, connected to the server through an Ethernet connection. However, the XSCF Web cannot be used through a serial connection. If the browser function of a terminal is used for a connection to the XSCF, BUI operations can be performed. 3.2.2 XSCF Functional Overview This section provides an overview of the main functions supported by the XSCF.
3.2.2.3 System Status Management The XSCF provides functions as XSCF operations for displaying the system configuration status, creating and changing a domain configuration definition, and starting and stopping domains. Also, the XSCF provides the DR function, which assists in dynamically changing a system board configuration during domain operation. Thus, domain resources can be optimized for job operations. Moreover, the XSCF in linkage with the Oracle Solaris OS manages CPU, memory, and I/O resources.
Capacity on Demand (COD) The COD feature allows you to configure spare processing resources on your server in the form of one or more COD CPUs which can be activated at a later date when additional processing power is needed. For details, see the SPARC Enterprise M4000/M5000/M8000/M9000 Servers Capacity on Demand (COD) User’s Guide 3.2.2.7 Airflow Indicator The airflow indicator indicates the amount of air exhausted from the server while the M8000/M9000 servers are up and running.
Index M8000 rear view, 1-13 M9000 (base cabinet only) front view, 1-15 M9000 (base cabinet only) rear view, 1-15 M9000 (with an expansion cabinet) front view, 117 M9000 (with an expansion cabinet) rear view, 117 A airflow indicator, 3-6 appearance M8000, 1-2 M9000 (base cabinet only), 1-3 M9000 (with an expansion cabinet), 1-4 availability, 2-14 C components CPU module, 1-21 CPU/memory unit, 1-22 F features high-end server, 1-5 partitioning, 2-7 software, 3-1 system, 2-1 XSCF, 3-2 H hardware configurat
software Oracle Solaris operating system, 3-1 XSCF firmware, 3-2 specifications system, 1-8 system specifications, 1-8 U Uni-XSB, 2-8 X XSCF firmware, 3-2 XSCF shell, 3-3 XSCF web, 3-4 Index-2 SPARC Enterprise M8000/M9000 Servers Overview Guide • December 2010