1. Manuals
  2. Brands
  3. Fujitsu Manuals
  4. Server
  5. SPARC Enterprise T5440 Server
  6. Service manual

Fujitsu SPARC Enterprise T5440 Service Manual

Fujitsu server user manual
Hide thumbs Also See for SPARC Enterprise T5440:
Table of Contents

Quick Links

See also: Administration Manual, Service Manual
SPARC Enterprise T5440 Server
Service Manual
Manual Code C120-E512-03EN,
Part No. 875-4392-12
June 2011, Revision A
Table of Contents
loading

Related Manuals for Fujitsu SPARC Enterprise T5440

Summary of Contents for Fujitsu SPARC Enterprise T5440

  • Page 1 SPARC Enterprise T5440 Server Service Manual Manual Code C120-E512-03EN, Part No. 875-4392-12 June 2011, Revision A...
  • Page 2 INFRINGEMENT, ARE DISCLAIMED, EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID. Unless otherwise expressly set forth in such agreement, to the extent allowed by applicable law, in no event shall Oracle or Fujitsu Limited, and/or any of their affiliates have any liability to any third party under any legal theory for any loss of revenues or profits, loss of use or data, or business interruptions, or for any indirect, special, incidental or consequential damages, even if advised of the possibility of such damages.
  • Page 3 OU À L’ABSENCE DE CONTREFAÇON, SONT EXCLUES, DANS LA MESURE AUTORISÉE PAR LA LOI APPLICABLE. Sauf mention contraire expressément stipulée dans ce contrat, dans la mesure autorisée par la loi applicable, en aucun cas Oracle ou Fujitsu Limited et/ou l’une ou l’autre de leurs sociétés affiliées ne sauraient être tenues responsables envers une quelconque partie tierce, sous quelque théorie juridique que ce soit, de tout manque à...

  • Page 5: Table Of Contents

    Contents Preface xiii Identifying Server Components 1 Infrastructure Boards and Cables Front Panel Diagram 3 Front Panel LEDs 5 Rear Panel Diagram 6 Rear Panel LEDs 8 Ethernet Port LEDs 9 Managing Faults 11 Understanding Fault Handling Options 11 Server Diagnostics Overview 12...
  • Page 6 ▼ ▼ Oracle VTS Software Packages 45 Useful Oracle VTS Tests 46 Detecting Faults Using POST 46 SPARC Enterprise T5440 Server Service Manual • June 2011 ALOM CMT Compatibility Shell) 26 Console 26 Command) 27 Command) 28 Verify Installation of Oracle VTS Software 42...
  • Page 7 ▼ Obtain the Chassis Serial Number Remotely 66 Powering Off the System 67 ▼ Power Off (Command Line) 67 ▼ Power Off (Graceful Shutdown) 68 ▼ Power Off (Emergency Shutdown) 68 ▼ Disconnect Power Cords From the Server 68 Contents...
  • Page 8 Fan Tray Device Identifiers 88 Fan Tray Fault LED 89 Servicing Power Supplies About Power Supplies 90 ▼ Remove a Power Supply (Hot-Swap) 90 ▼ Install a Power Supply (Hot-Swap) 91 viii SPARC Enterprise T5440 Server Service Manual • June 2011...
  • Page 9 ▼ Remove a Power Supply ▼ Install a Power Supply 93 Power Supply Device Identifiers 94 Power Supply LED 95 Servicing PCIe Cards 96 ▼ Remove a PCIe Card 96 ▼ Install a PCIe Card 97 ▼ Add a PCIe Card 98 PCIe Device Identifiers 99 PCIe Slot Configuration Guidelines 100 Servicing CMP/Memory Modules 102...
  • Page 10 Remove the Hard Drive Backplane 136 ▼ Install the Hard Drive Backplane 137 Servicing the Motherboard 139 ▼ Remove the Motherboard 139 ▼ Install the Motherboard 142 Motherboard Fastener Locations 143 SPARC Enterprise T5440 Server Service Manual • June 2011...
  • Page 11 Install the Server Into the Rack 154 ▼ Slide the Server Into the Rack 155 ▼ Connect the Power Cords to the Server 157 ▼ Power On the Server 157 Performing Node Reconfiguration 159 I/O Connections to CMP/Memory Modules 160...
  • Page 12 Network Management Port Connector Pinouts 173 Serial Port Connector Pinouts 174 USB Connector Pinouts 175 Gigabit Ethernet Connector Pinouts 176 Server Components 177 Customer-Replaceable Units 178 Field-Replaceable Units 180 Index 183 SPARC Enterprise T5440 Server Service Manual • June 2011...

  • Page 13: Preface

    Preface This manual provides detailed procedures that describe the removal and replacement of replaceable parts in the SPARC Enterprise T5440 Server. This manual also includes information about the use and maintenance of the server. This document is written for technicians, system administrators, authorized service providers (ASPs), and users who have advanced experience troubleshooting and replacing hardware.

  • Page 14: Related Documentation

    “Server Components” on page 177 ■ Contains illustrations showing server components. Related Documentation The latest versions of all the SPARC Enterprise Series manuals are available at the following Web sites: Global Site (http://www.fujitsu.com/sparcenterprise/manual/) Japanese Site SPARC Enterprise T5440 Server Service Manual • June 2011...
  • Page 15 (http://primeserver.fujitsu.com/sparcenterprise/manual/) Title SPARC Enterprise T5440 Server Getting Started Guide SPARC Enterprise T5440 Server Product Notes Important Safety Information for Hardware Systems SPARC Enterprise T5440 Server Safety and Compliance Guide SPARC Enterprise/ PRIMEQUEST Common Installation Planning Manual SPARC Enterprise T5440 Server...
  • Page 16 Software documentation that you received with your system ■ Sun Oracle software-related manuals (Oracle Solaris OS, and so on): ■ (http://www.oracle.com/technetwork/documentation/index.html) SPARC Enterprise T5440 Server Service Manual • June 2011 Description Information and procedures for accessing ILOM 3.0 functions using SNMP or IPMI management hosts Enhancements that have been made to ILOM firmware since the ILOM 3.0 release...

  • Page 17: Text Conventions

    Text Conventions Typeface* Meaning The names of commands, files, AaBbCc123 and directories; on-screen computer output What you type, when AaBbCc123 contrasted with on-screen computer output AaBbCc123 Book titles, new words or terms, words to be emphasized. Replace command-line variables with real names or values.

  • Page 18: Conventions For Alert Messages

    A space of one line precedes and follows an alert statement. Caution – The following tasks regarding this product and the optional products provided from Fujitsu should only be performed by a certified service engineer. Users must not perform these tasks. Incorrect operation of these tasks may cause malfunction.

  • Page 19: Notes On Safety

    Maintenance Damage Two people must dismount and carry the chassis. The weight of the server on extended slide rails can be enough to overturn an equipment rack. Before you begin, deploy the antitilt feature on your cabinet. The server weighs approximately 88 lb (40 kg). Two people are required to lift and mount the server into a rack enclosure when using the procedures in this chapter.
  • Page 20 Plugging or unplugging of external interface cards ■ Maintenance and inspections (repairing, and regular diagnosis and maintenance) ■ SPARC Enterprise T5440 Server Service Manual • June 2011 Warning Electric shock Never attempt to run the server with the covers removed. Hazardous voltage present.
  • Page 21 Caution – The following tasks regarding this product and the optional products provided from Fujitsu should only be performed by a certified service engineer. Users must not perform these tasks. Incorrect operation of these tasks may cause malfunction. Unpacking optional adapters and such packages delivered to the users ■...

  • Page 22: Documentation Feedback

    If you have any comments or requests regarding this document, or if you find any unclear statements in the document, please state your points specifically on the form at the following URL. (http://www.fujitsu.com/global/contact/computing/sparce_index.ht xxii SPARC Enterprise T5440 Server Service Manual • June 2011...

  • Page 23: Identifying Server Components

    “Server Components” on page 177 ■ Infrastructure Boards and Cables The server is based on a 4U chassis and has the following boards installed: Motherboard – The motherboard includes slots for up to four CMP modules and ■ four memory modules, memory control subsystem, up to eight PCIe expansion slots, and a service processor slot.
  • Page 24 Related Information SPARC Enterprise T5440 Server Site Planning Guide ■ “Managing Faults” on page 11 ■ “Servicing Customer-Replaceable Units” on page 75 ■ “Servicing Field-Replaceable Units” on page 119 ■ SPARC Enterprise T5440 Server Service Manual • June 2011...

  • Page 25: Front Panel Diagram

    LEDs, Locator button and LED. The front panel also provides access to internal hard drives, the DVD-ROM drive (if equipped), and the two front USB ports. The following illustration shows front panel features on the server front panel. For a detailed description of front panel controls and LEDs, see...
  • Page 26 “Rear Panel Diagram” on page 6 ■ “Servicing the Front Bezel” on page 119 ■ SPARC Enterprise T5440 Server Service Manual • June 2011...

  • Page 27: Front Panel Leds

    • If the system is powered on, press and hold for 4 seconds to initiate an For more information about powering on and powering off the system, see the SPARC Enterprise T5440 Server Administration Guide. previously mentioned, indicating that it is active.

  • Page 28: Rear Panel Diagram

    FIGURE: Rear Panel Features on page 7 Enterprise T5440 server. For more detailed information about ports and their uses, see the SPARC Enterprise T5440 Server Installation and Setup Guide. For a detailed description of PCIe slots, see SPARC Enterprise T5440 Server Service Manual • June 2011 service action is required on at least one of the fan modules.
  • Page 29 Network management port Gigabit ethernet ports Related Information “Front Panel Diagram” on page 3 ■ “Rear Panel LEDs” on page 8 ■ “Ethernet Port LEDs” on page 9 ■ “Detecting Faults Using LEDs” on page 34 ■ Identifying Server Components...

  • Page 30: Rear Panel Leds

    “Ethernet Port LEDs” on page 9 ■ “Detecting Faults Using LEDs” on page 34 ■ SPARC Enterprise T5440 Server Service Manual • June 2011 Description The Locator LED enables you to find a particular system. The LED is activated using one of the following methods: •...

  • Page 31: Ethernet Port Leds

    * The NET MGT port only operates in 100-Mbps or 10-Mbps so the speed indicator LED will be green or off (never amber). Related Information “Rear Panel Diagram” on page 6 ■ “Rear Panel LEDs” on page 8 ■ “Detecting Faults Using LEDs” on page 34 ■ Identifying Server Components...
  • Page 32 SPARC Enterprise T5440 Server Service Manual • June 2011...

  • Page 33: Managing Faults

    ■ “ILOM-to-ALOM CMT Command Reference” on page 58 ■ Understanding Fault Handling Options This topic contains the following: “Server Diagnostics Overview” on page 12 ■ “Diagnostic Flowchart” on page 13 ■ “Options for Accessing the Service Processor” on page 17 ■...

  • Page 34: Server Diagnostics Overview

    Server Diagnostics Overview You can use a variety of diagnostic tools, commands, and indicators to monitor and troubleshoot a server: LEDs – Provide a quick visual notification of the status of the server and of some ■ of the FRUs. See ILOM firmware –...

  • Page 35: Diagnostic Flowchart

    (Optional) Perform a reset of the server. ■ Related Information “Diagnostic Flowchart” on page 13 ■ SPARC Enterprise T5440 Server Installation and Setup Guide ■ SPARC Enterprise T5440 Server Administration Guide ■ Diagnostic Flowchart The following diagnostics are available to troubleshoot faulty hardware. See POST Parameters”...
  • Page 36 Diagnostic Flowchart FIGURE: SPARC Enterprise T5440 Server Service Manual • June 2011...
  • Page 37 Run Oracle VTS Oracle VTS is an application you can run to exercise software. and diagnose FRUs. To run Oracle VTS, the server must be running the Oracle Solaris OS. • If Oracle VTS reports a faulty device, replace the FRU.
  • Page 38 Unit include the text string Ext FRU or Ext in the External I/O Sensor at the beginning of the fault description. Expansion Unit. SPARC Enterprise T5440 Server Service Manual • June 2011 For more information “Detecting Faults (ILOM show faulty Command)”...

  • Page 39: Options For Accessing The Service Processor

    Related Information “Server Diagnostics Overview” on page 12 ■ SPARC Enterprise T5440 Server Administration Guide ■ Options for Accessing the Service Processor There are three methods of interacting with the service processor: Integrated Lights Out Manager (ILOM) shell (default) – Available via the System ■...

  • Page 40: Ilom Overview

    SPARC Enterprise T5440 Server Installation and Setup Guide ■ SPARC Enterprise T5440 Server Administration Guide ■ Integrated Lights Out Manager 3.0 Supplement for the SPARC Enterprise T5440 Server ■ ILOM Overview The Integrated Lights Out Manager (ILOM) firmware runs on the service processor in the server, enabling you to remotely manage and administer your server.
  • Page 41 ILOM Fault Management FIGURE: The service processor can detect when a fault is no longer present and clears the fault in several ways: Fault recovery – The system automatically detects that the fault condition is no ■ longer present. The service processor extinguishes the Service Required LED and updates the FRU’s PROM, indicating that the fault is no longer present.

  • Page 42: Alom Cmt Compatibility Shell Overview

    ILOM event log. The ILOM event log is also available using the ALOM CMT compatibility shell. See the Integrated Lights Out Manager 3.0 Supplement for the SPARC Enterprise T5440 Server for comparisons between the ILOM CLI and the ALOM CMT compatibility CLI, and for instructions for adding an ALOM-CMT account.

  • Page 43: Oracle Vts Overview

    ■ Oracle VTS Overview Sometimes a server exhibits a problem that cannot be isolated definitively to a particular hardware or software component. In such cases, it might be useful to run a diagnostic tool that stresses the system by continuously running a comprehensive battery of tests.

  • Page 44: Post Fault Management Overview

    ■ POST Fault Management Overview Power-on self-test (POST) is a group of PROM-based tests that run when the server is powered on or reset. POST checks the basic integrity of the critical hardware components in the server (CMP, memory, and I/O subsystem).

  • Page 45: Post Fault Management Flowchart

    POST Fault Management Flowchart Flowchart of Variables for POST Configuration FIGURE: Related Information “Diagnostic Flowchart” on page 13 ■ Managing Faults...

  • Page 46: Memory Fault Handling Overview

    113. The server uses advanced ECC technology that corrects up to 4-bits in error on nibble boundaries, as long as the bits are all in the same DRAM. On 4 GB FB-DIMMs, if a DRAM fails, the DIMM continues to function.

  • Page 47: Connecting To The Service Processor

    “Diagnostic Flowchart” on page 13 ■ “FB-DIMM Fault Button Locations” on “Servicing FB-DIMMs” Links SPARC Enterprise T5440 Server Installation and Setup Guide SPARC Enterprise T5440 Server Installation and Setup Guide “Switch From the System Console to the Service Processor (ILOM or ALOM CMT Compatibility Shell)”...

  • Page 48: Switch From The System Console To The Service Processor (Ilom Or Alom Cmt Compatibility Shell)

    From the ILOM -> prompt, type start /SP/console. -> start /SP/console ▼ Switch From the ALOM CMT Compatibility Shell to the System Console ● From the ALOM-CMT sc> prompt, type console. sc> console SPARC Enterprise T5440 Server Service Manual • June 2011...

  • Page 49: Displaying Fru Information With Ilom

    Displaying FRU Information With ILOM “Display System Components (ILOM show components Command)” on page 27 ■ “Display Individual Component Information (ILOM show Command)” on page 28 ■ ▼ Display System Components (ILOM show components Command) The show components command displays the system components (asrkeys) and reports their status.

  • Page 50: Display Individual Component Information (Ilom Show Command)

    ● At the -> prompt, enter the show command. EXAMPLE: show Command Output on page get information about a memory module (FB-DIMM). SPARC Enterprise T5440 Server Service Manual • June 2011 | Value | Enabled | Enabled | Enabled...

  • Page 51: Controlling How Post Runs

    show Command Output EXAMPLE: -> show /SYS/MB/CPU0/CMP0/BR1/CH0/D0 /SYS/MB/CPU0/CMP0/BR1/CH0/D0 Targets: SEEPROM SERVICE PRSNT T_AMB Properties: type = DIMM component_state = Enabled fru_name = 1024MB DDR2 SDRAM FB-DIMM 333 (PC2 5300) fru_description = FBDIMM 1024 Mbyte fru_manufacturer = Micron Technology fru_version = FFFFFF fru_part_number = 18HF12872FD667D6D4 fru_serial_number = d81813ce fault_state = OK...

  • Page 52: Post Parameters

    Parameter keyswitch_mode diag_mode diag_level diag_trigger diag_verbosity SPARC Enterprise T5440 Server Service Manual • June 2011 shows how the variables work together. Values Description The system can power on and run POST (based normal on the other parameter settings). For details see...

  • Page 53: Change Post Parameters

    ■ “Detecting Faults Using POST” on page 46 ■ “Clear Faults Detected During POST” on page 52 ■ SPARC Enterprise T5440 Server Installation and Setup Guide ■ SPARC Enterprise T5440 Server Administration Guide ■ ▼ Change POST Parameters 1. Access the ILOM prompt.

  • Page 54: Run Post In Maximum Mode

    33 shows a reset using a power cycle command sequence. For other methods, refer to the SPARC Enterprise T5440 Server Administration Guide. Note – The server takes about one minute to power off. Use the show /HOST command to determine when the host has been powered off. The console will display status=Powered Off 4.
  • Page 55 2007-12-19 22:01:27.274 0:0:0>INFO: STATUS: Running RGMII 1G BCM5466R PHY level Loopback Test 2007-12-19 22:01:32.036 0:0:0>Master set ACK for vbsc runpost command and spin... T5440, No Keyboard OpenBoot ..., 7968 MB memory available, Serial #75916434. [stacie obp #0] {0} ok 2007-12-19 22:01:32.028 0:0:0>POST:Return to VBSC.

  • Page 56: Detecting Faults

    FB-DIMM Fault LEDs. See ■ These LEDs provide a quick visual check of the state of the system. SPARC Enterprise T5440 Server Service Manual • June 2011 Topic “Detecting Faults Using LEDs” on page 34 “Detecting Faults (ILOM show faulty Command)”...
  • Page 57 The following table describes which fault LEDs are lit under given error conditions. Use the ILOM show faulty command to obtain more information about the nature of a given fault. See Component Fault Fault LEDs Lit Power supply • Service Required LED (front and rear panel) •...

  • Page 58: Detecting Faults (Ilom Show Faulty Command)

    ■ SPARC Enterprise T5440 Server Administration Guide ■ Integrated Lights Out Manager 3.0 Supplement for the SPARC Enterprise T5440 Server ■ Detecting Faults (ILOM show faulty Command) Use the ILOM show faulty command to display the following kinds of faults: Environmental or configuration faults –...

  • Page 59: Detect Faults (Ilom Show Faulty Command)

    ▼ Detect Faults (ILOM show faulty Command) ● At the -> prompt, type the show faulty command. The following show faulty command examples show the different kinds of output from the show faulty command: Example of the show faulty command when no faults are present: ■...
  • Page 60 | Property --------------------+------------------------+-------------------------------- /SP/faultmgmt/0 | fru /SP/faultmgmt/0 | timestamp /SP/faultmgmt/0/ | timestamp SPARC Enterprise T5440 Server Service Manual • June 2011 | Value | /SYS/MB/MEM0/CMP0/BR1/CH1/D1 | Dec 14 22:43:59 | SUN4V-8000-DX | 3aa7c854-9667-e176-efe5-e487e520 | 7a8a | Dec 14 22:43:59 | Value...

  • Page 61: Detecting Faults (Oracle Solaris Os Files And Commands)

    SPARC Enterprise T5440 Server Installation and Setup Guide ■ SPARC Enterprise T5440 Server Administration Guide ■ Integrated Lights Out Manager 3.0 Supplement for the SPARC Enterprise T5440 Server ■ ▼ Check the Message Buffer 1. Log in as superuser. 2. Issue the dmesg command: # dmesg The dmesg command displays the most recent messages generated by the system.

  • Page 62: View System Message Log Files

    “ILOM-to-ALOM CMT Command Reference” on page 58 ■ SPARC Enterprise T5440 Server Installation and Setup Guide ■ SPARC Enterprise T5440 Server Administration Guide ■ Integrated Lights Out Manager 3.0 Supplement for the SPARC Enterprise T5440 Server ■ SPARC Enterprise T5440 Server Service Manual • June 2011...

  • Page 63: View Ilom Event Log

    ▼ View ILOM Event Log ● Type the following command: -> show /SP/logs/event/list Note – The ILOM event log can also be viewed through the ILOM BUI or the ALOM CMT CLI. If a “major” or “critical” event is found that was not expected and not included under ILOM show faulty than it may indicate a system fault.

  • Page 64: About Oracle Vts Software

    ■ ▼ Verify Installation of Oracle VTS Software To perform this procedure, the Oracle Solaris OS must be running on the server, and you must have access to the Oracle Solaris command line. Note – The Oracle VTS 7.0 software, and future compatible versions, are supported on the server.

  • Page 65: Start The Oracle Vts Browser Environment

    User’s Guide. Note – Oracle VTS software can be run in several modes. You must perform this procedure using the default mode. 1. Start the Oracle VTS agent and Javabridge on the server. # cd /usr/Oracle VTS/bin # ./startOracle VTS 2.
  • Page 66 Logs tab. You can choose to view the following logs: Test Error – Detailed error messages from individual tests. ■ SPARC Enterprise T5440 Server Service Manual • June 2011 lists test categories that are especially useful to...

  • Page 67: Oracle Vts Software Packages

    Oracle VTS test binaries SUNWvtsts Related Information “Diagnostic Flowchart” on page 13 ■ “Useful Oracle VTS Tests” on page 46 ■ SPARC Enterprise T5440 Server Installation and Setup Guide ■ SPARC Enterprise T5440 Server Administration Guide ■ Managing Faults...

  • Page 68: Useful Oracle Vts Tests

    In this syntax, c = the core number, s = the strand number. Warning and informational messages use the following syntax: INFO or WARNING: message SPARC Enterprise T5440 Server Service Manual • June 2011 FRUs Exercised by Tests FB-DIMMs CMP, motherboard...
  • Page 69 In the following example, POST reports a memory error at FB-DIMM location /SYS/MB/CPU0/CMP0/BR1/CH0/D0. The error was detected by POST running on core 7, strand 2. show Command Output EXAMPLE: 7:2> 7:2>ERROR: TEST = Data Bitwalk 7:2>H/W under test = /SYS/MB/CPU0/CMP0/BR1/CH0/D0 7:2>Repair Instructions: Replace items in order listed by 'H/W under test' above.

  • Page 70: Identifying Faults Detected By Psh

    Manager 3.0 Concepts Guide. The following example depicts an ALOM CMT alert of the same fault reported by Oracle Solaris PSH in on page SPARC Enterprise T5440 Server Service Manual • June 2011 EXAMPLE: Console Message Showing Fault Detected by PSH...

  • Page 71: Detect Faults Identified By The Oracle Solaris Psh Facility (Ilom Fmdump Command)

    “ILOM-to-ALOM CMT Command Reference” on page 58 ■ SPARC Enterprise T5440 Server Administration Guide ■ Integrated Lights Out Manager 3.0 Supplement for the SPARC Enterprise T5440 Server ■ ▼ Detect Faults Identified by the Oracle Solaris PSH Facility (ILOM fmdump Command) The ILOM fmdump command displays the list of faults detected by the Oracle Solaris PSH facility and identifies the faulty FRU for a particular EVENT_ID (UUID).
  • Page 72 CPU errors exceeded acceptable levels Type Fault Severity Major Description The number of errors associated with this CPU has exceeded acceptable levels. SPARC Enterprise T5440 Server Service Manual • June 2011 the FRU name is 50, the message ID SUNW-MSG-ID...
  • Page 73 Automated Response The fault manager will attempt to remove the affected CPU from service. Impact System performance may be affected. Suggested Action for System Administrator Schedule a repair procedure to replace the affected CPU, the identity of which can be determined using fmdump -v -u . Details The Message ID: SUN4V-8000-JA indicates diagnosis has...

  • Page 74: Clearing Faults

    “Predictive Self-Healing Overview” on page 20 ■ SPARC Enterprise T5440 Server Administration Guide ■ Integrated Lights Out Manager 3.0 Supplement for the SPARC Enterprise T5440 Server ■ External I/O Expansion Unit Installation and Service Manual for SPARC Enterprise ■ T5120/T5240/T5220/T5240/T5440 Servers ▼...
  • Page 75 Additionally, the Service Required LED is no longer on. 3. Reset the server. You must reboot the server for the component_state property to take effect. 4. At the ILOM prompt, use the show faulty command to verify that no faults are reported.

  • Page 76: Clear Faults Detected By Psh

    To ensure that these messages are not displayed, perform the following Oracle Solaris command: fmadm repair UUID Example: # fmadm repair 7ee0e46b-ea64-6565-e684-e996963f7b86 SPARC Enterprise T5440 Server Service Manual • June 2011 | Value | /SYS/MB/CPU0/CMP0/BR1/CH0/D0 | Dec 21 16:40:56 | Dec 21 16:40:56...

  • Page 77: Clear Faults Detected In The External I/O Expansion Unit

    ▼ Clear Faults Detected in the External I/O Expansion Unit For service processor detected faults in the External I/O Expansion Unit, the fault must be manually cleared from ILOM show faulty after the problem has been repaired. Note – After the problem has been repaired, the fault will also be cleared from the ILOM show faulty command by resetting the service processor.

  • Page 78: Disabling Faulty Components Using Automatic System Recovery

    Note – The asrkeys vary from system to system, depending on how many cores and memory are present. Use the show components command to see the asrkeys on a given system. SPARC Enterprise T5440 Server Service Manual • June 2011 (TABLE: ASR Commands on page Description Displays system components and their current state.

  • Page 79: Disable System Components

    Related Information “Diagnostic Flowchart” on page 13 ■ “Detecting Faults” on page 34 ■ SPARC Enterprise T5440 Server Administration Guide ■ ▼ Disable System Components The component_state property disables a component by adding it to the ASR blacklist. 1. At the -> prompt, set the component_state property to Disabled: ->...

  • Page 80: Ilom-To-Alom Cmt Command Reference

    The following table describes the typical commands for servicing a server. For descriptions of all ALOM CMT commands, issue the help command or refer to the following documents: Integrated Lights Out Manager 3.0 Concepts Guide ■ SPARC Enterprise T5440 Server Service Manual • June 2011...
  • Page 81 Integrated Lights Out Manager 3.0 Supplement for the SPARC Enterprise T5440 Server ■ ILOM Command help [command] set /HOST/send_break_action true /SYS/component/clear_fault_a ction true start /SP/console show /SP/console/history ALOM CMT Command help [command] break [-y][-c][-D] • -y skips the confirmation question.
  • Page 82 /SYS/PSx/prepare_to_remove_acti on true reset /SYS reset /SP SPARC Enterprise T5440 Server Service Manual • June 2011 ALOM CMT Command bootmode value [normal|reset_nvram| bootscript=string] powercycle [-f] The -f option forces an immediate poweroff. Otherwise the command attempts a graceful shutdown.
  • Page 83 Component Information (ILOM show Command)” on page showkeyswitch Description Sets the virtual keyswitch. Turns the Locator LED on the server on or off. Displays the environmental status of the host server. This information includes system temperatures, power supply, front panel LED, hard drive, fan, voltage, and current sensor status.
  • Page 84 “ILOM-to-ALOM CMT Command Reference” on page 58 ■ SPARC Enterprise T5440 Server Administration Guide ■ Integrated Lights Out Manager 3.0 Supplement for the SPARC Enterprise T5440 Server ■ SPARC Enterprise T5440 Server Service Manual • June 2011 ALOM CMT Command...

  • Page 85: Preparing To Service The System

    Preparing to Service the System These topics describe how to prepare the server for servicing. “Safety Information” on page 63 ■ “Required Tools” on page 66 ■ “Obtain the Chassis Serial Number” on page 66 ■ “Obtain the Chassis Serial Number Remotely” on page 66 ■...

  • Page 86: Observing Important Safety Precautions

    Follow all cautions and instructions marked on the equipment and described in ■ the SPARC Enterprise T5440 Server Safety and Compliance Guide. Ensure that the voltage and frequency of your power source match the voltage ■...

  • Page 87: Electrostatic Discharge Safety Measures

    Following this practice equalizes the electrical potentials between you and the server. Note – An antistatic wrist strap is no longer included in the server accessory kit. However, antistatic wrist straps are still included with options.

  • Page 88: Required Tools

    ▼ Obtain the Chassis Serial Number Remotely ● Use the ILOM show /SYS command to obtain the chassis serial number. -> show /SYS /SYS Targets: SERVICE LOCATE PS_FAULT TEMP_FAULT FAN_FAULT SPARC Enterprise T5440 Server Service Manual • June 2011...

  • Page 89: Powering Off The System

    Powering Off the System Note – Additional information about powering off the system is located in the SPARC Enterprise T5440 Server Administration Guide. This topic includes the following: “Power Off (Command Line)” on page 67 ■ “Power Off (Graceful Shutdown)” on page 68 ■...

  • Page 90: Power Off (Graceful Shutdown)

    Caution – All applications and files will be closed abruptly without saving changes. File system corruption might occur. ● Press and hold the Power button for four seconds. ▼ Disconnect Power Cords From the Server ● Unplug all power cords from the server. SPARC Enterprise T5440 Server Service Manual • June 2011...

  • Page 91: Extending The Server To The Maintenance Position

    “Components Serviced in the Maintenance Position” on page 69 ■ “Extend the Server to the Maintenance Position” on page 70 ■ Components Serviced in the Maintenance Position The following components can be serviced with the server in the maintenance position: Fan trays ■ CMP/memory modules ■...

  • Page 92: Extend The Server To The Maintenance Position

    -> set /SYS/LOCATE value=Fast_Blink Once you have located the server, press the Locator LED and button to turn it off. 2. Verify that no cables will be damaged or will interfere when the server is extended.

  • Page 93: Remove The Server From The Rack

    4. While squeezing the slide rail locks, slowly pull the server forward until it is locked in the service position. ▼ Remove the Server From the Rack The server must be removed from the rack to remove or install the following...
  • Page 94 Caution – Use two people to dismount and carry the chassis. Lift Warning FIGURE: 4. From the front of the server, press inner rail release buttons and pull the server forward until it is free of the rack rails. 5. Set the server on a sturdy work surface.

  • Page 95: Perform Electrostatic Discharge - Antistatic Prevention Measures

    Before you begin, complete these tasks: Read the section, “Safety Information” on page ■ Power off the server using one of the methods described in the section, ■ Off the System” on page “Extend the Server to the Maintenance Position” on page 70 ■...
  • Page 96 Caution – If the top cover is removed before the server is powered off, the server will immediately disable the front panel Power button and shut down. After such an event, you must replace the top cover and use the poweron command to power on the server.

  • Page 97: Servicing Customer-Replaceable Units

    Servicing Customer-Replaceable Units These topics describe how to service customer-replaceable units (CRUs) in the server. Topic Read and learn about components which can be serviced while the system is in operation. Remove, install and add hard drives. Remove and install fan trays.

  • Page 98: Servicing Hard Drives

    To hot-plug a drive you must take the drive offline before you can safely remove it. Taking a drive offline prevents any applications from accessing it, and removes the logical software links to it. SPARC Enterprise T5440 Server Service Manual • June 2011...

  • Page 99: Remove A Hard Drive (Hot-Plug)

    If the hard drive cannot be logically isolated from the online operations of the ■ server. If your drive falls into one of these conditions, you must power off the server before you replace the hard drive. Related Information “Identifying Server Components” on page 1 ■...
  • Page 100 Caution – The latch is not an ejector. Do not bend the latch too far. Doing so can damage the latch. 5. Grasp the latch and pull the drive out of the drive slot. SPARC Enterprise T5440 Server Service Manual • June 2011...

  • Page 101: Install A Hard Drive (Hot-Plug)

    ---------------------------- ▼ Install a Hard Drive (Hot-Plug) Installing a hard drive into the server is a two-step process. You must first install a hard drive into the desired drive slot. Then you must configure that drive to the server.
  • Page 102 Type: # cfgadm -al This command should identify the Ap_id for the hard drive that you installed. The drive you installed should be is configured. SPARC Enterprise T5440 Server Service Manual • June 2011 EXAMPLE: Sample Ap_id Output on...

  • Page 103: Remove A Hard Drive

    Before you begin, complete these tasks: Read the section, ■ Power off the server, using one of the methods described in the section, ■ Off the System” on page “Perform Electrostatic Discharge – Antistatic Prevention Measures” on page 73 ■...

  • Page 104: Install A Hard Drive

    Hard drives are physically addressed according to the slot in which they are installed. If you removed an existing hard drive from a slot in the server, you must install the replacement drive in the same slot as the drive that was removed.

  • Page 105: Hard Drive Device Identifiers

    4. If you performed any additional service procedures, see on page 157. Hard Drive Device Identifiers The following table lists physical drive locations and their corresponding default path names in OpenBoot PROM and Solaris for the server. Device Device Identifier HDD0 /SYS/HDD0...

  • Page 106: Hard Drive Leds

    ■ “Install a Fan Tray” on page 88 ■ “Fan Tray Device Identifiers” on page 88 ■ SPARC Enterprise T5440 Server Service Manual • June 2011 Color Notes Blue This LED is lit to indicate that a hard drive can be removed safely during a hot-plug operation.

  • Page 107: About Fan Trays

    ■ About Fan Trays Four fan trays are located toward the front of the server, arranged in two N+1 redundant pairs. Each fan tray contains a fan mounted in an integrated, hot-swappable CRU. If a fan tray fails, replace it as soon as possible to maintain server availability.

  • Page 108: Install A Fan Tray (Hot-Swap)

    “Slide the Server Into the Rack” on page 155 ■ If you performed any additional service procedures, see ■ page 157. SPARC Enterprise T5440 Server Service Manual • June 2011 “Power On the Server” on...

  • Page 109: Remove A Fan Tray

    Before you begin, complete these tasks: Read the section, “Safety Information” on page ■ Power off the server, using one of the methods described in the section, ■ Off the System” on page Perform the task, “Extend the Server to the Maintenance Position” on page 70 ■...

  • Page 110: Install A Fan Tray

    Device Related Information “Managing Faults” on page 11 ■ “Hot-Pluggable and Hot-Swappable Devices” on page 75 ■ “Fan Tray Fault LED” on page 89 ■ SPARC Enterprise T5440 Server Service Manual • June 2011 Device Identifier /SYS/MB/FT0 /SYS/MB/FT1 /SYS/MB/FT2 /SYS/MB/FT3...

  • Page 111: Fan Tray Fault Led

    Fan Tray Fault LED Each fan tray contains a Fault LED that is located on the top panel of the server. The LED is visible when you slide the server partially out of the rack. Fault The front panel Fan Fault LED, and the front and rear panel Service Required LEDs are also lit if the system detects a fan tray fault.

  • Page 112: About Power Supplies

    See “Detecting Faults” on page 2. Gain access to the rear of the server where the faulty power supply is located. If necessary, slide the system partially out of the rack to obtain better access to the rear panel.

  • Page 113: Install A Power Supply (Hot-Swap)

    4. Grasp the power supply handle and press the release latch. 5. Pull the power supply out of the chassis. ▼ Install a Power Supply (Hot-Swap) 1. Align the replacement power supply with the empty power supply bay. 2. Slide the power supply into the bay until it is fully seated. Servicing Customer-Replaceable Units...

  • Page 114: Remove A Power Supply

    ▼ Remove a Power Supply Caution – Hazardous voltages are present. To reduce the risk of electric shock and danger to personal health, follow the instructions. SPARC Enterprise T5440 Server Service Manual • June 2011 “Rear Panel LEDs” on page 8 for more...

  • Page 115: Install A Power Supply

    Before you begin, complete these tasks: Read the section, “Safety Information” on page ■ Power off the server, using one of the methods described in the section, ■ Off the System” on page “Disconnect Power Cords From the Server” on page 68 ■...

  • Page 116: Power Supply Device Identifiers

    “Connect the Power Cords to the Server” on page 157 ■ “Power On the Server” on page 157 ■ Power Supply Device Identifiers These are the FRU device names for power supplies: Device SPARC Enterprise T5440 Server Service Manual • June 2011 Device Identifier /SYS/PS0 /SYS/PS1 /SYS/PS2 /SYS/PS3...

  • Page 117: Power Supply Led

    Fault The following LEDs are lit when a power supply fault is detected: Front and rear Service Required LEDs ■ Rear PS Failure LED on the bezel of the server ■ Fault LED mode on the faulty power supply ■...

  • Page 118: Servicing Pcie Cards

    ■ Do the following : 1. Identify the PCIe card you want to remove. 2. Open the PCIe card latch. SPARC Enterprise T5440 Server Service Manual • June 2011 for specific information about power supply “Safety Information” on page “Powering...

  • Page 119: Install A Pcie Card

    3. Remove the PCIe card the system. 4. Place the PCIe card on an antistatic mat. 5. If you are not replacing the PCIe card, install a PCIe filler panel in its place. 6. Close the PCIe card latch. ▼ Install a PCIe Card 1.

  • Page 120: Add A Pcie Card

    “Remove the Top Cover” on page 73 ■ 1. Identify the correct slot for installation. “PCIe Device Identifiers” on page 99 Guidelines” on page SPARC Enterprise T5440 Server Service Manual • June 2011 “Safety Information” on page “PCIe Slot Configuration 100. “Powering...

  • Page 121: Pcie Device Identifiers

    4. Insert the PCIe card into its slot. 5. Close the PCIe card latch. Next Steps “Install the Top Cover” on page 154 ■ “Slide the Server Into the Rack” on page 155 ■ “Power On the Server” on page 157 ■ PCIe Device Identifiers Device identifiers are case-sensitive.

  • Page 122: Pcie Slot Configuration Guidelines

    If you are installing a XAUI card in XAUI Port 1, the onboard NET0 port ■ is disabled. SPARC Enterprise T5440 Server Service Manual • June 2011 Device Identifier Notes /SYS/MB/PCIE5 or x8 slot; shared with XAUI slot...
  • Page 123 Use the following guidelines to spread the load evenly across CMP/memory modules. If a slot is already populated with a device, install a new device in the next available slot, in the order indicated. Number of CMP/Memory PCIe/XAUI Card Type Modules 10 GBit Ethernet (XAUI) 1, 2, 3 or 4...

  • Page 124: Servicing Cmp/Memory Modules

    A faulty CMP or memory module is indicated with an alluminated fault LED. An alluminated module LED also might indicate a faulty FB-DIMM on that module. SPARC Enterprise T5440 Server Service Manual • June 2011...
  • Page 125 Related Information “CMP and Memory Module Device Identifiers” on page 107 ■ “Supported CMP/Memory Module Configurations” on page 107 ■ “I/O Connections to CMP/Memory Modules” on page 160 ■ “Reconfiguring I/O Device Nodes” on page 162 ■ “Servicing FB-DIMMs” on page 108 ■...

  • Page 126: Remove A Cmp/Memory Module

    2. Rotate the ejector levers up and away from the module. 3. Slide the module up and out of the system. 4. Place the module on an antistatic mat. SPARC Enterprise T5440 Server Service Manual • June 2011 “Safety Information” on page “Powering...

  • Page 127: Install A Cmp/Memory Module

    3. Rotate the ejector levers down to secure the module into place. Next Steps “Install the Top Cover” on page 154 ■ “Slide the Server Into the Rack” on page 155 ■ “Power On the Server” on page 157 ■...
  • Page 128 5. Rotate the ejector levers down to secure the module into place. Next Steps “Install the Top Cover” on page 154 ■ “Slide the Server Into the Rack” on page 155 ■ “Power On the Server” on page 157 ■ SPARC Enterprise T5440 Server Service Manual • June 2011 “Powering...

  • Page 129: Cmp And Memory Module Device Identifiers

    “FB-DIMM Configuration” on page 113 ■ “Performing Node Reconfiguration” on page 159 ■ Supported CMP/Memory Module Configurations These are the supported CMP/memory module configurations, as viewed from the front of the server. CMP3 Configuration MEM3 One CMP/memory pair Two CMP/memory pairs...

  • Page 130: Servicing Fb-Dimms

    “Remove a CMP/Memory Module” on page 104 ■ Do the following: 1. If you are removing a faulty FB-DIMM, determine which FB-DIMM you want to remove. SPARC Enterprise T5440 Server Service Manual • June 2011 CMP3 CMP1 MEM3 MEM1 “Safety Information” on page...

  • Page 131: Install Fb-Dimms

    Next Steps “Install a CMP/Memory Module” on page 105 ■ “Install the Top Cover” on page 154 ■ “Slide the Server Into the Rack” on page 155 ■ 117. Step 4 to remove any additional FB-DIMMs. for information about configuring Step 4 until all replacement FB-DIMMs are installed.

  • Page 132: Verify Fb-Dimm Replacement

    | sp_detected_fault faults/0 If the fault is still displayed by the show faulty command, then run the set command to enable the FB-DIMM and clear the fault. SPARC Enterprise T5440 Server Service Manual • June 2011 Step | Value | /SYS/MB/CPU0/CMP0/BR0/CH1/D0...
  • Page 133 Are you sure you want to start /SYS (y/n)? y Starting /SYS Note – The server takes about one minute to power off. Use the show /HOST command to determine when the host has been powered off. The console will display status=Powered Off.
  • Page 134 6. Run the set command. -> set /SYS/MB/CPU0/CMP0/BR0/CH1/D0 clear_fault_action=True Are you sure you want to clear /SYS/MB/CPU0/CMP0/BR0/CH1/D0 (y/n)? y Set ’clear_fault_action’ to ’true SPARC Enterprise T5440 Server Service Manual • June 2011 for an approach to diagnose the fault. | Value | /SYS/MB/CPU0/CMP0/BR0/CH1/D0...

  • Page 135: Add Fb-Dimms

    “FB-DIMM Configuration” on page 113 ■ Identifiers” on page 116. Power off the server using one of the methods described in the section, ■ Off the System” on page “Extend the Server to the Maintenance Position” on page 70 ■...

  • Page 136: Supported Fb-Dimm Configurations

    Configuration 4 4 x 4 GByte Configuration 5 4 x 4 GByte SPARC Enterprise T5440 Server Service Manual • June 2011 Banks 2 and 3 must be either completely empty or completely filled. If filled, they must have the FB-DIMMs of the same capacity as Banks 0 and 1 Memory Module (Includes Memory Banks 1, 2 and 3.)
  • Page 137 Bank 1, if filled, must contain FB-DIMMs of the same capacity as Bank 0 CPU Module (Includes Memory Bank 0) Configuration Number Memory Bank 0 Configuration 6 4 x 4 GByte Configuration 7 4 x 8 GByte Configuration 8 4 x 8 GByte Configuration 9 4 x 8 GByte Supported FB-DIMM Configurations...

  • Page 138: Fb-Dimm Device Identifiers

    These are the device and device identifiers for FB-DIMMs on a CMP and memory module pair. Device identifiers are case-sensitive. Location CMP module Memory module SPARC Enterprise T5440 Server Service Manual • June 2011 FB-DIMM Device Identifiers /SYS/MB/CPUx/CMPx/BR1/CH0/D0 /SYS/MB/CPUx/CMPx/BR1/CH1/D0 /SYS/MB/CPUx/CMPx/BR0/CH0/D0...

  • Page 139: Fb-Dimm Fault Button Locations

    Location FB-DIMM Device Identifiers /SYS/MB/MEMx/CMPx/BR0/CH1/D /SYS/MB/MEMx/CMPx/BR0/CH0/D /SYS/MB/MEMx/CMPx/BR1/CH1/D /SYS/MB/MEMx/CMPx/BR1/CH0/D Motherboard connector The FB-DIMM address follows the same convention as the CMP or memory module upon which it is mounted. For example, /SYS/MB/CPU0/CMP0/BR1/CH0/D0 is the device identifier for the FB-DIMM mounted at J792 on CMP module 0. Related Information “Managing Faults”...
  • Page 140 Related Information “Managing Faults” on page 11 ■ “FB-DIMM Configuration” on page 113 ■ “FB-DIMM Device Identifiers” on page 116 ■ SPARC Enterprise T5440 Server Service Manual • June 2011...

  • Page 141: Servicing Field-Replaceable Units

    Servicing Field-Replaceable Units These topics describe how to service field-replaceable units (FRUs) in the server. Note – The procedures in this chapter must be performed by a qualified service technician. Topic Remove and install field-replaceable components. Exploded views of FRUs Servicing the Front Bezel You must remove the front bezel in order to service the DVD-ROM drive.

  • Page 142: Remove The Front Bezel

    1. Grasp the front bezel on the left and right sides. 2. Pull the bezel off of the front of the chassis. The bezel is secured with three snap-in posts. SPARC Enterprise T5440 Server Service Manual • June 2011 “Safety Information” on page “Powering Off the System” on...

  • Page 143: Install The Front Bezel

    2. Press the bezel onto the front panel. The bezel is oriented with four guide pins, and is secured with three snap-in posts. Next Steps “Slide the Server Into the Rack” on page 155 ■ If you performed any additional service procedures, see ■...

  • Page 144: Servicing The Dvd-Rom Drive

    2. Unplug the DVD-ROM drive from the flex cable assembly. 3. Push the DVD-ROM drive forward until it protrudes from the front of the chassis. SPARC Enterprise T5440 Server Service Manual • June 2011 “Safety Information” on page “Powering...

  • Page 145: Install The Dvd-Rom Drive

    Place the retainer into position and tighten the captive No. 2 Phillips screw. Next Steps “Install the Front Bezel” on page 121 ■ “Install the Top Cover” on page 154 ■ “Slide the Server Into the Rack” on page 155 ■ Servicing Field-Replaceable Units...

  • Page 146: Servicing The Service Processor

    1. Ensure that the power cords are disconnected from the server. 2. Loosen the two captive No. 2 Phillips screws securing the service processor to the motherboard. SPARC Enterprise T5440 Server Service Manual • June 2011 “Safety Information” on page “Powering...
  • Page 147 3. Lift the service processor up and out of the system. 4. Place the service processor on an antistatic mat. Next Steps If you are replacing a faulty service processor, you must install the IDPROM onto the new service processor. Do the following: Remove the IDPROM from the old service processor.

  • Page 148: Install The Service Processor

    3. Press down evenly to plug the service processor into the motherboard. 4. Secure the service processor with the two captive No.2 Phillips screws. Next Steps “Install the Top Cover” on page 154 ■ SPARC Enterprise T5440 Server Service Manual • June 2011 “Install the IDPROM” on...

  • Page 149: Servicing The Idprom

    Before you begin, complete these tasks: Read the section, “Safety Information” on page ■ Power off the server, using one of the methods described in the section, ■ Off the System” on page “Extend the Server to the Maintenance Position” on page 70 ■...

  • Page 150: Install The Idprom

    “Perform Electrostatic Discharge – Antistatic Prevention Measures” on page 73 ■ “Remove the Top Cover” on page 73 ■ “Remove the Service Processor” on page 124 ■ SPARC Enterprise T5440 Server Service Manual • June 2011 “Safety Information” on page “Powering...

  • Page 151: Servicing The Battery

    Before you begin, complete these tasks: Read the section, “Safety Information” on page ■ Power off the server, using one of the methods described in the section, ■ Off the System” on page “Extend the Server to the Maintenance Position” on page 70 ■...

  • Page 152: Install The Battery

    “Disconnect Power Cords From the Server” on page 68 ■ “Extend the Server to the Maintenance Position” on page 70 ■ “Remove a Power Supply” on page 92 ■ SPARC Enterprise T5440 Server Service Manual • June 2011 “Safety Information” on page “Powering...
  • Page 153 Note – You must remove all four power supplies from the system. “Perform Electrostatic Discharge – Antistatic Prevention Measures” on page 73 ■ “Remove the Top Cover” on page 73 ■ Do the following: 1. Remove the flex cable retainer. Loosen the captive No.

  • Page 154: Install The Power Distribution Board

    “Slide the Server Into the Rack” on page 155 ■ “Install a Power Supply” on page 93 ■ Note – Install all four power supplies. “Connect the Power Cords to the Server” on page 157 ■ SPARC Enterprise T5440 Server Service Manual • June 2011...

  • Page 155: Servicing The Fan Tray Carriage

    Before you begin, complete these tasks: Read the section, “Safety Information” on page ■ Power off the server using one of the methods described in the section, ■ Off the System” on page “Extend the Server to the Maintenance Position” on page 70 ■...

  • Page 156: Install The Fan Tray Carriage

    3. Lift the fan tray carriage up and out of the system. ▼ Install the Fan Tray Carriage 1. Lower the fan tray carriage into the system. SPARC Enterprise T5440 Server Service Manual • June 2011...

  • Page 157: Servicing The Hard Drive Backplane

    “Install a Fan Tray” on page 88 ■ Note – Install all four fan trays. “Install the Top Cover” on page 154 ■ “Slide the Server Into the Rack” on page 155 ■ “Power On the Server” on page 157 ■ Servicing the Hard Drive Backplane The hard drive backplane provides the power and data interconnect to the internal hard drives.

  • Page 158: Remove The Hard Drive Backplane

    “Remove a Hard Drive” on page 81 ■ Note – You must remove all four hard drives from the server. Note the location of each hard drive you remove. You must re-install each hard drive in the correct bay. “Remove a Fan Tray” on page 87 ■...

  • Page 159: Install The Hard Drive Backplane

    4. Lift the backplane up and out of the system. ▼ Install the Hard Drive Backplane 1. Lower the hard drive backplane into the system. Align the tab on the lower edge the backplane with the corresponding slot in the chassis floor.
  • Page 160 ■ Note – You must install the hard drives in the correct slots. “Slide the Server Into the Rack” on page 155 ■ “Power On the Server” on page 157 ■ SPARC Enterprise T5440 Server Service Manual • June 2011...

  • Page 161: Servicing The Motherboard

    Before you begin, complete these tasks: Read the section, “Safety Information” on page ■ Power off the server, using one of the methods described in the section, ■ Off the System” on page “Disconnect Power Cords From the Server” on page 68 ■...
  • Page 162 “Remove the Fan Tray Carriage” on page 133 ■ 1. Remove the CMP/memory module bracket. The bracket is secured with six captive No. 2 Phillips screws. See Fastener Locations” on page SPARC Enterprise T5440 Server Service Manual • June 2011 143. “Motherboard...
  • Page 163 2. Remove the flex cable retainer. Loosen the captive No.2 Phillips screw and lift the retainer up and out of the chassis. 3. Unplug the flex cable from J9801 on the motherboard. 4. Unplug the auxiliary power cable from J9803 on the motherboard. 5.

  • Page 164: Install The Motherboard

    9. Install the flex cable retainer. Place the retainer into position and tighten the captive No. 2 Phillips screw. 10. Plug in the front I/O cable to J9901. SPARC Enterprise T5440 Server Service Manual • June 2011 “Motherboard Fastener Locations” on...

  • Page 165: Motherboard Fastener Locations

    “Install the Top Cover” on page 154 ■ “Install the Server Into the Rack” on page 154 ■ “Connect the Power Cords to the Server” on page 157 ■ “Power On the Server” on page 157 ■ Motherboard Fastener Locations This figure shows the location of the captive screws that secure the motherboard to the chassis floor.

  • Page 166: Servicing The Flex Cable Assembly

    The flex cable assembly provides the power and data connection between the power supply backplane, hard drive backplane, and motherboard. This topic includes the following: “Remove the Flex Cable Assembly” on page 145 ■ “Install the Flex Cable Assembly” on page 146 ■ SPARC Enterprise T5440 Server Service Manual • June 2011...

  • Page 167: Remove The Flex Cable Assembly

    Before you begin, complete these tasks: Read the section, “Safety Information” on page ■ Power off the server, using one of the methods described in the section, ■ Off the System” on page “Extend the Server to the Maintenance Position” on page 70 ■...

  • Page 168: Install The Flex Cable Assembly

    1. Ensure the power cables are unplugged. 2. Plug in the motherboard connector. 3. Plug in the hard drive backplane connector. 4. Plug in the DVD-ROM drive connector. 5. Plug in the power supply backplane connector. SPARC Enterprise T5440 Server Service Manual • June 2011...
  • Page 169 Place the retainer into position and tighten the captive No. 2 Phillips screw. 7. Plug in the power cables. Next Steps “Install the Top Cover” on page 154 ■ “Slide the Server Into the Rack” on page 155 ■ “Power On the Server” on page 157 ■ Servicing Field-Replaceable Units...

  • Page 170: Servicing The Front Control Panel

    1. Unplug the front control panel cable from J9901 on the motherboard. 2. Unplug the front control panel cable from the front I/O board. 3. Remove the two No. 2 Phillips screws. SPARC Enterprise T5440 Server Service Manual • June 2011 “Safety Information” on page “Powering...

  • Page 171: Install The Front Control Panel

    4. Lift the front control panel up and out of the system. 5. Place the front control panel on an antistatic mat. ▼ Install the Front Control Panel 1. Lower the front control panel into the system. Servicing Field-Replaceable Units...

  • Page 172: Servicing The Front I/O Board

    Power off the server, using one of the methods described in the section, ■ Off the System” on page “Disconnect Power Cords From the Server” on page 68 ■ SPARC Enterprise T5440 Server Service Manual • June 2011 “Safety Information” on page “Powering...

  • Page 173: Install The Front I/O Board

    “Remove the Server From the Rack” on page 71 ■ “Perform Electrostatic Discharge – Antistatic Prevention Measures” on page 73 ■ “Remove the Top Cover” on page 73 ■ “Remove a Fan Tray” on page 87 ■ “Remove the Fan Tray Carriage” on page 133 ■...
  • Page 174 “Install the Top Cover” on page 154 ■ “Install the Server Into the Rack” on page 154 ■ “Connect the Power Cords to the Server” on page 157 ■ “Power On the Server” on page 157 ■ SPARC Enterprise T5440 Server Service Manual • June 2011...

  • Page 175: Returning The Server To Operation

    Returning the Server to Operation These topics describe how to return the server to operation after you have performed service procedures. Caution – Never attempt to run the server with the cover removed. Hazardous voltage is present. Caution – Equipment damage could occur if you run the server with the cover removed.

  • Page 176: Install The Top Cover

    Server” on page 1. Place the top cover on the chassis. Set the cover down so that it hangs over the rear of the server by about an inch (25.4 mm). 2. Slide the top cover forward until it seats.

  • Page 177: Slide The Server Into The Rack

    2. Lift the server up and insert the inner rails into the inner slide assemblies. Ensure that the inner rails are horizontal when the inner rails enter the inner slide assemblies. 3. Ensure that the inner rails are engaged with the ball-bearing retainers on both inner slide assemblies.
  • Page 178 4. Reconnect the cables to the back of the server. If the CMA is in the way, slide the server partially out of the cabinet to access the necessary rear panel connections. SPARC Enterprise T5440 Server Service Manual • June 2011...

  • Page 179: Connect The Power Cords To The Server

    Note – As soon as the power cords are connected, standby power is applied. Depending on the configuration of the firmware, the system might boot. See the SPARC Enterprise T5440 Server Administration Guide for configuration and power-on information. ▼ Power On the Server ●...
  • Page 180 SPARC Enterprise T5440 Server Service Manual • June 2011...

  • Page 181: Performing Node Reconfiguration

    Performing Node Reconfiguration If a CMP/memory module pair develops a fault, the server can be reconfigured to run in a degraded state until the CMP/memory module is replaced. In addition, you can add CMP/memory module pairs to existing systems. However, adding or...

  • Page 182: I/O Connections To Cmp/Memory Modules

    “System Bus Topology” on page 167 ■ “I/O Fabric in 2P Configuration” on page 168 ■ “I/O Fabric in 4P Configuration” on page 169 ■ SPARC Enterprise T5440 Server Service Manual • June 2011 CMP Number on page 168 for more information.

  • Page 183: Recovering From A Failed Cmp/Memory Module

    Recovering From a Failed CMP/Memory Module This topic includes the following: “Options for Recovering From a Failed CMP/Memory Module” on page 161 ■ “Reconfiguring I/O Device Nodes” on page 162 ■ “Reset the LDoms Guest Configuration” on page 166 ■ Options for Recovering From a Failed CMP/Memory Module If your system experiences a complete CMP/memory module failure, do one of the...

  • Page 184: Reconfiguring I/O Device Nodes

    “Re-Enable All Memory Modules” on page 165 ■ “Reset the LDoms Guest Configuration” on page 166 ■ SPARC Enterprise T5440 Server Service Manual • June 2011 “I/O Fabric in 2P Configuration” on page 168 in one of the following circumstances: “I/O...

  • Page 185: Reconfigure The I/O And Pcie Fabric

    CMP modules and the PCIe devices and slots. Use the reconfig.pl script to reattach each PCIe slot and onboard device to its nearest available CMP module. To use the reconfig.pl, you must have the following: Solaris OS JumpStart server ■ Net install image ■...

  • Page 186: Temporarily Disable All Memory Modules

    FB-DIMMs located on all memory modules using the disablecomponent command. To remove the memory modules from the system, see the instructions in the SPARC Enterprise T5440 Server Service Manual. SPARC Enterprise T5440 Server Service Manual • June 2011...

  • Page 187: Re-Enable All Memory Modules

    To remotely disable all FB-DIMMs in the system, do the following: 1. Halt the Solaris OS. 2. Power off the system. 3. Disable each FB-DIMM. sc> disablecomponent /SYS/MB/MEMx/CMPx/BR0/CH0/D1 sc> disablecomponent /SYS/MB/MEMx/CMPx/BR0/CH0/D2 sc> disablecomponent /SYS/MB/MEMx/CMPx/BR1/CH1/D3 where x is the memory module to be disabled. The following example shows how to disable all the FB-DIMMs on MEM1.

  • Page 188: Reset The Ldoms Guest Configuration

    1. Power off the system. 2. In the ALOM compatibility shell, type: sc> bootmode config="factory-default" 3. Power on the system. 4. Recreate your LDoms guests using the remaining hardware resources. SPARC Enterprise T5440 Server Service Manual • June 2011...

  • Page 189: System Bus Topology

    System Bus Topology Related Information “I/O Fabric in 2P Configuration” on page 168 ■ “I/O Fabric in 4P Configuration” on page 169 ■ Performing Node Reconfiguration...

  • Page 190: I/O Fabric In 2P Configuration

    CMP1 Related Information “System Bus Topology” on page 167 ■ “I/O Fabric in 4P Configuration” on page 169 ■ SPARC Enterprise T5440 Server Service Manual • June 2011 Devices Controlled Onboard disk drives Onboard USB ports Onboard DVD drive PCIe0...

  • Page 191: I/O Fabric In 4P Configuration

    I/O Fabric in 4P Configuration CMP Number Devices Controlled CMP0 Onboard disk drives Onboard USB ports Onboard DVD drive PCIe0 PCIe1 CMP1 Onboard Gbit or 10-Gbit network PCIe4 PCIe5 CMP2 PCIe2 PCIe3 CMP3 PCIe6 PCIe7 Related Information “System Bus Topology” on page 167 ■...
  • Page 192 SPARC Enterprise T5440 Server Service Manual • June 2011...

  • Page 193: Identifying Connector Pinouts

    “Serial Management Port Connector Pinouts” on page 172 connector pinouts “Network Management Port Connector Pinouts” on page 173 “Serial Port Connector Pinouts” on page 174 “USB Connector Pinouts” on page 175 “Gigabit Ethernet Connector Pinouts” on page 176 Related Information “Identifying Server Components” on page 1 ■...

  • Page 194: Serial Management Port Connector Pinouts

    This port is the default connection to the system console. Signal Description Request to Send Data Terminal Ready Transmit Data Ground SPARC Enterprise T5440 Server Service Manual • June 2011 Signal Description Ground Receive Data Data Set Ready Clear to Send...

  • Page 195: Network Management Port Connector Pinouts

    Network Management Port Connector Pinouts The network management connector (labeled NET MGT) is an RJ-45 connector located on the motherboard and can be accessed from the back panel. This port needs to be configured prior to use. Signal Description Transmit Data + Transmit Data –...

  • Page 196: Serial Port Connector Pinouts

    The serial port connector (TTYA) is a DB-9 connector that can be accessed from the back panel. Signal Description Data Carrier Detect Receive Data Transmit Data Data Terminal Ready Ground SPARC Enterprise T5440 Server Service Manual • June 2011 Signal Description Data Set Ready Request to Send Clear to Send Ring Indicate...

  • Page 197: Usb Connector Pinouts

    USB Connector Pinouts Two Universal Serial Bus (USB) ports are located on the motherboard in a double-stacked layout and can be accessed from the back panel. Two additional USB ports are located on the front panel. Signal Description +5 V (fused) USB0/1- USB0/1+ Ground...

  • Page 198: Gigabit Ethernet Connector Pinouts

    Signal Description Transmit/Receive Data 0 + Transmit/Receive Data 0 – Transmit/Receive Data 1 + Transmit/Receive Data 2 + SPARC Enterprise T5440 Server Service Manual • June 2011 Signal Description Transmit/Receive Data 2 – Transmit/Receive Data 1 – Transmit/Receive Data 3 +...

  • Page 199: Server Components

    Server Components These topics provide illustrations depicting components of SPARC Enterprise T5440 server. Description A diagram and list of customer replaceable units (CRUs) A diagram and list of components that only field service personnel can replace. Related Information “Identifying Server Components” on page 1 ■...

  • Page 200: Customer-Replaceable Units

    Customer-Replaceable Units Customer-Replaceable Units (CRUs) FIGURE: Figure Legend CMP modules Memory modules Fan trays Removable media drive SPARC Enterprise T5440 Server Service Manual • June 2011 Front bezel Hard drives Power supplies...
  • Page 201 “Servicing Fan Trays” on page 84 ■ “Servicing Power Supplies” on page 89 ■ “Servicing CMP/Memory Modules” on page 102 ■ “Servicing FB-DIMMs” on page 108 ■ “Servicing the Front Bezel” on page 119 ■ “Servicing the DVD-ROM Drive” on page 122 ■ Server Components...

  • Page 202: Field-Replaceable Units

    Field-Replaceable Units Field-Replaceable Units (FRUs) FIGURE: Figure Legend CMP/memory module bracket Fan cage Hard drive backplane SPARC Enterprise T5440 Server Service Manual • June 2011 Power supply backplane Flex cable assembly Auxiliary power cable...
  • Page 203 Front I/O Board Related Information “Servicing the Service Processor” on page 124 ■ “Servicing the IDPROM” on page 127 ■ “Servicing the Battery” on page 129 ■ “Servicing the Power Distribution Board” on page 130 ■ Motherboard Battery Service Processor Server Components...
  • Page 204 “Servicing the Motherboard” on page 139 ■ “Servicing the Flex Cable Assembly” on page 144 ■ “Servicing the Front Control Panel” on page 148 ■ “Servicing the Front I/O Board” on page 150 ■ SPARC Enterprise T5440 Server Service Manual • June 2011...

  • Page 205: Index

    Index Numerics 3.3V standby (power supply rail), 2 AC Present (power supply LED), 15, 95 adding CMP/memory module, 105 FB-DIMMs, 113 PCIe card, 98 addresses, device and system configuration, 160 advanced ECC technology, 24 Advanced Lights Out Management (ALOM) CMT connecting to, 25 airflow, blocked, 16 antistatic wrist strap, 65...
  • Page 206 Oracle VTS, 42 External I/O Expansion Unit fault detected by show faulty command, 38 faults detection in, 18 SPARC Enterprise T5440 Server Service Manual • June 2011 Fan Fault (system LED) interpreting to diagnose faults, 35 fan tray, 87...
  • Page 207 example POST error output, 46 fault handling, 24 installing, 109 managing faults in, 110 re-enabling to run system in degraded state, 165 removing, 108 troubleshooting, 24 verifying successful replacement, 110 flex cable assembly installing, 146 removing, 145 fmadm command, 54, 112 fmdump command, 49 front bezel installing, 121...
  • Page 208 Locator LED and button, 3, 5, 6, 8 log files, viewing, 40 logical domains guest configuration, 166 SPARC Enterprise T5440 Server Service Manual • June 2011 MAC addresses, stored on SCC module, 2 maintenance position, 69, 71 memory fault handling, 24...
  • Page 209 ILOM, 36 memory faults, 24 PSH, See Predictive Self-Healing (PSH) quick visual notification, 12 rack extending server to maintenance position, 69 slide rail, 70 Ready-to-Remove (hard drive LED), 78, 80 rear panel access, 6 reconfig.pl script, 163...
  • Page 210 15 using to diagnose FB-DIMMs, 110 using to verify successful FB-DIMM replacement, 112 showcomponent command, 27, 56 SPARC Enterprise T5440 Server Service Manual • June 2011 showenvironment command, 61 showfaults command syntax, 61 showfru command, 28, 61...
  • Page 211 Power OK LED state, 15 using LEDs, 34 using Oracle VTS, 15 using POST, 15, 17 using the show faulty command, 15 UltraSPARC T2+ multicore processor, 21 Universal Unique Identifier (UUID), 21, 49 USB ports front, 3 pinouts, 175 virtual keyswitch, 31, 111 XAUI card about, 1 configuration guidelines, See PCIe configuration...
  • Page 212 SPARC Enterprise T5440 Server Service Manual • June 2011...

Table of Contents