SPARC Enterprise T2000 Server ® Service Manual Manual Code : C120-E377-01EN Part No. 875-4036-10 April 2007...
Page 4
Fujitsu Limited or Sun Microsystems, Inc., or any affiliate of either of them.
Page 5
Aucune partie de ce produit, de ces technologies ou de ce document ne peut être reproduite sous quelque forme que ce soit, par quelque moyen que ce soit, sans l’autorisation écrite préalable de Fujitsu Limited et de Sun Microsystems, Inc., et de leurs éventuels bailleurs de licence.
Safety Information 1–1 Safety Symbols 1–1 Electrostatic Discharge Safety 1–2 1.3.1 Using an Antistatic Wrist Strap 1–2 1.3.2 Using an Antistatic Mat 1–2 Server Overview 2–1 Server Features 2–2 2.1.1 Chip Multitheaded Multicore Processor and Memory Technology 2–2 2.1.2 Performance Enhancements 2–3 2.1.3...
Page 8
Using ALOM CMT for Diagnosis and Repair Verification 3–16 3.3.1 3.3.2 3.3.3 3.3.4 Running POST 3–26 3.4.1 3.4.2 SPARC Enterprise T2000 Server Service Manual • April 2007 Predictive Self-Healing 2–8 Memory Configuration and Fault Handling 3–6 3.1.1.1 Memory Configuration 3–6 3.1.1.2 Memory Fault Handling 3–7 3.1.1.3 Troubleshooting Memory Faults 3–8...
Page 9
3.4.3 Reasons to Run POST 3–31 3.4.3.1 3.4.3.2 3.4.4 Running POST in Maximum Mode 3–32 3.4.5 Correctable Errors Detected by POST 3–36 3.4.5.1 3.4.5.2 3.4.6 Clearing POST Detected Faults 3–39 Using the Solaris Predictive Self-Healing Feature 3–40 3.5.1 Identifying PSH Detected Faults 3–41 3.5.1.1 3.5.2 Clearing PSH Detected Faults 3–44...
Page 10
5.2.3 5.2.4 5.2.5 5.2.6 5.2.7 viii SPARC Enterprise T2000 Server Service Manual • April 2007 Replacing a Fan 4–4 Removing a Power Supply 4–4 Replacing a Power Supply 4–6 Removing the Rear Blower 4–7 Replacing the Rear Blower 4–7 Removing a Hard Drive 4–9 Replacing a Hard Drive 4–10...
Page 11
Replacing the Top Cover 5–42 5.3.3 Reinstalling the Server Chassis in the Rack 5–42 5.3.4 Returning the Server to the Normal Rack Position 5–43 5.3.5 Applying Power to the Server 5–45 Adding New Components and Devices 6–1 Adding Hot-Pluggable and Hot-Swappable Devices 6–1 6.1.1...
Page 12
6.2.3 6.2.4 A. Field-Replaceable Units A–1 Illustrated FRU Locations A–2 Index Index–1 SPARC Enterprise T2000 Server Service Manual • April 2007 PCI Express or PCI-X Card Guidelines 6–7 Adding a PCI-Express or PCI-X Card 6–7...
Page 13
Figures Server 2–2 FIGURE 2-1 Motherboard and UltraSPARC T1 Multicore Processor 2–3 FIGURE 2-2 Server Front Panel 2–9 FIGURE 2-3 Server Rear Panel 2–9 FIGURE 2-4 Diagnostic Flow Chart 3–3 FIGURE 3-1 Front Panel LEDs 3–9 FIGURE 3-2 Rear Panel LEDs 3–9 FIGURE 3-3 Hard Drive LEDs 3–11...
Page 14
Removing the Front I/O Board 5–36 FIGURE 5-24 Removing the SAS Disk Backplane 5–38 FIGURE 5-25 Replacing the SAS Disk Backplane 5–39 FIGURE 5-26 Removing the Battery From the System Controller 5–40 FIGURE 5-27 SPARC Enterprise T2000 Server Service Manual • April 2007...
Page 15
Replacing the Battery in the System Controller 5–40 FIGURE 5-28 Replacing the Top Front Cover 5–41 FIGURE 5-29 Returning the Server to the Rack 5–43 FIGURE 5-30 Release Levers 5–44 FIGURE 5-31 Installing the CMA 5–45 FIGURE 5-32 Hard Drive Slots 6–3 FIGURE 6-1 Adding a USB Device 6–4...
Page 16
SPARC Enterprise T2000 Server Service Manual • April 2007...
Page 17
TABLE 3-9 ALOM CMT Parameters and POST Modes 3–30 TABLE 3-10 ASR Commands 3–46 TABLE 3-11 Useful SunVTS Tests to Run on This Server 3–53 TABLE 3-12 DIMM Names and Socket Numbers 5–13 TABLE 5-1 DIMM Names and Socket Numbers 6–6...
Page 18
SPARC Enterprise T2000 Server Service Manual • April 2007...
Preface The SPARC Enterprise T2000 Server Service Manual provides information to aid in diagnosing hardware problems and describes how to replace components within the SPARC Enterprise T2000 server. This guide also describes how to add components such as hard drives and memory to the server.
Structure and Contents of This Manual This manual is organized as described below: Chapter 1 ■ Describes the safety precautions of the SPARC Enterprise T2000 server. Chapter 2 ■ Describes the main features of the SPARC Enterprise T2000 server. Chapter 3 ■...
Page 21
Japanese Site http://primeserver.fujitsu.com/sparcenterprise/manual/ Title SPARC Enterprise T2000 Server Product Notes SPARC Enterprise T2000 Server Site Planning Guide SPARC Enterprise T2000 Server Getting Started Guide SPARC Enterprise T2000 Server Overview Guide SPARC Enterprise T2000 Server Installation Guide SPARC Enterprise T2000 Server...
Typeface AaBbCc123 AaBbCc123 AaBbCc123 * The settings on your browser might differ from these settings. xx SPARC Enterprise T2000 Server Service Manual • April 2007 Meaning The names of commands, files and directories; on-screen computer output What you type, when contrasted...
Prompt Notations The following prompt notations are used in this manual. Shell C shell C shell superuser Bourne shell and Korn shell Bourne shell and Korn shell and Korn shell superuser Conventions for Alert Messages This manual uses the following conventions to show alert messages, which are intended to prevent injury to the user or bystanders as well as property damage, and important messages that are useful to the user.
Caution – The following tasks regarding this product and the optional products provided from Fujitsu should only be performed by a certified service engineer. Users must not perform these tasks. Incorrect operation of these tasks may cause malfunction. Unpacking optional adapters and such packages delivered to the users ■...
Page 25
Maintenance and inspections (repairing, and regular diagnosis and maintenance) ■ Caution – The following tasks regarding this product and the optional products provided from Fujitsu should only be performed by a certified service engineer. Users must not perform these tasks. Incorrect operation of these tasks may cause malfunction.
Fujitsu Welcomes Your Comments We would appreciate your comments and suggestions to improve this document. You can submit your comments by using "Reader's Comment Form." xxiv SPARC Enterprise T2000 Server Service Manual • April 2007 M6 Screws and Cage Nuts Attach stabilizer...
Page 28
FIRST-CLASS MAIL PERMIT NO 741 SUNNYVALE CA POSTAGE WILL BE PAID BY ADDRESSEE FUJITSU COMPUTER SYSTEMS AT TENTION ENGINEERING OPS M/S 249 1250 EAST ARQUES AVENUE P O BOX 3470 SUNNYVALE CA 94088-3470 FOLD AND TAPE xxvi SPARC Enterprise T2000 Server Service Manual • April 2007...
C H A P T E R Safety Information This chapter provides important safety information for servicing the server. The following topics are covered: Section 1.1, “Safety Information” on page 1-1 ■ Section 1.2, “Safety Symbols” on page 1-1 ■...
1.3.2 Using an Antistatic Mat Place ESD-sensitive components such as the motherboard, memory, and other PCB cards on an antistatic mat. SPARC Enterprise T2000 Server Service Manual • April 2007...
C H A P T E R Server Overview This chapter provides an overview of the features of the server. The following topics are covered: Section 2.1, “Server Features” on page 2-2 ■ Section 2.2, “Chassis Identification” on page 2-9...
Each core equates to a 64-bit execution pipeline capable of running four threads. The result is that the 8-core processor handles up to 32 active threads concurrently. SPARC Enterprise T2000 Server Service Manual • April 2007 ® T1 multicore processor is the basis of the server. The UltraSPARC...
UltraSPARC T1 multicore processor Motherboard and UltraSPARC T1 Multicore Processor FIGURE 2-2 2.1.2 Performance Enhancements The server introduces several new technologies with its sun4v architecture and multithreaded UltraSPARC T1 multicore processor. Some of these enhancements are: Large page optimization ■...
Page 34
Other internal peripherals USB ports Cooling PCI interfaces Power SPARC Enterprise T2000 Server Service Manual • April 2007 Description 1 UltraSPARC T1 multicore processor (4 or 8 cores) SPARC® V9 architecture, ECC protected Platform group: sun4v Platform name: SUNW, SPARC-Enterprise-T2000...
(such as device drivers) must also be provided for a PCI card to function in the server. Refer to the specifications and documentation for a given PCI card to determine if the required drivers are provided that enable the card to function in this server.
PSH automated run-time diagnosis capability that takes faulty components ■ offline. For more information about using RAS features, refer to the SPARC Enterprise T2000 Server Administration Guide. 2.1.4.1 Hot-Pluggable and Hot-Swappable Components The server hardware supports hot-plugging or hot-swapping of the chassis-mounted hard drives, fans, power supplies, and the rear blower.
The server features two hot-swappable power supplies, which enable the system to continue operating should a power supply or power sources fail. The server also has a single hot-swappable blower unit that works in conjunction with the power supply fans to provide cooling for the internal hard drives. If the blower unit fails, the two power supply fan units provide enough cooling for the hard drive bay to keep the server running.
By automatically diagnosing problems, business-critical applications and essential system services can continue uninterrupted in the event of software failures, or major hardware component failures. SPARC Enterprise T2000 Server Service Manual • April 2007...
Chassis Identification FIGURE 2-3 Indicators and buttons Server Front Panel FIGURE 2-3 Power supply 0 Server Rear Panel FIGURE 2-4 show the physical characteristics of the server. FIGURE 2-4 USB ports SC serial mgt port TTYA serial port Power PCI-E slot...
To obtain support for your system, you need your chassis serial number. The chassis serial number is located on a sticker that is on the front of the server and another sticker on the side of the server. You can also run the ALOM CMT showplatform command to obtain the chassis serial number.
Overview of Server Diagnostics You can use a variety of diagnostic tools, commands, and indicators to monitor and troubleshoot a server: LEDs Provide a quick visual notification of the status of the server and of some – ■ of the FRUs.
The flow chart assumes that you have already performed some troubleshooting such as verification of proper installation, and visual inspection of cables and power, and possibly performed a reset of the server (refer to the SPARC Enterprise T2000 Server Installation Guide and SPARC Enterprise T2000 Server Administration Guide for details).
• If SunVTS reports a faulty device replace the FRU. • If SunVTS does not report a faulty device, go to Action No. SPARC Enterprise T2000 Server Service Manual • April 2007 For more information, see these sections Section 3.2, “Using LEDs to Identify the State of Devices”...
Page 45
If the fault indicates that a fan, blower, or power supply is bad, you can perform a hot-swap of the FRU. You can also use the fault LEDs on the server to identify the faulty FRU (fans, blower, and power supplies).
This section describes how the memory is configured and how the server deals with memory faults. 3.1.1.1 Memory Configuration In the server memory there are 16 slots that hold DDR-2 memory DIMMs in the following DIMM sizes: 512 MB (maximum of 8 GB) ■...
3.1.1.2 Memory Fault Handling The server uses advanced ECC technology, also called chipkill, that corrects up to 4- bits in error on nibble boundaries, as long as the bits are all in the same DRAM. If a DRAM fails, the DIMM continues to function.
The six front panel LEDs ( server chassis. Three of these LEDs are also provided on the rear panel ( SPARC Enterprise T2000 Server Service Manual • April 2007 for DIMM removal and replacement instructions. ) are located in the upper left corner of the FIGURE 3-2 Section 5.2.3,...
Service Required Power OK Locator LED/button Front Panel LEDs FIGURE 3-2 Locator LED/button Rear Panel LEDs FIGURE 3-3 Power On/Off Rear-FRU Fault button Top Fan Service Power OK Required Chapter 3 Server Diagnostics Over Temp...
• Pressing the button to toggle the indicator on or off. This LED provides the following indications: • Off – Normal operating state. • Fast blink – The server received a signal as a result of one of the preceding methods and is indicating that it is operational. Amber If on, indicates that service is required.
Front and Rear Panel LEDs (Continued) TABLE 3-2 OverTemp 3.2.2 Hard Drive LEDs The hard drive LEDs ( drive that is installed in the server chassis. Hard Drive LEDs FIGURE 3-4 Hard Drive LEDs TABLE 3-3 OK to Remove Unused...
FIGURE 3-5 Power Supply LEDs TABLE 3-4 Power OK Failure AC OK 3-12 SPARC Enterprise T2000 Server Service Manual • April 2007 FIGURE 3-5 TABLE 3-4 Color Description Green • On – Normal operation. DC output voltage is within normal limits.
TABLE 3-5 Fan LEDs 3.2.5 Blower Unit LED The blower unit LED is located on the back of the blower unit and visible from the rear of the server ( FIGURE 3-6 Color Description Amber • On – This fan is faulty.
The ALOM CMT management Ethernet port and the four 10/100/1000 Mbps Ethernet ports each have two LEDs, as shown in TABLE 3-7 3-14 SPARC Enterprise T2000 Server Service Manual • April 2007 Color Description Amber • On – The blower unit is faulty.
• Blinking – There is activity on this port. • Off – No link is established. * The NET MGT port only operates in 100-Mbps or 10-Mbps so the speed indicator LED will be green or off (never amber). Chapter 3 Server Diagnostics 3-15...
ALOM CMT sends alerts to all ALOM CMT users that are logged in, sending the alert through email to a configured email address, and writing the event to the ALOM CMT event log. 3-16 SPARC Enterprise T2000 Server Service Manual • April 2007 FIGURE 3-9 Service Required LED FRU LEDs...
Page 57
LEDs on either the chassis or the hard drive itself. Use the Solaris message files to view hard drive faults. See From Solaris OS Files and Commands” on page Section 3.6, “Collecting Information 3-45. Chapter 3 Server Diagnostics 3-17...
Switching Between the System Console and ALOM CMT To switch from the console output to the ALOM CMT sc> prompt, type #. ■ (Hash-Period). To switch from the sc> prompt to the console, type console. ■ 3-18 SPARC Enterprise T2000 Server Service Manual • April 2007...
Displays a list of all ALOM CMT commands with syntax and descriptions. Specifying a command name as an option displays help for that command. Takes the host server from the OS to either kmdb or OpenBoot PROM (equivalent to a Stop-A), depending on the mode Solaris software was booted.
Page 60
Note – See TABLE 3-11 3-20 SPARC Enterprise T2000 Server Service Manual • April 2007 Description Indicates if it is okay to perform a hot-swap of a power supply. This command does not perform any action, but it provides a warning if the power supply should not be removed because the other power supply is not enabled.
Environmental faults – Temperature or voltage problems that might be caused by ■ faulty FRUs (power supplies, fans, or blower), or by room temperature or blocked air flow to the server. POST detected faults – Faults on devices detected by the power-on self-test ■...
Page 64
------------------------------------------------------------------------------ Supply Status Overcurrent ------------------------------------------------------------------------------ sc> Note – Some environmental information might not be available when the server is in standby mode. 3-24 SPARC Enterprise T2000 Server Service Manual • April 2007 3.33 3.13 3.16 1.30 1.20 1.24 1.48 1.27 1.35...
3.3.4 Running the showfru Command The showfru command displays information about the FRUs in the server. Use this command to see information about an individual FRU, or for all the FRUs. Note – By default, the output of the showfru command for all FRUs is very long.
POST output that is displayed, and which reset events trigger POST by using ALOM CMT variables. 3-26 SPARC Enterprise T2000 Server Service Manual • April 2007 Section 3.4.5, 3-36.
Runs POST upon user initiated resets. Only runs POST for the first power on. This option is the default. Runs POST if fatal errors are detected. Runs POST after any reset. No POST output is displayed. Chapter 3 Server Diagnostics FIGURE 3-10 TABLE 3-9 3-27...
Page 68
ALOM CMT Parameters Used For POST Configuration (Continued) TABLE 3-9 Parameter 3-28 SPARC Enterprise T2000 Server Service Manual • April 2007 Values Description POST output displays functional tests with a banner and pinwheel. POST output displays all test and informational normal messages.
The setkeyswitch parameter sets the virtual keyswitch, so it does not use the setsc command. For example, to change the POST parameters using the setkeyswitch command, enter the following: sc> setkeyswitch diag 3-30 SPARC Enterprise T2000 Server Service Manual • April 2007 Diagnostic Service No POST Execution Mode service...
In normal operation (diag_level=min), POST runs in mimimum mode by default to test devices required to power on the server. Replace any devices POST detects as faulty in minimum mode. Run POST in maximum mode (diag_level=max) for all power-on or error- generated resets, and to validate hardware upgrades or repairs.
3. Reset the system so that POST runs. There are several ways to initiate a reset. The following example uses the powercycle command. For other methods, refer to the SPARC Enterprise T2000 Server Administration Guide. sc> powercycle...
Page 73
0:0>sys 150 MHz, CPU 600 MHz, mem 150 MHz. 0:0>Integrated POST Testing 0:0>Setup L2 Cache 0:0>L2 Cache Control = 00000000.00300000 0:0>Scrub and Setup L2 Cache 0:0>L2 Directory clear 0:0>L2 Scrub VD & UA 0:0>L2 Scrub Tags 0:0>Test Memory... Note: some output omitted. Chapter 3 Server Diagnostics 3-33...
Page 74
0:0>INFO:Master Abort for probe, device IOBD/PCIE2 looks like it is not present! 0:0>INFO: 0:0>POST Passed all devices. 0:0> 0:0>DEMON: (Diagnostics Engineering MONitor) 0:0>Select one of the following functions 0:0>POST:Return to OBP. 3-34 SPARC Enterprise T2000 Server Service Manual • April 2007...
Page 75
7:2> Dram Error AFAR channel 2 = 00000000.00000000 7:2> L2 AFAR channel 2 = 00000000.00000000 In this example, POST is reporting a memory error at DIMM location . It was detected by POST running on core 7, strand 2. MB/CMP0/CH2/R0/D0 Appendix Chapter 3 Server Diagnostics 3-35...
When using maximum mode, if no faults are detected, return POST to minimum mode. sc> setkeyswitch normal sc> setsc diag_mode normal sc> setsc diag_level min 3-36 SPARC Enterprise T2000 Server Service Manual • April 2007 MB/CMP0/CH2/R0/D0 is disabled. The system can boot using MB/CMP0/CH2/R0/D0 3-46. 3-40.
3. Reset the system so that POST runs. There are several ways to initiate a reset. The following example uses the powercycle command. For other methods, refer to the SPARC Enterprise T2000 Server Administration Guide. sc> powercycle...
Note – The detected DIMM in the previous example must also be replaced because it exceeds the PSH page retire threshold. 3-38 SPARC Enterprise T2000 Server Service Manual • April 2007 ), replace the detected devices. CODE EXAMPLE 3-2 POST Fault for Multiple DIMMs...
If no fault is reported, you do not need to do anything else. Do not perform the subsequent steps. Section 3.4.5.1, “Correctable Errors for 3-37. Section 3.7, “Managing Components With Automatic 3-46). MB/CMP0/CH2/R0/D0 Chapter 3 Server Diagnostics Fault MB/CMP0/CH2/R0/D0 3-39...
The daemon also logs the fault to the syslogd daemon and provides a fault notification with a message ID (MSGID). You can use the message ID to get additional information about the problem from Sun’s knowledge article database. 3-40 SPARC Enterprise T2000 Server Service Manual • April 2007...
The message identifier ( ■ fault information Faulted FRU ( ■ MB, indicating that the motherboard requires replacement. 3-42 SPARC Enterprise T2000 Server Service Manual • April 2007 Apr 24 06:54:08.2005) ) that can be used to obtain additional SUNW4V-8000-6H FRU:hc:///component=MB), 3-21. SUNW-MSG-ID...
Page 83
CPU. The recommended action for the system administrator is to contact Sun support so a Sun service technician can replace the affected component. 3. Follow the suggested actions to repair the fault. SUN4U-8000-6H indicates diagnosis has Chapter 3 Server Diagnostics 3-43...
Collecting Information From Solaris OS Files and Commands With the Solaris OS running on the server, you have the full complement of Solaris OS files and commands available for collecting information and for troubleshooting. If POST, ALOM CMT, or the Solaris PSH features do not indicate the source of a fault, check the message buffer and log files for notifications for faults.
* The showcomponent command might not report all blacklisted DIMMS. 3-46 SPARC Enterprise T2000 Server Service Manual • April 2007 ) enable you to view, and manually add or remove TABLE 3-11 Description Displays system components and their current state.
The enablecomponent command enables a disabled component by removing it from the ASR blacklist. 1. At the sc> prompt, enter the enablecomponent command. sc> enablecomponent MB/CMP0/CH3/R1/D1 SC Alert:MB/CMP0/CH3/R1/D1 reenabled 3-48 SPARC Enterprise T2000 Server Service Manual • April 2007 Disabled Devices...
3.8.1 Checking Whether SunVTS Software Is Installed This procedure assumes that the Solaris OS is running on the server, and that you have access to the Solaris command line. 1. Check for the presence of SunVTS packages using the pkginfo command.
SunVTS software can be run in several modes. This procedure assumes that you are using the default mode. This procedure also assumes that the server is headless. That is, it is not equipped with a monitor capable of displaying bitmap graphics. In this case, you access the SunVTS GUI by logging in remotely from a machine that has a graphics display.
2. Enable the remote display. On the display system, type: # /usr/openwin/bin/xhost + test-system where test-system is the name of the server you plan to test. 3. Remotely log in to the server as superuser. Use a command such as rlogin or telnet.
The test selection area lists tests in categories, such as Network, as shown in . To expand a category, left-click the icon (expand category icon) to the FIGURE 3-12 left of the category name. 3-52 SPARC Enterprise T2000 Server Service Manual • April 2007...
Tests are enabled when checked, and disabled when not checked. lists tests that are especially useful to run on this server. TABLE 3-12 Useful SunVTS Tests to Run on This Server...
Page 94
Log Files (/var/opt/SUNWvts/logs) ■ 3-54 SPARC Enterprise T2000 Server Service Manual • April 2007 , right-clicking on the text string ce0(nettest) brings up a Detailed versions of all the status and error messages that appear –...
Replacing Hot-Swappable and Hot- Pluggable FRUs This chapter describes how to remove and replace the hot-swappable and hot- pluggable field-replaceable units (FRUs) in the server. The following topics are covered: Section 4.1, “Devices That Are Hot-Swappable and Hot-Pluggable” on page 4-2 ■...
4.2.1 Removing a Fan 1. Gain access to the top of the server where the fan door is located ( SPARC Enterprise T2000 Server Service Manual • April 2007 FIGURE 4-1...
You might need to extend the server to a maintenance position. See “Extending the Server to the Maintenance Position” on page 5-3 Fan Identification and Removal FIGURE 4-1 2. Unpackage the replacement fan and place it near the server. 3. Lift the latch on the top of the fan door ( The fan door is spring loaded, and you must hold it in the open position.
1. Identify which power supply (0 or 1) requires replacement ( A lighted amber LED on a power supply indicates that a failure was detected. You can also use the showfaults command at the sc> prompt. SPARC Enterprise T2000 Server Service Manual • April 2007 FIGURE 4-2...
PS0 or PS1. 3. Gain access to the rear of the server where the faulty power supply is located. 4. At the rear of the server, release the cable management arm (CMA) tab ( and swing the CMA out of the way so you can access the power supply.
5. Verify that the amber LED on the replaced power supply, the Service Required LED, and Rear-FRU Fault LEDs are not lit. 6. At the sc> prompt, issue the showenvironment command to verify the status of the power supplies. SPARC Enterprise T2000 Server Service Manual • April 2007...
4.4.1 Removing the Rear Blower 1. Gain access to the rear of the server where the faulty blower unit is located. 2. Release the cable management arm tab ( management arm out of the way so you can access the power supply.
3. Tighten the two thumbscrews to secure the blower to the chassis. 4. Verify that the Rear Blower and Service Required LEDs are not lit. 5. Close the CMA, inserting the end of the CMA into the rear left rail bracket. SPARC Enterprise T2000 Server Service Manual • April 2007...
Hot-Plugging a Hard Drive The hard drives in the server are hot-pluggable, but this capability depends on how the hard drives are configured. To hot-plug a drive you must be able to take the drive offline (prevent any applications from accessing it, and remove the logical software links to it) before you can safely remove it.
The hard drive is physically addressed according to the slot in which it is installed. FIGURE 4-6 which the drive was removed. 4-10 SPARC Enterprise T2000 Server Service Manual • April 2007 button HDD0 . It is important to install a replacement drive in the same slot from...
Page 105
2. Slide the drive into the bay until it is fully seated. 3. Close the latch to lock the drive in place. 4. Perform administrative tasks to reconfigure the hard drive. The procedures that you perform at this point depend on how your data is configured.
Page 106
4-12 SPARC Enterprise T2000 Server Service Manual • April 2007...
Common Procedures for Parts Replacement Before you can remove and replace parts that are inside the server, you must perform the following procedures: Section 5.1.2, “Shutting the System Down” on page 5-2 ■...
Depending on the nature of the problem, you might want to view the system status, the log files, or run diagnostics before you shut down the system. Refer to the SPARC Enterprise T2000 Server Administration Guide for log file information. 2. Notify affected users.
Note – You can also use the Power On/Off button on the front of the server to initiate a graceful system shutdown. This button is recessed to prevent accidental server power-off. Use the tip of a pen to operate this button.
CMA from the rail assembly (on the right side from the back of the rack). This action leaves the CMA still attached to the cabinet, but the server chassis is now disconnected from the CMA. SPARC Enterprise T2000 Server Service Manual • April 2007...
Caution – The server weighs approximately 40 lb. (18 kg). The next step requires two people to dismount and carry the chassis. 4. From the front of the server, pull the release tabs forward and pull the server forward until it is free of the rack rails.
Do this after you disconnect the power cords from the server. 5.1.7 Removing the Top Cover All field-replaceable units (FRUs) that are not hot-swappable require the removal of the top cover. SPARC Enterprise T2000 Server Service Manual • April 2007...
Top Cover and Release Button FIGURE 5-3 2. While pressing the top cover release button, slide the cover toward the rear of the server about half of an inch. 3. Lift the cover off the chassis. 5.1.8 Removing the Front Bezel and Top Front Cover...
Section 5.2.8, “Replacing the Motherboard Assembly” on page 5-23 Section 5.2.9, “Removing the Power Distribution Board” on page 5-27 ■ Section 5.2.10, “Replacing the Power Distribution Board” on page 5-30 SPARC Enterprise T2000 Server Service Manual • April 2007 FIGURE 5-4 Section 5.2.4, “Replacing...
Section 5.2.11, “Removing the LED Board” on page 5-32 ■ “Replacing the LED Board” on page 5-33 Section 5.2.13, “Removing the Fan Power Board” on page 5-34 ■ “Replacing the Fan Power Board” on page 5-34 Section 5.2.15, “Removing the Front I/O Board” on page 5-35 ■...
4. Note and remove any cables that are attached to the card. 5. Rotate the PCI hold-down bracket 90 degrees so it no longer covers the PCI card FIGURE 5-7 5-10 SPARC Enterprise T2000 Server Service Manual • April 2007 PCI-E slots 0, 1, 2 PCI-X slots 0, 1...
PCI Card and Hold-Down Bracket FIGURE 5-7 6. Carefully pull the card out of the socket. 7. Place the card on an antistatic mat. 8. Rotate the hold-down bracket so that it does not protrude into the chassis. 5.2.2 Replacing PCI Cards 1.
FIGURE 5-8 Note – For memory configuration information see Guidelines” on page 5-12 SPARC Enterprise T2000 Server Service Manual • April 2007 Section 3.4.5, “Correctable Errors Detected by POST” Section 5.1, “Common Procedures for Parts 5-1. ) that you want to replace.
Front of board DIMM Locations FIGURE 5-8 FIGURE 5-8 TABLE 5-1 socket numbers that identify the location of the DIMM on the motherboard. DIMM Names and Socket Numbers TABLE 5-1 DIMM Name Used in Messages CH0/R1/D1 CH0/R0/D1 CH0/R1/D0 CH0/R0/D0 CH1/R1/D1 CH1/R0/D1 to map DIMM names that are displayed in faults to Socket No.
4. Push the DIMM into the connector until the ejector tabs lock the DIMM in place. 5. Perform the procedures described in Finishing Up” on page 5-14 SPARC Enterprise T2000 Server Service Manual • April 2007 Socket No. J1301 J1101...
Page 121
6. Gain access to the ALOM CMT sc> prompt. Refer to the SPARC Enterprise T2000 Advanced Lights Out Management (ALOM) Guide for instructions. 7. Run the showfaults -v command to determine how to clear the fault. The method you use to clear a fault depends on how the fault is identified by the showfaults command.
If faults are reported, refer to the diagnostics flowchart in to diagnose the fault. 9. Gain access to the ALOM CMT sc> prompt. 10. Run the showfaults command. 5-16 SPARC Enterprise T2000 Server Service Manual • April 2007 for an approach FIGURE 3-1...
If the fault was detected by the host and the fault information persists, the output ■ will be similar to the following example: sc> showfaults -v ID Time 0 SEP 09 11:09:26 SUN4U-8000-2S If the showfaults command does not report a fault with a UUID, then you do ■...
The PROM is keyed to ensure proper orientation. 3. Locate the system controller slot on the motherboard assembly. 5-18 SPARC Enterprise T2000 Server Service Manual • April 2007 ) from the system controller FIGURE 5-10 System configuration PROM...
Finishing Up” on page 5.2.7 Removing the Motherboard Assembly The motherboard for your server has two distinct boards for the CPU and the I/O board. However, they must be removed and replaced as a single motherboard assembly ( FIGURE 5-11 Caution –...
■ Disconnect the hard drive data cables and carefully pull them through the interior ■ wall of the chassis. 5-20 SPARC Enterprise T2000 Server Service Manual • April 2007 I/O board Section 5.1, “Common Procedures for Parts 5-1. 5-12. FIGURE 5-12...
The SAS hard drive and the cable marked P8 pass through a cutout in the interior wall of the chassis. Before removing the motherboard assembly, ensure that these cables are out of the way. The SAS hard drive cables can be folded back over the interior wall or passed through the cutout ( marked P8 is large and contains a number of small wires.
The front of the motherboard refers to the part of the motherboard nearest the front of the server. 9. Slide the motherboard forward to clear the connectors from the cutouts in the rear of the chassis. 5-22 SPARC Enterprise T2000 Server Service Manual • April 2007...
Caution – Do not lift the motherboard assembly over the front fan housing to remove it from the chassis, because doing so can damage the assembly. Removing the Motherboard Assembly From the Server Chassis. FIGURE 5-14 11. Place the motherboard assembly on an antistatic mat.
Page 130
4. Place the front of the motherboard down on the front standoffs. The front of the motherboard refers to the part of the motherboard nearest the front of the server. 5-24 SPARC Enterprise T2000 Server Service Manual • April 2007 Section 5.1.6, “Performing 5-6. FIGURE 5-15...
Installing the Motherboard Assembly FIGURE 5-15 5. Adjust the position of the motherboard assembly so that it is mounted on the bus bar. 6. Adjust the position of the motherboard assembly so that it lines up with the standoff screw holes. 7.
Section 5.2.4, “Replacing DIMMs” on page 12. Reinstall any PCI option cards that were removed. Section 5.2.2, “Replacing PCI Cards” on page 5-26 SPARC Enterprise T2000 Server Service Manual • April 2007 Insulating washer FIGURE 5-16 5-14. Install these two screws first to properly align the board .
Pull the hard drive data cables through the interior wall of the chassis and ■ reconnect the cables to the motherboard. 14. Reconnect all cables that were removed from the rear of the server. 15. Perform the procedures described in Finishing Up” on page 5.2.9...
Release the latches on the DVD cable and disconnect it. ■ Disconnect the cable marked P7. ■ Disconnect the blower power cable from the power distribution board. ■ 5-28 SPARC Enterprise T2000 Server Service Manual • April 2007 Power supply latches...
4. Remove the two screws that secure the power distribution board to the bus bar FIGURE 5-18 Location of Bus Bar Screws on the Power Distribution Board and the FIGURE 5-18 Motherboard Assembly Chapter 5 Replacing Cold-Swappable FRUs mounting screw Bus bar screws 5-29...
3. Secure the PDB to the bus bar with two screws, and tighten all three screws FIGURE 5-20 5-30 SPARC Enterprise T2000 Server Service Manual • April 2007 ) that secures the power distribution board to the FIGURE 5-19 FIGURE 5-19...
6. Note the chassis serial number. The chassis serial number is located on a sticker on the front of the server and on a sticker on the side of the server. The serial number is unique to each server. You need this number for subsequent steps in this procedure.
Removing the LED Board 1. Perform the procedures described in Replacement” on page 2. Remove all three fans. Section 4.2.1, “Removing a Fan” on page 5-32 SPARC Enterprise T2000 Server Service Manual • April 2007 Section 5.1, “Common Procedures for Parts 5-1. 4-2.
3. Remove the screws that secure the LED board to the chassis ( Removing the LED Board From the Chassis FIGURE 5-21 4. Slide the LED board to the right to disconnect it from the front I/O board. 5. Remove the LED board from the chassis and place it on an antistatic mat. 5.2.12 Replacing the LED Board 1.
5.2.14 Replacing the Fan Power Board 1. Unpackage the replacement fan power board and place it on an antistatic mat. 5-34 SPARC Enterprise T2000 Server Service Manual • April 2007 Section 5.1, “Common Procedures for Parts 5-1. 4-2) FIGURE 5-22...
2. Lower the board into place and slide the board to the left to plug it into the front I/O board. 3. Secure the board to the chassis with the screws. 4. Reinstall all three fans. Section 4.2.2, “Replacing a Fan” on page 5.
4. Reconnect the front I/O board data cable. 5. Reinstall the LED board. Section 5.2.12, “Replacing the LED Board” on page 5-36 SPARC Enterprise T2000 Server Service Manual • April 2007 Section 5.2.11, “Removing the LED Board” on FIGURE 5-24 5-33.
6. Reconnect and secure the fan power board. 7. Replace all three fans. Section 4.2.2, “Replacing a Fan” on page 8. Perform the procedures described in Finishing Up” on page 5.2.17 Removing the DVD Drive 1. Perform the procedures described in Replacement”...
2. Place the SAS disk backplane on the two ledges on the bottom of the drive cage assembly, with the power connector facing down toward the bottom of the chassis. The ledges hold the backplane in place temporarily. 5-38 SPARC Enterprise T2000 Server Service Manual • April 2007 Power cable connector le plug...
3. Secure the backplane to the drive cage assembly with five insulating washers and five screws FIGURE 5-26 Do not fully tighten any screws until all of the screws are loosely installed. Insulating washers are supplied with the replacement FRU. Install one insulating washer with each screw even if the original SAS disk backplane did not have any washers.
(+) facing upward (away from the card). Replacing the Battery in the System Controller FIGURE 5-28 5-40 SPARC Enterprise T2000 Server Service Manual • April 2007 Section 5.3, “Common Procedures for Section 5.1, “Common Procedures for Parts 5-1. (Section 5.2.5, “Removing the...
3. Replace the system controller. Section 5.2.6, “Replacing the System Controller Card” on page 4. Perform the procedures described in Finishing Up” on page 5. Use the ALOM CMT setdate command to set the day and time. Use the setdate command before you power on the host system. For details about this command, refer to the Advanced Lights Out Management (ALOM) CMT Guide.
Replacing the Top Cover 1. Place the top cover on the chassis. Set the cover down so that it hangs over the rear of the server by about an inch. 2. Slide the cover forward until it latches into place.
5.3.4 Returning the Server to the Normal Rack Position If you extended the server to the maintenance position, use this procedure to return the server to the normal rack position. 1. Release the slide rails from the fully extended position by pushing the release...
Ensure that the cables do not get in the way. 3. Reconnect the CMA into the back of the rail assembly: Note – Refer to the SPARC Enterprise T2000 Server Installation Guide for detailed CMA installation instructions. a. Insert the inner latch (smaller, right side) into the clip located at the end of the...
Plug the CMA rail extension into the end of the left slide rail assembly. The tab at the front of the rail extension clicks into place. 4. Reconnect the cables to the back of the server. If the CMA is in the way, disconnect the left CMA release and swing the CMA open.
Page 152
5-46 SPARC Enterprise T2000 Server Service Manual • April 2007...
Hard drives are physically addressed according to the slot in which they are installed. Depending on the server model, the hard drives might be connected to a PCI-X SAS controller card, or connected to a drive controller that is built into the Section 6.2, “Adding Components Inside the Chassis”...
Page 154
If the disk is not in list, such as with a newly installed disk, then use devfsadm to configure it into the tree. See the devfsadm man page for details. SPARC Enterprise T2000 Server Service Manual • April 2007 . For additional details, see...
You can connect up to 126 devices to each of the two USB controllers (each ■ controller provides two connectors) for a total of 252 USB devices. The USB ports on the server support USB 1.1 devices. ■ Note – There are many USB devices on the market. Read the product documentation for your USB device for additional installation requirements and instructions that are not covered here.
■ 1 GB ■ 2 GB ■ 4 GB ■ The server supports two ranks of eight DIMMs each. ■ SPARC Enterprise T2000 Server Service Manual • April 2007 Rear USB ports to plan the memory FIGURE 6-3 TABLE 6-1...
At minimum, rank 0 must be fully populated with eight DIMMS of the same ■ capacity. DIMMs can be added eight at a time, of the same capacity, to fill rank 1. ■ Front of board DIMM Layout FIGURE 6-3 Chapter 6 Adding New Components and Devices...
4. Line up the DIMM with the connector. 5. Push the DIMM into the connector until the ejector tabs lock the DIMM in place. 6. Repeat Step 3 SPARC Enterprise T2000 Server Service Manual • April 2007 DIMM Name Socket Number J0701...
7. Perform the procedures described in Replacement” on page 6.2.3 PCI Express or PCI-X Card Guidelines Follow these guidelines and The server provides the following PCI capabilities: ■ 3 PCI-Express (PCI-E) slots for low-profile cards (supports lane widths of x1, ■ x2, x4, and x8) 2 PCI-X slots for low-profile cards ■...
Page 160
5. Rotate the PCI hold-down bracket to the closed position and secure the screw on the bracket. 6. Install any cables that go to the PCI card. 7. Perform the procedures described in Replacement” on page SPARC Enterprise T2000 Server Service Manual • April 2007 Section 5.1, “Common Procedures for Parts 5-1.
Page 161
A P P E N D I X Field-Replaceable Units This appendix provides illustrated parts breakdown diagrams and a table that lists the server FRUs. The following topic is covered: Section A.1, “Illustrated FRU Locations” on page A-2 ■...
Illustrated FRU Locations , and list the locations of the field-replaceable units (FRUS) in the FIGURE A-1 FIGURE A-2 TABLE A-1 server. Field-Replaceable Units (1 of 2) FIGURE A-1 SPARC Enterprise T2000 Server Service Manual • April 2007...
Section 5.2.1, “Removing PCI- PCI-X cards Express and PCI-X Cards” on page 5-9 SPARC Enterprise T2000 Server Service Manual • April 2007 Description The motherboard assembly is comprised of the following boards that must be replaced as a single FRU: •...
Page 165
Server FRU List (Continued) TABLE A-1 Replacement Item No. Instructions DIMMs Section 5.2.3, “Removing DIMMs” on page 5-12 Power Section 5.2.9, distribution “Removing the board Power Distribution Board” on page 5-27 Cable Cable replacement management instructions are provided in the corresponding FRU procedures.
Page 166
DVD Drive” on page 5-37 * The FRU name is used in system messages. SPARC Enterprise T2000 Server Service Manual • April 2007 Description The SAS backplane board contains the Molex connector for interfacing to 2.5 SAS or S-ATA disk drives.
Page 167
6-1 advanced ECC technology, 3-7 Advanced Lights Out Management (ALOM) CMT about, 2-7 configuration parameters, 5-18 connecting to, 3-18 diagnosis and repair of server, 3-16 POST, and, 3-27 prompt, 3-18 remote management, 2-5 service related commands, 3-18 airflow, blocked, 3-5...
Page 168
DIMMs, 5-15 disk drives see hard drives displaying FRU status, 3-25 dmesg command, 3-45 DVD drive, A-6 Index-2 SPARC Enterprise T2000 Server Service Manual • April 2007 removing, 5-37 replacing, 5-37 DVD drive FRU name, A-6 DVD specification, 2-4...
Page 169
2-4 features, server, 2-2 field-replaceable units (FRUs) also see FRUs, 5-1 FIOBD (front I/O board FRU name), A-5 firmware, 2-5 flexible cable, 5-19, 5-24 fmadm command, 3-44, 5-16 fmdump command, 3-42 front bezel removing, 5-8 replacing, 5-42 front I/O board, A-5...
Page 170
Overtemp LED, 3-11, 4-2 parity checking, 2-7 parts, replacement see FRUs PCI (PCIE and PCIX FRU names), A-4 Index-4 SPARC Enterprise T2000 Server Service Manual • April 2007 PCI capabilities, 6-7 PCI hold-down bracket, 5-10 PCI-E and PCI-X cards adding, 6-7...
Page 171
LED board, 5-32 motherboard assembly, 5-19 PCI-E and PCI-X cards, 5-9 power distribution board, 5-27 SAS disk backplane, 5-37 server from the rack, 5-4 system controller card, 5-17 top cover, 5-6 replacing battery on the system controller, 5-40 DIMMs, 5-14...
Page 172
TLB misses, reduction of, 2-3 tools required, 5-2 top cover release button, 5-7 removing, 5-6 replacing, 5-42 Index-6 SPARC Enterprise T2000 Server Service Manual • April 2007 Top Fan Fault LED, 3-10, 4-2 top front cover removing, 5-7 replacing, 5-41 troubleshooting...