Dell EMC DSS8440 Installation and Service Manual Regulatory Model: B21S Series Regulatory Type: B21S001 June 2021 Rev.
Notes, cautions, and warnings NOTE: A NOTE indicates important information that helps you make better use of your product. CAUTION: A CAUTION indicates either potential damage to hardware or loss of data and tells you how to avoid the problem. WARNING: A WARNING indicates a potential for property damage, personal injury, or death. © 2019 -2021 Dell Inc. or its subsidiaries. All rights reserved. Dell, EMC, and other trademarks are trademarks of Dell Inc. or its subsidiaries.
Contents Chapter 1: About this document.................................................................................................... 7 Chapter 2: DSS8440 system overview........................................................................................... 8 DSS8440 system feature overview.................................................................................................................................9 Front view of the system........................................................
System Utilities............................................................................................................................................................. 41 PXE boot.............................................................................................................................................................................. 41 Chapter 6: Installing and removing system components.............................................................. 42 Safety instructions............
Installing the processor.............................................................................................................................................. 83 System memory................................................................................................................................................................. 85 Removing a memory module.....................................................................................................................................
Front control cable assembly control board to MB................................................................................................. 127 GPU power cable assembly GPU card to PSB......................................................................................................... 128 IDC cable MB-PDB assembly to PDB......................................................................................................................... 129 IDC cable MB-PDB assembly to MB.......................
1 About this document This document provides an overview about the system, information on installing and replacing components, technical specifications, diagnostic tools, and guidelines to be followed while installing certain components.
2 DSS8440 system overview This chapter briefly describes the main features of the Dell EMC DSS8440 system. The chapter includes figures of the products, a list of the server system features, and diagrams showing the location of the components and connections on the server systems. Figure 1. Dell EMC DSS8440 front View Figure 2.
DSS8440 system feature overview The DSS8440 is a 4U PCIe Accelerator Server by PCIe Switch Board(PSB) with PCIe downstream up to 10x general-purpose double width graphics processing unit (GPGPU), 8x NVMe, 4x (center) + 4x (right, optional) rear-PCIe slots and upstream the 14G leveraged PowerEdge C4140. The system contains configuration-A with 8x/10x double width GPGPU, 10x 2.5” hot-swap storage-drives (no expander), single or dual Skylake processors, 845.
Control panel Figure 4. Right control panel view 1. Power-on indicator/power button 2. System-health indicator 3. System identification button Rear view of the system Figure 5. Rear view of the system 1. 3. 5. 7. 9. 11. 13. 10 Slots-4, 5, 14, 15 Drive-[0..9] Slot-3 Power-Jack DB9 2x USB-3.0 Power Supply 1 to 4 DSS8440 system overview 2. 4. 6. 8. 10. 12. Slots-[19..
3 Technical specifications The technical and environmental specifications of your system are outlined in this section.
Table 1. Dell EMC DSS 8440 chassis dimensions Xa Xb Y Za Zb Zc 483.2 mm 444.6 mm 174.8 mm 836.5 mm 850.2 mm (19.02 inches) (17.50 inches) (6.88 inches) With bezel: 872.0 mm (34.33 inches) (32.93 inches) (34.47 inches) Chassis weight Table 2. Chassis weight System Maximum weight (with all drives) DSS 8440 (2 CPU/ 10 GPU/ 10 HDD/ 1 H730P+/ 1 CX5) 46.3 Kg (102.
Table 3. PSU specifications (continued) Functions 2400W Power supply Output Main DC Output Voltage Regulation 12.2V +/-5% Output current 196.72A @ high line Standby Output Voltage Regulation 12V +/-5% Output current 3.5A Cooling fans specifications The Dell EMC DSS 8440 system supports up to twelve 60 mm x 60 mm (square) cooling fans. System battery specifications The Dell EMC DSS 8440 system supports CR 2032 3.0-V lithium coin cell system battery.
. Memory specifications Table 6. Memory specifications DIMM type DIMM rank DIMM capacity RDIMM Dual rank RDIMM RDIMM Dual processors Minimum RAM Maximum RAM 32 GB 64 GB 768 GB Dual rank 16 GB 32 GB 384 GB Single rank 8 GB 16 GB 192 GB NOTE: Ensure that all the memory slots are populated either with DIMMs or DIMM blanks. NOTE: It is recommended to have all DIMMs of the same type. Drive specifications The Dell EMC DSS 8440 system supports 10 x 2.
Environmental specifications The following details define the system level operating and non-operating environmental limits. Table 7. Maximum Temperature: Maximum Temperature: Operation: Fan normal 10°C–35°C. (Maximum temperature is reduced by 1°C/300m (1°F/547ft) above 950 m (3117 ft)). One rotor fan failure 10°C -35°C. (Maximum temperature is reduced by 1°C/300m (1°F/547ft) above 950 m (3117 ft)). Non-Operation -40°C to 65°C Table 8.
Table 10. System diagnostics and indicator codes (continued) Icon Indicator, button, or connector Description To reset iDRAC (if not disabled in F2 iDRAC setup), press and hold the button for more than 15 seconds. NIC indicator codes Each NIC on the back panel has an indicator that provides information about the network activity and link status. The activity LED indicates whether the NIC is connected or not. The link LED indicates the speed of the connected network. Figure 7. NIC indicators 1.
Figure 8. AC PSU status indicator 1. AC PSU status indicator/handle Table 12. AC PSU status indicators Convention Power indicator pattern Condition A Green A valid power source is connected to the PSU and the PSU is operational. B Flashing green When the firmware of the PSU is being updated, the PSU handle flashes green. CAUTION: Do not disconnect the power cable or unplug the PSU when updating firmware. if firmware update is interrupted, the PSUs do not function. C Flashing green and turns off.
4 Initial system setup and configuration Topics: • • • • Setting up your system iDRAC configuration Options to set up iDRAC IP address Log in to iDRAC Setting up your system Complete the following steps to set up your system: Steps 1. Unpack the system. 2. Install the system into the rack. 3. Connect the peripherals to the system. 4. Connect the system to its electrical outlet. 5. Turn the system on by pressing the power button or by using iDRAC. 6. Turn on the attached peripherals.
NOTE: You must have iDRAC credentials to log in to iDRAC NOTE: Ensure that you change the default user name and password after setting up the iDRAC IP address.
5 Pre-operating system management applications You can manage basic settings and features of a system without booting to the operating system by using the system firmware.
System Setup details The System Setup Main Menu screen details are explained as follows: Option Description System BIOS Enables you to configure BIOS settings. iDRAC Settings Enables you to configure iDRAC settings. The iDRAC settings utility is an interface to set up and configure the iDRAC parameters by using UEFI (Unified Extensible Firmware Interface). You can enable or disable various iDRAC parameters by using the iDRAC settings utility. Device Settings Enables you to configure device settings.
Option Description Boot Settings Specifies options to specify the Boot mode (BIOS or UEFI). Enables you to modify UEFI and BIOS boot settings. Network Settings Provides options to manage the UEFI network settings and boot protocols. Legacy network settings are managed from the Device Settings menu. Integrated Devices Provides options to manage integrated device controllers and ports, specifies related features and options.
Option Description System Management Engine Version Specifies the current version of the Management Engine firmware. System Service Tag Specifies the system Service Tag. System Manufacturer Specifies the name of the system manufacturer. System Manufacturer Contact Information Specifies the contact information of the system manufacturer. System CPLD Version Specifies the current version of the system complex programmable logic device (CPLD) firmware.
Option Description System Memory Voltage Specifies the system memory voltage. Video Memory Specifies the amount of video memory. System Memory Testing Specifies whether the system memory tests are run during system boot. Options are Enabled and Disabled. This option is set to Disabled by default. Memory Operating Mode Specifies the memory operating mode. The available option is Optimizer Mode, Single Rank Spare Mode, Multi Rank Spare Mode, and Mirror Mode.
Processor Settings details About this task The Processor Settings screen details are explained as follows: Option Description Logical Processor Enables or disables the logical processors and displays the number of logical processors. If this option is set to Enabled, the BIOS displays all the logical processors. If this option is set to Disabled, the BIOS displays only one logical processor per core. This option is set to Enabled by default.
Option Description Option Description Family-ModelStepping Specifies the family, model, and stepping of the processor as defined by Intel. Brand Specifies the brand name. Level 2 Cache Specifies the total L2 cache. Level 3 Cache Specifies the total L3 cache. Number of Cores Specifies the number of cores per processor. Maximum Specifies the maximum memory capacity per processor. Memory Capacity Microcode Specifies the microcode.
Option Description For AHCI Mode or RAID Mode, BIOS support is always enabled. Option Description Model Specifies the drive model of the selected device. Drive Type Specifies the type of drive attached to the SATA port. Capacity Specifies the total capacity of the drive. This field is undefined for removable media devices such as optical drives. Boot Settings You can use the Boot Settings screen to set the boot mode to either BIOS or UEFI. It also enables you to specify the boot order.
Changing boot order About this task You may have to change the boot order if you want to boot from a USB key or an optical drive. The following instructions may vary if you have selected BIOS for Boot Mode. Steps 1. On the System Setup Main Menu screen, click System BIOS > Boot Settings > UEFI/BIOS Boot Settings > UEFI/ BIOS Boot Sequence. 2. Click Boot Option Settings > BIOS/UEFI Boot Settings > Boot Sequence. 3.
Option Description Table 13. UEFI iSCSI Settings screen details Option Description iSCSI Initiator Name Specifies the name of the iSCSI initiator in IQN format. iSCSI Device1 Enables or disables the iSCSI device. When disabled, a UEFI boot option is created for the iSCSI device automatically. This is set to Disabled by default. iSCSI Device1 Settings Enables you to control the configuration of the iSCSI device.
Integrated Devices You can use the Integrated Devices screen to view and configure the settings of all integrated devices including the video controller, integrated RAID controller, and the USB ports. Viewing Integrated Devices To view the Integrated Devices screen, perform the following steps: Steps 1. Power on, or restart your system. 2.
Option Description to both the primary add-in video and the embedded video during POST and pre-boot environment. The embedded video is disabled before the operating system boots. This option is set to Enabled by default. NOTE: When there are multiple add-in graphic cards installed in the system, the first card discovered during PCI enumeration is selected as the primary video. You might have to re-arrange the cards in the slots in order to control which card is the primary video.
Option Description when set to Manual bifurcation Control and is disabled when set to Platform Default Bifurcation or Auto discovery of Bifurcation. Table 15.
Option Description within the BIOS setup utility may not always revert the serial MUX setting to the default setting of Serial Device 1. External Serial Connector Enables you to associate the External Serial Connector to Serial Device 1, Serial Device 2, or the Remote Access Device by using this option. This option is set to Serial Device 1 by default. NOTE: Only Serial Device 2 can be used for Serial Over LAN (SOL).
Option Description and Workstation PerformanceOther options include Performance Per Watt (OS), Performance, and Workstation Performance. NOTE: All the parameters on the system profile setting screen are available only when the System Profile option is set to Custom. CPU Power Management Sets the CPU power management. This option is set to System DBPM (DAPC) by default. DBPM is Demand-Based Power Management . Other options include OS DBPM, and Maximum Performance.
System Security You can use the System Security screen to perform specific functions such as setting the system password, setup password and disabling the power button. Viewing System Security To view the System Security screen, perform the following steps: Steps 1. Power on, or restart your system. 2.
Option Description Power Button Enables you to set the power button on the front of the system. This option is set to Enabled by default. AC Power Recovery Sets how the system behaves after AC power is restored to the system. This option is set to Last by default. AC Power Recovery Delay Enables you to set the time that the system should take to power up after AC power is restored to the system. This option is set to Immediate by default.
Creating a system and setup password Prerequisites Ensure that the password jumper is enabled. The password jumper enables or disables the system password and setup password features. For more information, see the System board jumper settings section. NOTE: If the password jumper setting is disabled, the existing system password and setup password are deleted and you need not provide the system password to boot the system. Steps 1.
Steps 1. To enter System Setup, press F2 immediately after turning on or restarting your system. 2. On the System Setup Main Menu screen, click System BIOS > System Security. 3. On the System Security screen, ensure that Password Status is set to Unlocked. 4. In the System Password field, change or delete the existing system password, and then press Enter or Tab. 5. In the Setup Password field, alter or delete the existing setup password, and then press Enter or Tab.
Redundant OS Control screen details The Redundant OS Control screen details are explained as follows: About this task Option Description Redundant OS Location Enables you to select a backup disk from the following devices: ● None ● IDSDM ● ISATA Ports in AHCI mode ● BOSS PCIe Cards (Internal M.2 Drives) ● Internal USB NOTE: RAID configurations and NVMe cards not are included as BIOS does not have the ability to distinguish between individual drives in those configurations.
Option Description System Time Enables you to set the time on the system. System Date Enables you to set the date on the system. Asset Tag Specifies the asset tag and enables you to modify it for security and tracking purposes. Keyboard NumLock Enables you to set whether the system should boot with the NumLock enabled or disabled. This option is set to On by default. NOTE: This option does not apply to 84-key keyboards. F1/F2 Prompt on Error Enables or disables the F1/F2 prompt on error.
Boot Manager The Boot Manager screen enables you to select boot options and diagnostic utilities. Viewing Boot Manager To enter Boot Manager: Steps 1. Turn on, or restart your system. 2. Press F11 when you see the following message: F11 = Boot Manager If your operating system begins to load before you press F11, allow the system to complete the booting, and then restart your system and try again.
6 Installing and removing system components Topics: • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • Safety instructions Before working inside your system After working inside your system Recommended tools System cover Front bezel Air shroud Drives Drive backplane Power supply unit Expansion cards and expansion card risers Nvidia Tesla T4 GPU Nvidia A100 GPU and NVLink bridge Nvidia A40 GPU and NVLink bridge Processor and heat sink System memory Riser 2 module Riser 1 module Network daughter car
NOTE: It is recommended that you always use an antistatic mat and antistatic strap while working on components inside the system. CAUTION: To ensure proper operation and cooling, all bays in the system and system fans must be always populated with a component or a blank. Before working inside your system Prerequisites Follow the safety guidelines listed in Safety instructions. Steps 1. Power off the system and all attached peripherals. 2.
Figure 9. Removing the system cover Next steps Install the system cover. Installing the system cover Prerequisites 1. Follow the safety guidelines listed in Safety instructions. NOTE: Ensure that all internal cables are connected and placed out of the way and no tools or extra parts are left inside the system. Steps 1. Align the tabs on the system cover with the guide slots on the chassis. 2. Tighten the captive screw.
Figure 10. Installing the system cover Next steps 1. Reconnect the peripherals, and connect the system to the electrical outlet. 2. Power on the system and all attached peripherals. Front bezel Removing the front bezel Prerequisites 1. Follow the safety guidelines listed in Safety instructions. 2. Follow the procedure listed in Before working inside your system. 3. Remove the system cover. Steps 1. Remove the screws that secures the front bezel to the fan cage.
Figure 11. Removing the screws 2. Remove the front bezel from the fan cage. Figure 12. Removing the front bezel Installing the front bezel Prerequisites 1. Follow the safety guidelines listed in Safety instructions. Steps 1. Place the front bezel onto the chassis and slide the front bezel into place.
Figure 13. Installing the front bezel 2. Tighten the screws to secure the front bezel to the fan cage. Next steps 1. Install the system cover 2.
Air shroud Removing the air shroud Prerequisites CAUTION: Never operate your system with the air shroud removed. The system may get overheated quickly, resulting in shutdown of the system and loss of data. 1. Follow the safety guidelines listed in Safety instructions. 2. Follow the procedure listed in Before working inside your system. 3. Remove the system cover. Steps NOTE: The screws on top of the air shroud are meant to secured the T_standoff. Do not remove the crews when removing the air shroud.
Steps 1. Align the slot on the air shroud with the T_standoff on the chassis. 2. Lower and slide the air shroud into the system until it is firmly seated. Figure 15. Installing the air shroud Next steps 1. Install the system cover. 2. Follow the procedure listed in After working inside your system Drives Removing a drive carrier and drive Prerequisites 1. Follow the safety guidelines listed in Safety instructions. Steps 1.
Figure 16. Removing the drive carrier 2. Remove the four screws securing the drive to the carrier. 3. Remove the drive from the carrier. Figure 17. Removing the drive from the drive carrier Next steps Install the drive and drive carrier. Installing the drive and drive carrier Prerequisites 1. Follow the safety guidelines listed in Safety instructions. Steps 1. Install the drive to the carrier. 2. Tighten the four screws to secure the drive to the carrier.
Figure 18. Install the drive 3. Insert the drive carrier into the chassis, and then push the drive carrier into the place. Figure 19. Installing the drive carrier Next steps 1.
Drive backplane Removing the drive backplane Prerequisites 1. 2. 3. 4. 5. Follow the safety guidelines listed in Safety instructions. Follow the procedure listed in Before working inside your system. Remove the system cover. Remove all the drives.. Disconnect all the cables. Steps 1. Remove the one screw securing the drive backplane to the system. 2. Lift the backplane from the hooks and then pull away from the system. Figure 20.
Figure 21. Installing the drive backplane Next steps 1. 2. 3. 4. Connect all the cables. Install the all drives. Install the top cover. Follow the procedure listed in After working inside your system Power supply unit Removing a power supply unit Prerequisites CAUTION: The power supply is only hot-swappable if you have a redundant system with all power supplies installed.
Figure 22. Removing a power supply unit Next steps Install the Power supply unit. Installing a power supply unit Prerequisites 1. Follow the safety guidelines listed in safety instructions. 2. For systems that support redundant PSU, ensure that all the PSUs are of the same type and have the same maximum output power. NOTE: The maximum output power (shown in watts) is listed on the PSU label. Steps Insert the power supply module into the power supply cage and push all the way until it clicks into place.
Figure 23. Installing a power supply unit Next steps 1. Connect the power cable to the PSU, and plug the cable into a power outlet. 2. Follow the procedure listed in After working inside your system. Expansion cards and expansion card risers Removing a GPU Prerequisites 1. Follow the safety guidelines listed in Safety instructions. 2. Follow the procedure listed in Before working inside your system. 3. Remove the system cover.
Figure 24. Removing the GPU clamp 3. Release two captive plungers on the GPU holding bracket and slide sideway to lift it from the system 4. Disconnect power cable from GPU card 5. Lift the GPU card from the system. Figure 25. Removing GPU card Installing a GPU Prerequisites 1. Follow the safety guidelines listed in Safety instructions. Steps 1. Insert the GPU card into chassis. 2. Connect the GPU card power cable. 3.
Figure 26. Installing the GPU card 4. Insert the GPU clamp into chassis. 5. Secure fixing the GPU clamp by four screws. Figure 27. Installing the GPU clamp Next steps 1. Installing the system cover.. 2. Follow the procedure listed in After working inside your system Removing a GPU support bracket Prerequisites 1. Follow the safety guidelines listed in Safety instructions. 2. Follow the procedure listed in Before working inside your system. 3. Remove the system cover. Steps 1.
Figure 28. Removing the GPU support bracket Next steps 1. Remove the GPU card. Installing a GPU support bracket Prerequisites 1. Follow the safety guidelines listed in Safety instructions. 2. Install the GPU card. Steps 1. Install the GPU support bracket into place. 2. Secure the GPU support bracket using two screws.
Figure 29. Installing the GPU support bracket Next steps 1. Install the system cover. 2. Follow the procedure listed in After working inside your system. Removing the PCIe switch board Prerequisites 1. 2. 3. 4. 5. 6. Follow the safety guidelines listed in Safety instructions. Follow the procedure listed in Before working inside your system. Remove the system cover. Remove the GPU support bracket. Remove the GPU card. Disconnect all the cables. For more information, see a.
Figure 30. Lift up the two levers 3. Lift the PCIe switch board module from the system. Figure 31. Removing the PCIe switch board 4. Remove the fourteen screws securing the PCIe switch board. and loosen the two captive screws.
Figure 32. Remove the screws securing the PCIe switch board 5. Lift the PCIe switch board from the GPU base. Installing the PCIe switch board Prerequisites 1. Follow the safety guidelines listed in Safety instructions. Steps 1. Insert the PCIe switch board into GPU base. 2. Secure fixing the PCIe switch board by fourteen screws and tighten the two captive screws. Figure 33. Installing the PCIe switch board 3. Insert the PCIe switch board module into chassis. 4.
Figure 34. Insert the two levers 5. Secure fixing the PCIe switch board module by six screws. Figure 35. Installing the PCIe switch board module Next steps 1. 2. 3. 4. 5. 62 Connect all the cables. Install the GPU card. Install the GPU support bracket. Install the system cover. Follow the procedure listed in After working inside your system.
Removing a GPU power interposer board Prerequisites 1. 2. 3. 4. 5. 6. Follow the safety guidelines listed in Safety instructions. Follow the procedure listed in Before working inside your system. Remove the system cover. Remove the GPU support bracket. Remove the GPU card. Remove the PCIe switch board module. Steps 1. Remove the eleven screws securing the GPU power interposer board. 2. Lift the GPU power interposer board from the system. Figure 36. Removing the GPU power interposer board Next steps 1.
Figure 37. Installing the GPU power interposer board Next steps 1. 2. 3. 4. 5. Install the PCIe switch board module. Install the GPU card. Install the GPU support bracket. Install the system cover. Follow the procedure listed in After working inside your system. Removing a butterfly module and riser 3 board Prerequisites 1. Follow the safety guidelines listed in Safety instructions. 2. Follow the procedure listed in Before working inside your system. 3. Remove the system cover. Steps 1.
Figure 38. Removing the butterfly module 4. Remove the eight screws securing both the riser 3 board 5. Lift the riser 3 board from the riser bracket. Figure 39. Removing the riser 3 board Next steps Install the riser 3 board. Installing the riser 3 board and butterfly module Prerequisites 1. Follow the safety guidelines listed in Safety instructions.
Steps 1. Insert the riser 3 board into riser bracket. 2. Secure fixing the both the riser 3 board by eight screws. Figure 40. Installing the riser 3 board 3. Connect all the cables. 4. Insert the butterfly module into chassis. 5. Secure fixing the butterfly module by four screws. Figure 41. Installing the butterfly module Next steps 1. Install the system cover 2.
Nvidia Tesla T4 GPU Removing a T4 GPU Prerequisites 1. Follow the safety guidelines listed in Safety instructions. 2. Follow the procedure listed in Before working inside your system. 3. Remove the system cover. Steps 1. Remove the screws securing the GPU clamp. 2. Lift the GPU clamp from the system. Figure 42. Removing the GPU clamp 3. Release two captive plungers on the GPU holding bracket and slide sideway to lift it from the system 4. Lift the GPU card from the system.
Figure 43. Removing GPU card NOTE: Do not operate the system with any GPU or GPU slot filler removed, as proper air flow and cooling may be impaired, impacting system performance. Figure 44.
Installing a T4 GPU Prerequisites 1. Follow the safety guidelines listed in Safety instructions. Steps 1. Insert the GPU card into chassis. To know more about GPU specifications, go to GPU specifications. 2. Slide the GPU holding bracket and until the captive plunger secure the GPU support bracket. Figure 45. Installing the GPU card 3. Insert the GPU clamp into chassis. 4. Secure fixing the GPU clamp by four screws.
Figure 46. Installing the GPU clamp NOTE: Do not operate the system with any GPU or GPU slot filler removed, as proper air flow and cooling may be impaired, impacting system performance. Figure 47.
Next steps 1. Installing the system cover.. 2. Follow the procedure listed in After working inside your system Removing the Nvidia Tesla T4 GPU from butterfly module Prerequisites 1. 2. 3. 4. 5. Follow the safety guidelines listed in Safety instructions. Follow the procedure listed in Before working inside your system. Remove the system cover.. Remove the butterfly module. Disconnect the SATA cable. Steps 1. Remove the screws securing the Nvidia Tesla T4 GPU. 2. Pull the GPU card out from the C-riser.
2. Secure the GPU card using screws. Figure 49. Installing the Nvidia Tesla T4 GPU in butterfly riser module Next steps 1. Install the butterfly module. 2. Install the top cover. 3. Follow the procedure listed in After working inside your system Nvidia A100 GPU and NVLink bridge Removing a A100 GPU and NVLink bridge Prerequisites 1. 2. 3. 4. Follow the safety guidelines listed in Safety instructions. Follow the procedure listed in Before working inside your system. Remove the system cover.
Figure 50. Removing GPU clamp 3. Release two captive plungers on the GPU holding bracket and slide sideway to lift it from the system. For more information, see Removing GPU support bracket. 4. Remove the screws securing the NVlink cross bars to the system. 5. Remove the NVLink cross bar. NOTE: Nvidia A100 system has three NVLink cross bars, regardless the number of GPGPU. Figure 51. Removing NVLink cross bar from A100 GPU 6. Locate the NVLink bridge on the GPU cards. A100 GPU has three pieces of NVLink.
Figure 52. Top view of NVLink bridge for A100 GPU 7. By using a plastic scribe, lift the NVLink bridge. NOTE: Ensure to use a plastic scribe for NVLink bridge removal, to avoid any damage. 8. Hold the NVLink bridge by the edges to remove it from the GPU cards. 9. Disconnect power cable from the GPU card. 10. Lift the GPU card from the system. 11. If you are removing the GPU permanently, install a filler bracket.
Figure 53. Installing GPU slot filler Next steps 1. Replace the GPU and NVLink bridge . Installing a A100 GPU and NVLink bridge Prerequisites 1. 2. 3. 4. Follow the safety guidelines listed in Safety instructions. Follow the procedure listed in Before working inside your system. Remove the system cover. If installing a new GPU card, unpack it and prepare the card for installation. For instructions, see the documentation accompanying the card. 5. If installed, remove the air shroud. Steps 1.
Figure 54. Installing GPU clamp 6. Fix the GPU clamp securely using four screws. NOTE: Do not operate the system with any GPU or GPU slot filler that is removed, as proper air flow and cooling may be impaired, impacting system performance. Figure 55. Installing GPU slot filler 7. Locate and remove the NVLink bridge cover on the GPU cards by using a plastic scribe. NOTE: Ensure to use a plastic scribe for NVLink bridge cover removal, to avoid any damage. 8.
Figure 56. Top view of NVLink bridge for A100 GPU 9. Replace the screws, to secure the NVLink cross bars on the NVlink bridge. NOTE: Nvidia A100 system has only three NVLink cross bars, regardless the number of GPGPU. Figure 57. Installing NVLink cross bar to A100 GPU Next steps 1. Installing the system cover. 2. Installing the air shroud. 3. Follow the procedure listed in After working inside your system.
Removing a A40 GPU and NVLink bridge Prerequisites 1. 2. 3. 4. Follow the safety guidelines listed in Safety instructions. Follow the procedure listed in Before working inside your system. Remove the system cover. If installed, remove the air shroud. NOTE: Do not operate the system with any GPU or GPU slot filler removed, as proper air flow and cooling may be impaired, impacting system performance. Steps 1. Remove the screws securing the GPU clamp. 2. Lift the GPU clamp from the system. Figure 58.
Figure 59. Removing NVLink cross bar from A40 GPU 6. Locate the NVLink bridge on the GPU cards. A40 GPU has one piece of NVLink bridge. Figure 60. Top view of NVLink bridge for A40 GPU 7. By using a plastic scribe, lift the NVLink bridge. NOTE: Ensure to use a plastic scribe for NVLink bridge removal, to avoid any damage. 8. Hold the NVLink bridge by the edges to remove it from the GPU cards. 9. Disconnect power cable from the GPU card. 10. Lift the GPU card from the system. 11.
12. Install a metal filler bracket over the empty expansion slot opening. Figure 61. Installing GPU slot filler Next steps 1. Replace the GPU and NVLink bridge . Installing a A40 GPU and NVLink bridge Prerequisites 1. 2. 3. 4. Follow the safety guidelines listed in Safety instructions. Follow the procedure listed in Before working inside your system. Remove the system cover. If installing a new GPU card, unpack it and prepare the card for installation.
Figure 62. Installing GPU clamp 6. Fix the GPU clamp securely using four screws. NOTE: Do not operate the system with any GPU or GPU slot filler that is removed, as proper air flow and cooling may be impaired, impacting system performance. Figure 63. Installing GPU slot filler 7. Locate and remove the NVLink bridge cover on the GPU cards by using a plastic scribe. NOTE: Ensure to use a plastic scribe for NVLink bridge cover removal, to avoid any damage. 8.
Figure 64. Top view of NVLink Bridge for A40 GPU 9. Replace the screws, to secure the NVLink cross bars on the NVlink bridge. NOTE: Nvidia A40 system has one NVLink cross bar, regardless the number of GPGPU. Figure 65. Installing NVLink cross bar to A40 GPU Next steps 1. Installing the system cover. 2. Installing the air shroud. 3. Follow the procedure listed in After working inside your system.
Processor and heat sink Removing the processor and heat sink Prerequisites WARNING: The heat sink may be hot to touch for some time after the system is powered down. Allow the heat sink to cool before removing it. 1. Follow the safety guidelines listed in Safety instructions. 2. Follow the procedure listed in Before working inside your system. 3. Remove the following: a. Remove the system cover. b. Removing the air shroud. Steps 1.
WARNING: The heat sink may be hot to touch for some time after the system has been powered down. Allow the heat sink to cool before removing it. 1. Follow the safety guidelines listed in Safety instructions. 2. If installed, remove the processor/DIMM blank and CPU dust cover. The procedure to remove the processor/DIMM blank is similar to that of the memory module. Steps 1.
System memory Removing a memory module Prerequisites 1. Follow the safety guidelines listed in Safety instructions. 2. Follow the procedure listed in Before working inside your system. 3. Remove the following: a. Remove the system cover. b. Removing the air shroud. Steps 1. Locate the DIMM sockets. Push the ejectors outward on both ends of the memory module socket to release the memory module from the socket. 2. Holding the DIMM by the edges, lift it from the socket, and store it in an anti-static package.
Figure 69. Installing a memory module Next steps 1. If applicable, Install the air shroud. 2. Install the system cover 3.
Riser 2 module Removing the riser 2 module Prerequisites 1. 2. 3. 4. 5. Follow the safety guidelines listed in Safety instructions. Follow the procedure listed in Before working inside your system. Remove the system cover.. Remove the butterfly module. Disconnect the SATA cable. Steps 1. Hold the touch points and lift the riser 2 module from the system board. Figure 70. Removing the riser 2 module 2. Open the PCIe bracket latch, removing the H730P+ card from the riser 2 module. Figure 71.
Next steps Install the riser 2 card. Installing the riser 2 module Prerequisites 1. Follow the safety guidelines listed in Safety instructions. Steps 1. Open the PCIe bracket latch. Figure 72. Open the PCIe bracket latch 2. Install the H730P+ card to the riser2 module.
Figure 73. Installing the H730P+ card 3. Close PCIe bracket latch. 4. Press the riser2 module -edge down until the card is fully seated. Align the riser2 module connector with the card connector on the system board and push the riser2 module wards the connector to seat it firmly. Figure 74. Installing the riser 2 module Next steps 1. Install the butterfly module. 2. Install the top cover. 3.
Riser 1 module Removing the riser 1 module Prerequisites 1. 2. 3. 4. Follow the safety guidelines listed in Safety instructions. Follow the procedure listed in Before working inside your system. Remove the system cover. Butterfly module. Steps Hold the touch points and lift the riser 1 module from the connector on the system board. Figure 75. Removing the riser 1 module Next steps Install the riser 1 card Installing the riser 1 module Prerequisites 1.
Figure 76. Installing the riser 1 module Next steps 1. Install the butterfly module. 2. Install the top cover. 3. Follow the procedure listed in After working inside your system Network daughter card Removing the network daughter card Prerequisites 1. 2. 3. 4. 5. 6. 7. Follow the safety guidelines listed in Safety instructions. Follow the procedure listed in Before working inside your system. Remove the system cover.. Remove the air shroud. Butterfly module Riser 2 Module Riser 1 module Steps 1.
Figure 77. Removing the network daughter card Installing the network daughter card Prerequisites Follow the procedure listed in Before working inside your system Steps 1. Orient the NDC so that the Ethernet connectors fit through the slot in the chassis. 2. Align the captive screws at the back-end of the card with the screw holes on the system board. 3. Press the touch points on the card until the card connector is firmly seated on the system board connector. 4.
Figure 78.
System board tray module Removing the system board tray module Prerequisites 1. Follow the safety guidelines listed in Safety instructions. 2. Follow the procedure listed in Before working inside your system. 3. Remove the following: a. Remove the system cover. b. Remove the air shroud. c. Remove the GPU card. d. Remove the GPU support bracket. e. Remove the PCIe switch board module. f. Butterfly module g. Riser 2 Module h. Riser 1 module i. Memory j. Processor and heat sink k.
Figure 80. Removing the system board tray module Next steps Install the system board tray module Installing the system board tray module Prerequisites 1. Follow the safety guidelines listed in Safety instructions. Steps 1. Align the location pin to install system board tray module. 2. Slide the system board tray to T standoff and make sure the T standoff can fix system board tray exactly.
Figure 81. Installing the drive backplane 3. To tighten the screw at the red mark position. Figure 82. Tighten one screw Next steps 1. Reconnect all cables to the system board tray module. 2. Install the following: a. Processor and heat sink b. Memory c. Riser 1 module d. Riser 2 module e. Butterfly module f. GPU support bracket g. GPU card h. Air shroud i. System cover 3.
System board and power interposer board Removing the system board and power interposer board Prerequisites 1. 2. 3. 4. 5. Follow the safety guidelines listed in Safety instructions. Follow the procedure listed in Before working inside your system. Remove the system cover. Remove the air shroud. Remove the system board tray module.Remove the system board tray module. Steps 1. Remove the eighteen screws securing the system board and power interposer board to the system board tray. 2.
Figure 84. Removing the power interposer board Next steps Install the system board and power interposer board. Installing the system board and power interposer board Prerequisites 1. Follow the safety guidelines listed in Safety instructions. Steps 1. Install the power interposer board to the system board. Figure 85. Installing the power interposer board 2. Install system board and power interposer board to system board tray. 3.
Figure 86. Installing the system board and power interposer board Next steps 1. 2. 3. 4. Install the system board tray module. Install the air shroud. Install the top cover.
Backup battery Replacing the backup battery Prerequisites CAUTION: Dispose the battery according to local ordinance. NOTE: You will need to run the BIOS Setup to restore the configuration settings to the RTC. 1. 2. 3. 4. Follow the safety guidelines listed in Safety instructions. Follow the procedure listed in Before working inside your system. Remove the system cover. Remove the butterfly module. Steps 1. Locate the battery on the server board. Figure 87. Locate the battery on the server board 2.
3. 4. 5. 6. Follow the procedure listed in After working inside your system. While booting, press F2 to enter the System Setup and ensure that the battery is operating properly. Enter the correct time and date in the System Setup Time and Date fields. Exit the System Setup. Power distribution board Removing the power distribution board Prerequisites 1. Follow the safety guidelines listed in Safety instructions. 2. Follow the procedure listed in Before working inside your system. 3.
Installing the power distribution board Prerequisites 1. Follow the safety guidelines listed in Safety instructions. Steps 1. Install the power distribution board to the system chassis. 2. Tighten the eight screws to secure the power distribution board to the system chassis. Figure 90. Installing the power distribution board Next steps 1. 2. 3. 4. 5. 6. Connect all cables from the power distribution board. Install the system board tray module. Install the Air shroud Install all the PSUs.
b. c. d. e. f. Remove Remove Remove Remove Remove the the the the the air shroud. GPU card. GPU support bracket. PCIe switch board module. system board tray module. Steps 1. Remove the four screws securing the PSB power interposer board to the system. 2. Lift the PSB power interposer board from the system. Figure 91. Removing the PSB power interposer board Next steps 1. Disconnect all cables from the PSB power interposer board. 2. Install the PSB power interposer board.
Figure 92. Installing the PSB power interposer board Next steps 1. 2. 3. 4. 5. Install the system board tray module. Install the Air shroud Installing a PCIe switch board System cover Follow the procedure that is listed in After working inside your system. Front control module Removing the front control module Prerequisites 1. Follow the safety guidelines listed in Safety instructions. 2. Follow the procedure listed in Before working inside your system. 3. Remove the following: a. System cover. b.
Figure 93. Removing the front control module Next steps 1. Install the front control module. Installing the right control panel Prerequisites 1. Follow the safety guidelines listed in Safety instructions. Steps 1. Install the front control module into the chassis. 2. Secure the front control module using two screws. 3. Connect the front control module cable to the system board and ensure that the cable routing is correct. Figure 94.
Next steps 1. Install the Butterfly module,front bezel,System cover. 2. Follow the procedure listed in After working inside your system. Fan louvers Removing the fan louvers Prerequisites 1. 2. 3. 4. 5. 6. Follow the safety guidelines listed in Safety instructions. Follow the procedure listed in Before working inside your system. Remove the system cover. Remove the PCIe switch board module. Remove the air shroud. Remove the GPU support bracket. Steps 1. Lift the fan louver from the hooks 2.
Installing the fan louvers Prerequisites 1. Follow the safety guidelines listed in Safety instructions. Steps 1. Locate the corresponding hole on the fan cage. Figure 96. Fan louver hook position 2. Hook the fan louver to the fan cage assembly.
Next steps 1. Install the following: a. GPU clamp and GPU card b. Air shroud c. System cover 2. Follow the procedure listed in After working inside your system Cooling fans Replacing a cooling fan Prerequisites CAUTION: Cooling fans are not hot swappable. 1. Follow the safety guidelines listed in Safety instructions. 2. Follow the procedure listed in Before working inside your system. 3. Remove the system cover. Steps 1. Hold the fan and pull it straight up to remove it from the fan cage.
Figure 97. Removing the cooling fan 2. Replace the system fan. CAUTION: To avoid injury, do not remove or install the fan by holding the fan blades. Next steps 1. Install the System cover. 2. Follow the procedure listed in After working inside your system. Fan cage Removing the fan cage Prerequisites 1. 2. 3. 4. 5. 6. 7. 8. 9. Follow the safety guidelines listed in Safety instructions. Follow the procedure listed in Before working inside your system. Remove the system cover.
Figure 98. Removing the fan cage Next steps 1. Install the fan cage Installing the fan cage Prerequisites 1. Follow the safety guidelines listed in Safety instructions. Steps 1. Install the fan cable to the fan cage. 2. Install the fan cage to the power distribution board. 3. Tighten the sixteen screws to secure the fan cage to the system chassis. Figure 99.
Next steps 1. Connect the fan cable to the PSB power interposer board. 2. Install the following: a. Install the front control module. b. System board tray module. c. Air shroud d. PCIe switch board module. e. System cover 3. Follow the procedure listed in After working inside your system Handle Removing the handle Prerequisites 1. Follow the safety guidelines listed in Safety instructions. 2. Follow the procedure listed in Before working inside your system. Steps 1. Unlock the handle by plunger. 2.
Steps 1. Install the handle into the chassis. 2. Lock the handle by plunger. NOTE: Please install the four handles in chassis simultaneously for lifting the system. Figure 101. Installing the handle Next steps 1. Follow the procedure listed in After working inside your system Slide rail installation Prerequisites 1. Follow the safety guidelines listed in Safety instructions. 2. Follow the procedure listed in Before working inside your system. Steps 1.
Figure 102. Removal of the inner member 2. Install the inner member into the chassis. Figure 103. Installation of inner member into the chassis 3. Screw the outer member and bracket into the racket.
Figure 104. Installation of outer member into the rack 4. Insert the chassis to complete the installation. a. b. c. d. 114 Pull the middle rail fully extended in lock position, ensure ball bearing retainer is located at the front of the middle rail. Insert the chassis into middle-outer rails. When hit a stop, please push the release tab on middle rail. Tighten chassis with shipping screws.
Figure 105. Completion of installation CAUTION: Verify ball bearing retainer is locked forward. Next steps 1. Follow the procedure listed in After working inside your system.
7 Cable Routing Figure 106.
• • • • • • • • • • • • • • • • • • • • • • • • 3M cable Installation-Config A left 3M cable Installation-Config A right Fan cable assembly to fan bracket Fan cable MB-PDB assembly to MB Fan cable MB-PDB assembly to PDB Front control cable assembly control board to MB GPU power cable assembly GPU card to PSB IDC cable MB-PDB assembly to PDB IDC cable MB-PDB assembly to MB IDC cable PDB-PIB assembly to PIB IDC cable PIB-PDB assembly to PDB IDC cable Riser1-PDB assembly to PDB IDC cable Riser1-PDB assembly t
Table 16.
3M cable Installation-Config A left Figure 107.
3M cable Installation-Config A right Figure 108.
Fan cable assembly to fan bracket Figure 109. Fan cable assembly to fan bracket Figure 110.
Figure 111. Fan cable assembly to fan bracket Figure 112.
Figure 113. Fan cable assembly to fan bracket Figure 114.
Figure 115.
Fan cable MB-PDB assembly to MB Figure 116.
Fan cable MB-PDB assembly to PDB Figure 117. Fan cable MB-PDB assembly to PDB Figure 118.
Front control cable assembly control board to MB Figure 119. Front control cable assembly control board to MB Figure 120.
Figure 121. Front control cable assembly control board to MB GPU power cable assembly GPU card to PSB Figure 122.
IDC cable MB-PDB assembly to PDB Figure 123. IDC cable MB-PDB assembly to PDB IDC cable MB-PDB assembly to MB Figure 124.
IDC cable PDB-PIB assembly to PIB Figure 125.
IDC cable PIB-PDB assembly to PDB Figure 126.
IDC cable Riser1-PDB assembly to PDB Figure 127. IDC cable Riser1-PDB assembly to PDB IDC cable Riser1-PDB assembly to riser board1 Figure 128.
IDC cable PIB-PDB assembly to PDB Figure 129. IDC cable Riser2-PDB assembly to PDB IDC cable Riser 2- PDB assembly to riser board 2 Figure 130.
Mini SAS HD cable assembly PERC-HDBP Figure 131. Mini SAS HD cable assembly PERC-HDBP Mini SAS HD cable assembly HDBP-MB Figure 132.
Power cable BP-PDB assembly to BP Figure 133. Power cable BP-PDB assembly to BP Power cable BP-PDB assembly to PDB Figure 134.
Power cable assembly to PDB Figure 135. Power cable assembly to PDB Figure 136.
Figure 137. Power cable assembly to PDB Figure 138.
Figure 139. Power cable assembly to PDB Figure 140.
Figure 141. Power cable assembly to PDB Figure 142.
Figure 143. Power cable assembly to PDB Figure 144.
Figure 145. Power cable assembly to PDB Figure 146.
Figure 147. Power cable assembly to PDB Figure 148.
Figure 149. Power cable assembly to PDB Figure 150.
Power cable assembly to PIB Figure 151. Power cable assembly to PIB Power cable1 assembly to Riser1 Figure 152.
Figure 153. Power cable1 assembly to Riser1 Figure 154.
Power cable2 Riser-PDB assembly to PDB Figure 155.
Power cable2 Riser-PDB assembly to Riser Figure 156.
8 Jumpers and connectors Topics: • • • 148 System Board Connectors System board jumpers settings Disabling forgotten password Jumpers and connectors
System Board Connectors Figure 157. System Board Connectors Table 17.
Table 17.
System board jumpers settings Table 18. System board jumper settings Jumper Setting PWRD_EN Description The password reset feature is enabled . The password reset feature is disabled. iDRAC local access is unlock at next AC power cycle. iDRAC password reset is enabled in F2 iDRAC settings menu. NVRAM_CLR The configuration settings are retained at the next system boot. The configuration settings are cleared at system boot.
9 Getting help Topics: • • Contacting Dell EMC Documentation feedback Contacting Dell EMC Dell EMC provides several online and telephone based support and service options. If you do not have an active internet connection, you can find contact information about your purchase invoice, packing slip, bill, or Dell EMC product catalog. Availability varies by country and product, and some services may not be available in your area.
