ESC4000A-E12 2U Rackmount Server User Guide
E21688 Revised Edition V2 February 2023 Copyright © 2023 ASUSTeK COMPUTER INC. All Rights Reserved. No part of this manual, including the products and software described in it, may be reproduced, transmitted, transcribed, stored in a retrieval system, or translated into any language in any form or by any means, except documentation kept by the purchaser for backup purposes, without the express written permission of ASUSTeK COMPUTER INC. (“ASUS”).
Contents Safety information....................................................................................................... vi About this guide........................................................................................................ viii Chapter 1: Product Introduction 1.1 System package contents.......................................................................... 1-2 1.2 Serial number label.....................................................................................
Contents 2.6 Cable connections.................................................................................... 2-37 2.7 SATA/SAS/NVMe backplane cabling....................................................... 2-38 2.8 2.9 Removable/optional components............................................................ 2-40 2.8.1 System fans............................................................................... 2-40 2.8.2 Redundant power supply units................................................
Contents 4.5.8 Network Stack Configuration..................................................... 4-25 4.5.9 NVMe Configuration................................................................... 4-26 4.5.10 SATA Configuration................................................................... 4-26 4.5.11 APM Configuration..................................................................... 4-26 4.5.12 AMD Mem Configuration Status................................................ 4-27 4.5.13 T1s Auth..
Safety information Electrical Safety • Before installing or removing signal cables, ensure that the power cables for the system unit and all attached devices are unplugged. • To prevent electrical shock hazard, disconnect the power cable from the electrical outlet before relocating the system. • When adding or removing any additional devices to or from the system, ensure that the power cables for the devices are unplugged before the signal cables are connected.
Lithium-Ion Battery Warning CAUTION: Danger of explosion if battery is incorrectly replaced. Replace only with the same or equivalent type recommended by the manufacturer. Dispose of used batteries according to the manufacturer’s instructions. Avertissement sur les batteries Lithium-Ion ATTENTION : Danger d’explosion si la batterie n’est pas correctement remplacée. Remplacer uniquement avec une batterie de type semblable ou équivalent, recommandée par le fabricant.
About this guide Audience This user guide is intended for system integrators, and experienced users with at least basic knowledge of configuring a server. Contents This guide contains the following parts: 1. Chapter 1: Product Introduction This chapter describes the general features of the server, including sections on front panel and rear panel specifications. 2.
Conventions To ensure that you perform certain tasks properly, take note of the following symbols used throughout this manual. DANGER/WARNING: Information to prevent injury to yourself when trying to complete a task. CAUTION: Information to prevent damage to the components when trying to complete a task. IMPORTANT: Instructions that you MUST follow to complete a task. NOTE: Tips and additional information to help you complete a task. Typography Bold text Indicates a menu or an item to select.
x
Chapter 1: Product Introduction Product Introduction This chapter describes the general features of the server. It includes sections on front panel and rear panel specifications.
1.1 System package contents Check your system package for the following items.
1.3 System specifications The ASUS ESC4000A-E12 Series servers features the ASUS K14PG-U12 server board that supports the AMD EPYC™ 9004 Series Processor Family. Model Name Processor Total Slots Capacity Memory ESC4000A-E12 1 x Socket SP5 (LGA 6096) Memory Type AMD EPYC™ 9004 Series Processor Family (up to TDP 400W) 12 (12 channels per CPU, 12 DIMM per CPU) Up to 3TB per CPU socket DDR5 4800/4400 RDIMM / 3DS RDIMM * Please refer to www.asus.
Model Name ESC4000A-E12 2 x Gigabit LAN ports (Intel® I350) Networking VGA Graphics Front I/O ports 1 x Dedicated Management port AST2600 64MB Up to 4 dual-slot or 8 single-slot GPU cards 4 x USB 3.2 Gen 1 ports 2 x USB 3.
1.4 Front panel features The barebone server features a simple yet stylish front panel. The power and location buttons, LED indicators, and USB ports are located and easily accessible on the front panel. Q-code/Port 80 LED Half-length / Low-profile expansion slot Hot-swap 2.5-inch storage bay Power button USB 3.2 Gen 1 ports Location button Front panel LEDs USB 3.2 Gen 1 ports Hot-swap 2.5-inch storage bay 1 2 Redundant power supply units Hot-swap 3.5-inch storage bays Hot-swap 3.
1.6 Internal features The barebone server includes the basic components as shown. GPU FAN1 GPU FAN3 GPU FAN4 FAN4 FAN3 FAN2 FAN1 1. Redundant power supply and power fan (hidden) 2. ASUS K14PG-U12 server board 3. System fans 4. SATA/SAS/NVME backplanes 5. SATA/SAS/NVME hotswap storage bays 6. PCIe expansion boards (hidden) 7. PCIe x32 links with rear riser card 8. Half-length / Low-profile expansion slot GPU FAN2 A protection film is pre-attached to the front cover before shipping.
1.7 LED information 1.7.
2 1.7.
2 1.7.
1.7.
1.7.
ACTION PHASE PSP Boot PSP Boot Loader phase (Error Post Codes) POST CODE 0x3B 0x3C 0x3D 0x3E 0x3F 0x40 0x41 0x42 0x43 0x44 0x45 0x46 0x47 0x48 0x49 0x4A 0x4B 0x4C 0x4D 0x4E 0x4F 0x50 0x51 0x52 0x53 0x54 0x55 0x56 0x57 0x58 0x59 0x5A 0x5B 0x5C 0x5D 0x5E 0x5F 0x60 0x61 0x62 0x63 0x64 0x65 0x66 0x67 0x68 0x69 0x6A 0x6B 0x6C 0x6D 0x6E 0x6F 0x70 0x71 0x72 0x73 0x74 0x75 0x76 0x77 0x78 0x79 0x7A 0x7B 0x7C TYPE error error error error error error error error error error error error error error error error err
ACTION PSP Boot PHASE POST CODE TYPE 0x7D error 0x7E 0x7F 0x80 error error error 0x81 error 0x82 error 0x83 0x84 error error 0x85 error DESCRIPTION Bootloader detects BIOS request boot from SPI-ROM, which is unsupported for PSB.
ACTION PSP Boot Quick VGA PHASE POST CODE 0xBB 0xBC 0xBD 0xBE 0xBF 0xC0 0xC1 0xC2 0xC3 0xC4 0xC5 0xC6 0xC7 0xC8 0xC9 0xCA 0xCB 0xCC 0xCD 0xCE 0xCF 0xD0 0xD1 0xD2 0xD3 0xD4 0xD5 0xD6 0xD7 PSP Boot Loader phase (Status Post 0xD8 Codes) 0xD9 0xDA 0xDB 0xDC 0xDD 0xE0 0xE2 0xE3 0xE4 0xE5 0xE6 0xE7 0xE8 0xE9 0xEA 0xEB 0xEC 0xED 0xEE 0xEF 0xF0 0xF1 0xF2 0xF3 0xF4 0xF5 0xF6 0xF7 0xFF 0x10 0x11 PEI(Pre-EFI Initialization) phase 0x15 0x19 TYPE error error error error error error error error error error error err
ACTION Quick VGA Normal boot PHASE POST CODE 0x32 0x33 0x34 0x35 0x36 0x37 0x3B 0x4F 0x60 DXE(Driver 0x61 Execution Environment) phase 0x62 0x63 0x68 0x69 0x6A 0x70 0x71 0x72 0x78 0xD0 0x90 0x91 0x92 0x93 0x94 0x95 0x96 0x97 0x98 0x99 0x9A 0x9B 0x9C BDS(Boot Device 0x9D Selection) phase 0xb3 0xb4 0xb6 0xb7 0xA0 0xA1 0xA2 0xA3 0x00~0xFF 0xA8 0xA9 0xAB 0xAD Operating system 0xAA phase 0xAC ASUS ESC4000A-E12 TYPE Progress Progress Progress Progress Progress Progress Progress Progress Progress Progress Pr
1-16 Chapter 1: Product Introduction
Chapter 2: Hardware Setup Hardware Setup This chapter lists the hardware setup procedures that you have to perform when installing or removing system components.
2.1 Chassis cover There are three parts of the chassis cover you may remove. The diagrams in this section are for reference only. The system layout may vary with models, but the installation steps are the same for all models. To remove the rear chassis cover: 2-2 1. Loosen the two (2) thumbscrews on the rear of the chassis. 2. Push and hold the cover buttons down, then slide the chassis cover towards the rear to disengage it from the chassis. 3.
To remove the middle chassis cover: 1. Remove the two screws as shown. 2. Press the cover latches down on both sides of the middle chassis cover. 3. Lift the chassis cover to completely remove it from the chassis. To remove the front chassis cover: 1. Push and hold the cover buttons down, then slide the chassis cover towards the front to disengage it from the chassis. 2. Lift the chassis cover to completely remove it from the chassis.
2.1.1 Air duct The diagrams in this section are for reference only. The system layout may vary with models, but the installation steps are the same for all models. To remove the air duct: 1. Loosen the two (2) thumbscrews as shown. 2. Lift the air duct to remove it from the chassis. To reinstall the air duct: 2-4 1. Align and install the air duct to the chassis ensuring that the screw holes on the air duct match the screw holes on the chassis. 2.
2.2 Central Processing Unit (CPU) The motherboard comes with a surface mount SP5 socket designed for the AMD EPYC™ 9004 Series Family processors. 2.2.1 • Upon purchase of the motherboard, ensure that the PnP cap is on the socket and the socket contacts are not bent. Contact your retailer immediately if the PnP cap is missing, or if you see any damage to the PnP cap/socket contacts/motherboard components. ASUS will bear the cost of repair only if the damage is shipment/transitrelated.
4. Loosen the screw on the socket to open the load plate. The load plate screws are T20 models. A torque value of 13.5±1.0 kgf-cm (11.7±0.9 lbf-in) is recommended. Load plate 5. Lift open the rail frame. Rail frame External cap External cap 6. Slide the external cap out of the rail frame.
7. Slide the carrier frame with CPU into the rail frame, then remove the PnP cap. The carrier frame with CPU fits in only one correct orientation. DO NOT force the carrier frame with CPU into the rail frame. 8. Gently close the rail frame just enough to let it sit on top of the CPU socket. Carrier frame with CPU 9. Close the load plate just enough to let it sit on top of the CPU, then secure the load plate using the screw on the socket. The load plate screws are T20 models. A torque value of 13.5±1.
10. Place the heatsink on the CPU socket and make sure the heatsink screws are aligned with the CPU socket. 11. The below instructions must be followed when securing the heatsink to the motherboard. The order in which the screws should be tightened is shown both in the illustration below and on the heatsink. A. B. C. Tighten screw just enough to attach the heatsink to the motherboard. Fully tighten screw , then fully tighten screw .
2.3 System memory 2.3.1 Overview The motherboard comes with twelve (12) Double Data Rate 5 (DDR5) Dual Inline Memory Modules (DIMM) sockets.
2.3.2 Memory Configurations You may install 16 GB, 32 GB, 64 GB DDR5 RDIMM / 128 GB, 256 GB DDR5 3DS RDIMM into the DIMM sockets using the memory configurations in this section. • Refer to ASUS Server AVL for the updated list of compatible DIMMs. • Always install DIMMs with the same CAS latency. For optimum compatibility, it is recommended that you obtain memory modules from the same vendor.
3. Hold the DIMM on both ends, then insert the DIMM vertically into the socket. Apply force to both ends of the DIMM simultaneously until the retaining clip snaps back into place, and the DIMM cannot be pushed in any further to ensure proper sitting of the DIMM. Locked Retaining Clip Always insert the DIMM into the socket VERTICALLY to prevent damage to the DIMM notch. • To install two or more DIMMs, refer to the user guide bundled in the motherboard package. • Refer to www.asus.
2.4 Storage devices The chassis supports the following storage configurations: • 2 x 2.5-inch storage devices and 4 x 3.5-inch storage devices • 6 x 2.5-inch storage devices Storage bay 1 (2.5-inch) Storage bay 2 (2.5-inch) 2 Storage bay 3 and 4 (2.5-inch or 3.5-inch) 2.4.1 1 Storage bay 5 and 6 (2.5-inch or 3.5-inch) Installing a 3.5-inch SATA/SAS storage device. DM 2-12 1. Press the spring lock. 2. Pull the tray lever outwards to remove the drive tray. 3.
4. 5. Push the storage device and drive tray assembly all the way into the the drive bay until the tray lever and spring lock clicks and secures the drive tray in place. • When installed, the SATA/SAS connector on the drive connects to the SATA/SAS interface on the backplane. • The drive tray is correctly placed when its front edge aligns with the bay edge. Repeat steps 1 to 4 to install additional 3.5” storage devices.. 2.4.2 Installing a 2.5-inch SATA/SAS/NVMe storage device. To install 2.
4. Insert the tool-less 2.5-inch tray into the device tray until it clicks in place. 5. Push the storage device and drive tray assembly all the way into the the drive bay until the tray lever and spring lock clicks and secures the drive tray in place. 6. Repeat steps 1 to 5 to install additional 2.5” storage devices. To install 2.5-inch storage devices into storage bays 3, 4, 5, and 6: 1. Remove the drive tray. Refer to the Installing a 3.
2.5 Expansion slots Make sure to unplug the power cord before adding or removing expansion cards. Failure to do so may cause you physical injury and damage motherboard components. 2.5.1 Installing a PCIe expansion card The onboard PCI Express slot on the motherboard comes pre-installed with a riser card that supports two x16 slots (1 x Gen5 x16 link, 1 x Gen5 x8/x16 link) for full-height/half-length PCIe cards and one x8 slot (Gen5 x0/x8 link) for installing low-profile/half-length PCIe cards.
3. Remove the metal covers from the riser card. 2 2 4. 2 Prepare the expansion cards. Before installing an expansion card, read the documentation that came with it and ensure that the proper hardware settings are configured. 5. Align and insert the golden finger connectors of the expansion cards into the PCIe slot connectors on the riser card as shown.
6. Replace the metal covers for any unused PCIe slots, then secure the PCIe lock using the screw removed earlier. 7. Align and insert the riser card and expansion card assembly into the PCIe slot on the motherboard.
2.5.2 Installing an OCP3.0 slot baseboard The onboard PCI Express slot on the motherboard comes pre-installed with a riser card that supports an OCP3.0 slot baseboard. 1. Remove the riser card, then remove the PCIe lock and metal covers. Refer to the Installing a PCIe expansion card section for the steps on removing the riser card, PCIe lock, and metal covers. 2. Prepare the OCP3.0 slot baseboard and insert the golden finger connectors into the PCIe connectors on the riser card as shown. 2 2 3.
2.5.3 Installing a PIKE II or RAID card A PIKE II or RAID card can be installed in the internal SAS/HBA/Storage bracket located in the front of the system. 1. Remove the four (4) system fans as shown. Refer to the Removable/Optional Components section for the steps on removing the system fans. 2. Remove the four (4) screws from the fan cage as shown.
2-20 3. Remove the fan cage from the system chassis. 4. Remove the ten (10) screws as shown, then remove the two (2) fans and fan cages from the system chassis.
5. Remove the two (2) screws from the internal bracket as shown. 6. Remove the screw from the metal cover, then remove the metal cover.
7. (Optional) To install an ASUS PIKE II 3108 RAID card and cache vault, follow the below instructions to install the cache vault add-on card: a. Align the two spacers with the screw holes on the ASUS PIKE II card, then secure the two spacers with two screws from the bottom of the card. b. Align and install the bundled cache vault add-on card onto the connector on the ASUS PIKE II card, then secure it to the two spacers with two screws. c.
9. Refer to the below instructions to connect the PIKE II or RAID card: To connect a PIKE II 3008 / PIKE II 3108 card: a. Disconnect the default SLIMSAS cables connected to SLIMSAS1 on the left and right backplanes. SGPIO_SW1 BP_NUM_SW1 TRI_DIS1 MCIO1 SLIMSAS1 MCIO3 SLIMSAS1 MCIO3 BPPWR4 BPPWR4 MCIO4 Left backplane VPP_I2C1 BP_TP_BP1 VPP_I2C1 BP_TP_BP1 MCIO4 SGPIO_SW1 BP_NUM_SW1 TRI_DIS1 MCIO1 Right backplane b.
To connect a 9540 RAID card in NVME configuration: a. Connect the SLIMSAS connector on the RAID card to MCIO3 and MCIO4 on the left backplane using the bundled cables.
To connect a 9540 RAID card in SATA configuration: a. Disconnect the default SLIMSAS cables connected to SLIMSAS1 on the left and right backplanes. SGPIO_SW1 BP_NUM_SW1 TRI_DIS1 MCIO1 SLIMSAS1 MCIO3 MCIO3 BPPWR4 b. BPPWR4 MCIO4 VPP_I2C1 Left backplane SLIMSAS1 BP_TP_BP1 VPP_I2C1 BP_TP_BP1 MCIO4 SGPIO_SW1 BP_NUM_SW1 TRI_DIS1 MCIO1 Right backplane Connect the SLIMSAS connector on the RAID card to SLIMSAS1 on the left and right backplanes using the bundled cables.
To connect a 9560 RAID card in NVME configuration: a. Disconnect the default MCIO cables connected to MCIO3 and MCIO4 on the right backplane. SGPIO_SW1 BP_NUM_SW1 TRI_DIS1 MCIO1 MCIO3 SLIMSAS1 VPP_I2C1 BP_TP_BP1 MCIO4 BPPWR4 Right backplane b. Connect the left SLIMSAS connector (B) on the RAID card to MCIO3 and MCIO4 on the left backplane using the bundled cables. c. Connect the right SLIMSAS connector (C) on the RAID card to MCIO3 and MCIO4 on the right backplane using the bundled cables.
To connect a 9560 RAID card in SATA configuration: a. Disconnect the default SLIMSAS cables connected to SLIMSAS1 on the left and right backplanes. SGPIO_SW1 BP_NUM_SW1 TRI_DIS1 MCIO1 SLIMSAS1 MCIO3 MCIO3 BPPWR4 BPPWR4 MCIO4 VPP_I2C1 Left backplane SLIMSAS1 BP_TP_BP1 VPP_I2C1 BP_TP_BP1 MCIO4 SGPIO_SW1 BP_NUM_SW1 TRI_DIS1 MCIO1 Right backplane b. Connect the left SLIMSAS connector (B) on the RAID card to MCIO3 and MCIO4 on the left backplane using the bundled cables. c.
10. Secure the internal bracket using the two screws removed earlier. 11. (Optional) Refer to the Installing the Cache Vault Power Module section to install and connect the Cache Vault Power Module. The cache vault is required for the PIKE II 3108 card or the 9560 RAID card. 12. 2-28 Align and install the two (2) fans and fan cages, then secure it using the ten (10) screws removed previously.
13. Align and install the fan cage, then secure it using the four (4) screws removed earlier. 14. Install the four (4) system fans into the fan cage.
2.5.4 2-30 Installing the Cache Vault Power Module 1. Disconnect the three (3) cables from the Front Panel Module, then remove the two (2) screws. 2. From the back of the Front Panel Module, push the Front Panel Module out of the system.
3. Align the three screw holes on the Cache Vault Power Module clip with the three screw holes on the Front Panel Module, then secure the clip with the three bundled screws. 4. Align and install the Cache Vault Power Module into the Cache Vault Power Module clip.
5. Insert the Front Panel Module into the system. 6. Connect the Cache Vault Power Module to the PIKE II card or RAID card. 7. Reconnect the three (3) cables to the Front Panel Module, then secure the Front Panel Module using the two (2) screws removed earlier. When reconnecting the cables, ensure that the cables are not placed on top of the Cache Vault Power Module.
2.5.5 Installing an M.2 (NGFF) card You may install an M.2 card (up to 22110) to the PCIe 5.0 M.2 card. 1. Remove the four (4) cover screws that secure the cover to the PCIe 5.0 M.2 card, then remove the cover and set it aside. 2. Peel the plastic film off the thermal pad next to the M.2 slot.
2-34 3. Secure the bundled stand screw onto the PCIe 5.0 M.2 card. 4. Install the M.2 storage device into the onboard M.2 slot (A), then secure the M.2 storage device with the bundled screw (B). 5. Peel the plastic film off the thermal pad on the heatsink (A), secure the cover onto the PCIe 5.0 M.2 card with the cover screws that you removed earlier (B), then install the PCIe 5.0 M.2 card into the PCIe slot on the rear riser card.
2.5.6 (optional) Installing the PFR module The optional PFR module will come pre-installed on your system and is connected to the PFR module connector on your motherboard. • The illustration below is for reference only. • For more information or assistance, please refer to www.asus.com. 1. Locate the PFR module connector on your motherboard. 2. Align and connect the PFR module to the PFR module connector. 3.
2.5.7 Configuring an expansion card After installing the expansion card, configure it by adjusting the software settings. 1. Turn on the system and change the necessary BIOS settings, if any. Refer to the BIOS Setup chapter for information on BIOS setup. 2. Assign an IRQ to the card. Refer to the Standard Interrupt assignments table for more information. 3. Install the software drivers for the expansion card.
2.6 Cable connections • The bundled system cables are pre-connected before shipment. You do not need to disconnect these cables unless you remove the pre‑installed components to install additional devices. • Refer to the Motherboard Information chapter for detailed information on the connectors. Pre-connected system cables 1. PWR1 power connector (from the power distribution board to the motherboard) 2. SLIMPCIE_SATA1 connector (from the motherboard to the backplane board) 3.
2.
Connect MCIO1 on the Left Backplane to MCIO3PCIE on the Motherboard Connect MCIO2 on the Left Backplane to MCIO2PCIE on the Motherboard Connect MCIO3 on the Left Backplane to MCIO2PCIE on the Motherboard Connect SLIMSAS1 on the Left Backplane to SLIMPCIE_SATA1 on the Motherboard Connect BPPWR4 on the Left Backplane to BPPWR2 on the Power Distribution Board Connect MCIO1 on the Right Backplane to MCIO3PCIE on the Motherboard Connect MCIO2 on the Right Backplane to MCIO1PCIE on the Motherboard Connect MCIO3 o
2.8 Removable/optional components The following sections describe installation or removal instructions for the following removable/optional components: 1. System fans 2. Redundant power supply units 3. GPUs 4. GPU bridges Ensure that the system is turned off before removing any components. 2.8.1 System fans To uninstall the system fans: 1. Hold the system fan by the notches, then press the latch inwards to release the system fan from the fan cage. 2. Lift the fan, then set it aside. 3.
2.8.2 Redundant power supply units We recommend that you use both of your hands when performing the following steps. To replace a power supply unit (PSU): 1. Unplug the PSU power cable. 2. Lift up the PSU lever. 3. Hold the PSU lever, press the PSU latch (A), then carefully pull the PSU out of the system chassis (B).
4. Prepare the replacement PSU. 5. Align and insert the replacement PSU into the empty PSU bay until it clicks in place. 6. Reconnect the PSU power cable. • The system automatically combines the two power supply modules as a single one. The combined output power varies with input voltages. Refer to the table below for details. 2600W 2-42 Input Voltage Max. Output Power (Watt) per PSU 100V-127Vac, 13.
2 2.8.3 1 Installing GPUs Follow the steps below to install an optional GPU to the system. 1. Locate and loosen the two thumbscrews at the rear of the chassis. DM 1 2. 2 Locate and loosen the thumbscrew in front of the GPU bracket (A), then firmly hold and pull the GPU bracket upwards to remove it from the system (B). Detach the power cables from the cable organizer on the side of the GPU bracket before removing the left GPU bracket. 3. Prepare the GPU air duct and the GPU.
The dongle comes with your Nvidia CPU-12V GPU card. Ask your vendor or retailer if the dongle is missing. Nvidia CPU-12V GPU card dongle 4. ASUS CPU 8-pin power cable Pass the power cable through the air duct as shown.
5. From inside the air duct, secure the air duct to the GPU with two screws. 6. Connect the GPU power cable, dongle, or ASUS CPU 8-pin power cable to the connector on the GPU as shown. For AMD/Nvidia GPU card installation 4-pin connector For Nvidia CPU-12V GPU card installation OR dongle ASUS CPU 8-pin power cable When using the dongle, connect a GPU power cable to the connector on the dongle.
2-46 7. Place the GPU bracket on a flat and stable surface. 8. Loosen the two thumbscrews and remove the PCIe lock (A), then remove the metal covers (B). 9. Insert the GPU cables into the opening on the bracket. 10. Align and insert the golden fingers of the GPU into the card slot on the bracket. Ensure the card is completely seated on the slot. 11. Replace the metal covers for any unused PCIe slots, then secure the PCIe lock using the two thumbscrews. 12.
13. (Optional) Repeat steps 3-12 to install a second GPU to the bracket. 14. Align and insert the golden fingers of the GPU bracket into the card slot on the motherboard. Ensure the bracket is completely seated on the slot. 15. Secure the thumbscrew in front of the GPU bracket. 2 1 16. Connect the GPU power cable to an available 6-pin power connector (VGAPWR1-8) on the motherboard. 17. Secure the two thumbscrews at the rear of the chassis.
2.8.4 Installing a GPU bridge Follow the steps below to install an optional GPU bridge to supported GPU cards. For AMD GPU cards with GPU bridge support Align the GPU bridge with the golden finger connectors on the GPU cards, then install the GPU bridge. For NVidia A100 GPU cards Align the three GPU bridges with the golden finger connectors on the GPU cards, then install the GPU bridges.
Motherboard Information This chapter gives information about the motherboard that comes with the server. This chapter includes the motherboard layout, jumper settings, and connector locations.
3.
Layout contents Central Processing Unit (CPU) Page 1. 3-4 CPU socket(s) Dual Inline Memory Module (DIMM) Page 1. 3-5 DIMM sockets Jumpers Page 1. Clear RTC RAM (CLRTC1) 3-6 2. VGA Controller setting (3-pin VGA_SW1) 3-7 3. Baseboard Management Controller setting (3-pin BMC_EN1) 3-7 4. DMLAN setting (3-pin DM_IP_SEL1) 3-8 5. IPMI SW setting (3-pin IPMI_SW1) 3-8 6. Heatsink Type setting (3-pin HS_TYPE1) 3-9 7. LANNCSI_SEL1 setting (3-pin LANNCSI_SEL1) 3-9 8.
Onboard LEDs Page 1. Standby Power LED (SBPWR1) 3-20 2. Baseboard Management Controller LED (BMCLED1) 3-20 3. Hard Disk Activity LED (HDDLED1) 3-21 4. Message LED (MESLED1) 3-21 5. Location LED (LOCLED1) 3-22 3.2 Central Processing Unit (CPU) The motherboard comes with a surface mount SP5 socket designed for the AMD EPYC™ 9004 Series Family processors.
3.3 Dual Inline Memory Module (DIMM) The motherboard comes with twelve (12) Double Data Rate 5 (DDR5) Dual Inline Memory Modules (DIMM) sockets.
3.4 1. Jumpers Clear RTC RAM (CLRTC1) This jumper allows you to clear the CMOS memory system setup parameters by erasing the CMOS Real Time Clock (RTC) RAM data. The onboard button cell battery powers the RAM data in CMOS, which includes system setup information such as system passwords. To erase the RTC RAM: 1. Turn OFF the computer and unplug the power cord. 2. Move the jumper cap from pins 1–2 (default) to pins 2–3. Keep the cap on pins 2–3 for about 5–10 seconds, then move the cap back to pins 1–2.
2. VGA Controller setting (3-pin VGA_SW1) This jumper allows you to enable or disable the onboard VGA controller. Set to pins 1–2 to activate the VGA feature. 3. Baseboard Management Controller setting (3-pin BMC_EN1) This jumper allows you to enable (default) or disable on-board BMC. Ensure to set this BMC jumper to enabled to avoid system fan control and hardware monitor error.
4. DMLAN setting (3-pin DM_IP_SEL1) This jumper allows you to select the DMLAN setting. Set to pins 2-3 to force the DMLAN IP to static mode (IP=10.10.10.10, submask=255.255.255.0). 5. IPMI SW setting (3-pin IPMI_SW1) This jumper allows you to select which protocol in the GPU sensor to function.
6. Heatsink Type setting (3-pin HS_TYPE1) This jumper allows you to set the fan curve used. 7. LANNCSI setting (3-pin LANNCSI_SEL1) This jumper allows you to select which LAN NCSI function to use.
8. PSU_ALT1 (3-pin PSU_ALT1) This jumper allows you to enable or disable the PSU SMB alert.
3.5 1. Internal connectors SLIMPCIE connector (SLIMPCIE_SATA1) Connects the SATA signal to the SLIMSAS1 ports on the backplanes. 2. MCIOPCIE connectors (MCIOPCIE1-3) Connects the PCIe signal to the MCIO ports on the backplanes.
3. USB 3.2 Gen 1 connectors (SLIMUSB1) Connect a compatible USB module cable to the SLIMUSB1 connector, and then install the module to a slot opening at the back or front of the system chassis. (SLIMUSB1 connector is used for the front USB panel by default). 4. Chassis Intrusion connector (2-pin INTRUSION1) These leads are for the intrusion detection feature for chassis with intrusion sensor or microswitch.
5. Serial Port connector (10-1 pin COM1) This connector is for the serial COM port. Connect the serial port module cable to one of these connectors, then install the module to a slot opening at the back of the system chassis. 6. TPM connector (14-1 pin TPM1) This connector supports a Trusted Platform Module (TPM) system, which can securely store keys, digital certificates, passwords, and data.
7. Power connector (PWR1) Connects to the power sharing board and supplies power to the motherboard. 3-14 • Use of a PSU with a higher power output is recommended when configuring a system with more power-consuming devices. The system may become unstable or may not boot up if the power is inadequate. • Ensure that your power supply unit (PSU) can provide at least the minimum power required by your system.
8. VGA Power Connectors (8-pin VGAPWR1-8) These 12V connectors supply power to the VGA cards. The 6-pin ATX power supply plugs are designed to fit these connectors in only one orientation. Find the proper orientation and push down firmly until the connectors completely fit.
9. MicroSD Card slot (MSD1) The microSD card slot allows you to install a microSD memory card v2.00 (SDHC) / v3.00 (SDXC) to log BMC events. Disconnect all power (including redundant PSUs) from the existing system before you add or remove a memory card, then reboot the system to access the memory card. Some memory cards may not be compatible with your motherboard. Ensure that you use only compatible memory cards to prevent loss of data, damage to your device or memory card, or both.
10. BMC Debug UART connector (3-pin BMC_DEBUGUART1) This connector is used for reading the BMC UART Debug log.
11. Platform Firmware Resilience (PFR) Module connector (ROT_CON) This connector allows you to connect a PFR module to enable platform firmware resilience functions. 12. System Panel connector (20-pin SYS_PANEL2) This connector supports several chassis-mounted functions.
13. BF Power connector (6-pin BFPWR1) This connector supplies power to the optional BlueField Ethernet DPU card. The 6-pin ATX power supply plug is designed to fit this connector in only one orientation. Find the proper orientation and push down firmly until the connector completely fits. This power connector supplies a maximum of 150W and is only intended for use with a Bluefield Ethernet DPU card.
3.6 1. Onboard LEDs Standby Power LED (SBPWR1) The motherboard comes with a standby power LED. The green LED lights up to indicate that the system is ON, in sleep mode, or in soft-off mode. This is a reminder that you should shut down the system and unplug the power cable before removing or plugging in any motherboard component. The illustration below shows the location of the onboard LED. 2.
3. Hard Disk Activity LED (HDDLED1) This LED is for the storage devices connected to the onboard SATA, or SATA/SAS add-on card. The read or write activities of any device connected to the onboard SATA, or SATA/SAS add-on card causes the rear panel LED to light up. 4. Message LED (MESLED1) This onboard LED lights up to red when there is temperature warning or a BMC event log is generated.
5. Location LED (LOCLED1) This onboard LED lights up when the Location button on the server is pressed or when triggered by a system management software. The Location LED helps visually locate and quickly identify the server on a server rack.
BIOS Setup This chapter tells how to change system settings through the BIOS Setup menus and describes the BIOS parameters.
4.1 Managing and updating your BIOS The following utilities allow you to manage and update the motherboard Basic Input/Output System (BIOS) setup: 1. ASUS CrashFree BIOS 3 To recover the BIOS using a bootable USB flash disk drive if the BIOS file fails or gets corrupted. 2. ASUS EzFlash Updates the BIOS using a USB flash disk. 3. BUPDATER Updates the BIOS in DOS mode using a bootable USB flash disk drive. Refer to the corresponding sections for details on these utilities.
4.1.2 ASUS EZ Flash Utility The ASUS EZ Flash Utility feature allows you to update the BIOS without having to use a DOS‑based utility. Before you start using this utility, download the latest BIOS from the ASUS website at www.asus.com. To update the BIOS using EZ Flash Utility: 1. Insert the USB flash disk that contains the latest BIOS file into the USB port. 2. Enter the BIOS setup program. Go to the Tool menu, then select Start ASUS EZ Flash. Press . ASUS Tek.
4.1.3 BUPDATER utility The succeeding BIOS screens are for reference only. The actual BIOS screen displays may not be the same as shown. The BUPDATER utility allows you to update the BIOS file in the DOS environment using a bootable USB flash disk drive with the updated BIOS file. Updating the BIOS file To update the BIOS file using the BUPDATER utility: 1. Visit the ASUS website at www.asus.com and download the latest BIOS file for the motherboard. Save the BIOS file to a bootable USB flash disk drive.
4. The utility verifies the file, then starts updating the BIOS file. ASUS Tek. EzFlash Utility Current Platform Platform : K14PG-U12 Version : 0102 Build date: 04/01/2022 Start Programming Flash. New Platform Platform : K14PG-U12 Version : 0104 Build date: 10/27/2022 DO NOT SHUTDOWN THE SYSTEM!!! Write 75% DO NOT shut down or reset the system while updating the BIOS to prevent system boot failure! 5. The utility returns to the DOS prompt after the BIOS update process is completed.
4.2 BIOS setup program This motherboard supports a programmable firmware chip that you can update using the provided utility described in the Managing and updating your BIOS section. Use the BIOS Setup program when you are installing a motherboard, reconfiguring your system, or prompted to “Run Setup.” This section explains how to configure your system using this utility. Even if you are not prompted to use the Setup program, you can change the configuration of your computer in the future.
4.2.1 BIOS menu screen Menu items Menu bar Configuration fields General help Navigation keys 4.2.
Menu items The highlighted item on the menu bar displays the specific items for that menu. For example, selecting Main shows the Main menu items. The other items (such as Advanced) on the menu bar have their respective menu items. Submenu items A solid triangle before each item on any menu screen means that the item has a submenu. To display the submenu, select the item then press . Navigation keys At the bottom right corner of a menu screen are the navigation keys for the BIOS setup program.
4.3 Main menu When you enter the BIOS Setup program, the Main menu screen appears. The Main menu provides you an overview of the basic system information, and allows you to set the system date, time, language, and security settings. System Language Allows you to set the system language. System Date [MM/DD/YYYY] Allows you to set the system date. System Time [HH:MM:SS] Allows you to set the system time.
4.4 Performance Tuning menu The Performance Tuning menu items allow you to change performance related settings for different scenarios. Optimized Performance Setting [Default] Allows you to select performance settings for different scenarios. [Default] Default settings. [By Benchmark] Optimize for different kinds of benchmarks. Select this option, then select a benchmark type from the >> list. [By Workload] Optimize for different kinds of workloads.
Overclocking [Disabled] Enable this item to increase the CPU’s clock. Please use an external PCIe storage controller for your hard drives when enabling this feature. Configuration options: [Disabled] [Enabled] Please note that overclocking might cause component damage or system crashes, which may reduce the lifespan of the system and the CPU. Use this tool at your own risk.
4.5 Advanced menu The Advanced menu items allow you to change the settings for the CPU and other system devices. Take caution when changing the settings of the Advanced menu items. Incorrect field values can cause the system to malfunction. 4.5.1 Trusted Computing Security Device Support [Disabled] Allows you to enable or disable the BIOS support for security device. Configuration options: [Disabled] [Enabled] 4.5.
CPU Common Options Performance Allows you to configure performance options. REP-MOV/STOS Streaming [Enabled] Allows you to enable or disable the use of non-caching streaming stores for large sizes. Configuration options: [Disabled] [Enabled] Prefetcher Settings Allows you to configure prefetcher options. Core Watchdog Allows you to configure core watchdog options. RedirectForReturnDis [Auto] Allows you to set RedirectForReturnDis to 0, 1, or Auto as a workaround for GCC/ C000005 issue for XV Core on CZ A0.
MCA Error Threshold Enable [Auto] Configuration options: [False] [True] [Auto] MCA FruText [Auto] Configuration options: [False] [True] SMU and PSP Debug Mode [Auto] If this option is enabled, uncorrected errors detected by the PSP FW or SMU FW will hang and not reset the system instead of causing a cold reset.
Link Allows you to configure Link options. DF Watchdog Timer Interval [Auto] Allows you to set the Data Fabric watchdog timer interval. Configuration options: [Auto] [41ms] [166ms] [334ms] [669ms] [1.34 seconds] [2.68 seconds] [5.36 seconds] Disable DF to external IP Sync Flood Propagation [Auto] Allows you to enable or disable sync flood to UMC and downstream slaves.
NBIO Common Options IOMMU [Auto] Configuration options: [Disabled] [Enabled] [Auto] DMAr Support [Auto] Configuration options: [Disabled] [Enabled] [Auto] DRTM Virtual Device Support [Auto] Configuration options: [Disabled] [Enabled] [Auto] DRTM Memory Reservation [Auto] Allows you to enable or disable reservation of 128MB memory below Bottom IO for DRTM. This option is required for Secured-Core Server functionality.
SEV-SNP Support [Disabled] Configuration options: [Disabled] [Enabled] [Auto] Allow Compliance [Auto] Allows you to enable or disable PCIe RP entering the polling compliance state.
SOC Miscellaneous Control ABL Console Out Control [Auto] Configuration options: [Disabled] [Enabled] [Auto] The following items appear only when ABL Console Out Control is set to [Enabled]. ABL Console Out Serial Port [Auto] Configuration options: [eSPI UART] [SOC UART0] [SOC UART1] [Auto] ABL Basic Console Out Control [Auto] Configuration options: [Disabled] [Enabled] [Auto] ABL PMU Message Control [Auto] Allows you to control the number of PMU debug messages.
4.5.3 Onboard LAN Configuration Onboard I350 LAN Configuration Intel I350 LAN1 LAN Enable [JumperState] Allows you to enable or disable the Intel LAN. Configuration options: [Disabled] [JumperState] The following item appears only when LAN Enable is set to [Jumperstate]. ROM Type [PXE] Allows you to select the Intel LAN ROM type. Configuration options: [Disabled] [PXE] Intel I350 LAN2 LAN Enable [JumperState] Allows you to enable or disable the Intel LAN.
4.5.4 Serial Port Console Redirection COM1/COM2 Console Redirection [Disabled] Allows you to enable or disable the console redirection feature. Configuration options: [Disabled] [Enabled] The following item appears only when Console Redirection is set to [Enabled]. Console Redirection Settings These items become configurable only when you enable the Console Redirection item. The settings specify how the host computer and the remote computer (which the user is using) will exchange data.
Parity [None] A parity bit can be sent with the data bits to detect some transmission errors. [Mark] and [Space] parity do not allow for error detection. [None] None [Even] parity bit is 0 if the num of 1’s in the data bits is even [Odd] parity bit is 0 if num of 1’s in the data bits is odd [Mark] parity bit is always 1 [Space] parity bit is always 0 Stop Bits [1] Stop bits indicate the end of a serial data packet. (A start bit indicates the beginning.) The standard setting is 1 stop bit.
Redirection After BIOS POST [Always Enable] This setting allows you to specify if Bootloader is selected than Legacy console redirection. Configuration options: [Always Enable] [BootLoader] Serial Port for Out-of-Band Management/Windows Emergency Management Services (EMS) Console Redirection EMS [Disabled] Allows you to enable or disable the console redirection feature. Configuration options: [Disabled] [Enabled] The following item appears only when Console Redirection EMS is set to [Enabled].
SVM Mode [Enable] This item allows you enable or disable CPU Virtualization. Configuration options: [Disabled] [Enable] Node 0 Information This item allows you to view memory information related to Node 0. 4.5.6 PCI Subsystem Settings Allows you to configure PCI, PCI-X, and PCI Express Settings. Above 4G Decoding [Enabled] Allows you to enable or disable 64-bit capable devices to be decoded in above 4G address space. It only works if the system supports 64-bit PCI decoding.
4.5.7 USB Configuration Legacy USB Support [Enabled] Allows you to enable or disable Legacy USB device support. Configuration options: [Enabled] [Disabled] [Auto] XHCI Hand-off [Enabled] Allows you to enable or disable workaround for OSes without XHCI hand-off support. The XHCI ownership change should be claimed by XHCI driver. Configuration options: [Enabled] [Disabled] USB Mass Storage Driver Support [Enabled] Allows you to enable or disable the USB Mass Storage driver support.
4.5.8 Network Stack Configuration Network Stack [Disabled] Enables or disables the network stack feature. Configuration options: [Disable] [Enable] The following items appear only when Network Stack is set to [Enabled]. Ipv4 PXE Support [Disabled] Enables or disables the Ipv4 PXE Boot Support. If disabled, Ipv4 PXE boot option will not be created. Configuration options: [Disabled] [Enabled] Ipv4 HTTP Support [Disabled] Enables or disables the Ipv4 HTTP Boot Support.
4.5.9 NVMe Configuration This page will display the NVMe controller and drive information. 4.5.10 SATA Configuration This page will display the SATA controller and drive information. 4.5.11 APM Configuration Allows you to configure the Advance Power Management (APM) settings. Restore AC Power Loss [Last State] When set to [Power Off], the system goes into off state after an AC power loss. When set to [Power On], the system will reboot after an AC power loss.
4.5.12 AMD Mem Configuration Status The items in this menu display the memory configuration (initialized by ABL) status. 4.5.13 T1s Auth Allows you to configure the Server Certificate Authority (CA). Server / Client CA Configuration Enroll Cert Allows you to enroll a certificate using a certificate file or manually input a certificate GUID. Enroll Cert Using File Allows you to enroll a certificate using a certificate file.
4.5.14 Driver Health This page will display the driver and controller health status. 4.6 Chipset menu The Chipset menu items allow you to change the Chipset settings. PCIe Link Training Type [1 Step] This item allows you to select PCIe Link Training in 1 or 2 steps. Configuration options: [1 Step] [2 Step] PCIe Compliance Mode [Off] This item allows you to turn the PCIe Compliance Mode on or off.
4.7 Security menu This menu allows a new password to be created or a current password to be changed. The menu also enables or disables the Secure Boot state and lets the user configure the System Mode state. Administrator Password To set an administrator password: 1. Select the Administrator Password item and press . 2. From the Create New Password box, key in a password, then press . 3. Confirm the password when prompted. To change an administrator password: 1.
User Password To set a user password: 1. Select the User Password item and press . 2. From the Create New Password box, key in a password, then press . 3. Confirm the password when prompted. To change a user password: 1. Select the User Password item and press . 2. From the Enter Current Password box, key in the current password, then press . 3. From the Create New Password box, key in a new password, then press . 4. Confirm the password when prompted.
Key Management This item only appears when the item Secure Boot Mode is set to [Custom]. The Key Management item allows you to modify Secure Boot variables and set Key Management page. Factory Key Provision [Enabled] Allows you to provision factory default Secure Boot keys when the system is in Setup Mode. Configuration options: [Disabled] [Enabled] Restore Factory keys This item will install all Factory Default keys. Reset to Setup Mode This item appears only when you load the default Secure Boot keys.
Key Exchange Keys (KEK) / Authorized Signatures (DB) / Forbidden Signatures (DBX) Configuration options: [Details] [Export] [Update] [Append] [Delete] Authorized TimeStamps (DBT) / OsRecovery Signatures Configuration options: [Update] [Append] 4.8 Boot menu The Boot menu items allow you to change the system boot options. Setup Prompt Timeout [1] Allows you to set the number of seconds that the firmware waits before initiating the original default boot selection. 65535(OxFFFF) means indefinite waiting.
Hard Drive BBS Priorities These items appear only when you connect a network cable or SATA ODD to the SATA port, and allows you to set the booting order of the Network / SATA devices. 4.9 Tool menu The Tool menu items allow you to configure options for special functions. Select an item and press to display the submenu. Start ASUS EzFlash Allows you to run ASUS EZ Flash BIOS ROM Utility when you press . Refer to the ASUS EZ Flash Utility section for details.
4.10 Event Logs menu The Event Logs menu items allow you to change the event log settings and view the system event logs. 4.10.1 Change Smbios Event Log Settings Press to change the Smbios Event Log configuration. All values changed here do not take effect until computer is restarted. Enabling/Disabling Options Smbios Event Log [Enabled] Change this to enable or disable all features of Smbios Event Logging during boot.
The following item appears only when Smbios Event Log is set to [Enabled]. Erasing Settings Erase Event Log [No] Choose options for erasing Smbios Event Log. Erasing is done prior to any logging activation during reset. Configuration options: [No] [Yes, Next reset] [Yes, Every reset] When Log is Full [Do Nothing] Choose options for reactions to a full Smbios Event Log.
4.11 Server Mgmt menu The Server Management menu displays the server management status and allows you to change the settings. OS Watchdog Timer [Disabled] This item allows you to start a BIOS timer which can only be shut off by Intel Management Software after the OS loads. Configuration options: [Enabled] [Disabled] The following items appear only when OS Watchdog Timer is set to [Enabled].
System Event Log Allows you to change the SEL event log configuration. Erase SEL [No] Allows you to choose options for erasing SEL. Configuration options: [No] [Yes, On next reset] [Yes, On every reset] View FRU Information Allows you to view the FRU information. BMC network configuration The sub-items in this configuration allow you to configure the BMC network parameters.
Shared LAN IPv6 Support [Enabled] Allows you to enable or disable LAN2 IPv6 Support. Configuration options: [Enabled] [Disabled] The following item appears only when IPv6 Support is set to [Enabled]. Configuration Address source [Previous State] This item allows you to configure LAN channel parameters statistically or dynamically (by BIOS or BMC). Unspecified option will not modify any BMC network parameters during BIOS phase.
4.12 Exit menu The Exit menu items allow you to save or discard your changes to the BIOS items. Pressing does not immediately exit this menu. Select one of the options from this menu or from the legend bar to exit. Discard Changes and Exit Exit system setup without saving any changes. Save Changes and Reset Reset the system after saving the changes. Discard Changes and Reset Reset system setup without saving any changes. Save Changes Save changes done so far to any of the setup options.
Boot Override These items displays the available devices. The device items that appears on the screen depends on the number of devices installed in the system. Click an item to start booting from the selected device. Launch EFI Shell from filesystem device This item allows you to attempt to launch the EFI Shell application (shellx64.efi) from one of the available filesystem devices.
Driver Installation This chapter provides instructions for installing the necessary drivers for different system components.
5.1 Running the Support DVD The support DVD that is bundled with your motherboard contains drivers, management applications, and utilities that you can install to maximize the features of your motherboard. The contents of the support DVD are subject to change at any time without notice. Visit the ASUS website (www.asus.com) for the latest updates on software and utilities. The main screen of the Support DVD contains the following tabs: 1.
Appendix Appendix This appendix includes additional information that you may refer to when configuring the motherboard.
K14PG-U12 K14PG-U12 block diagram DDR5 12 x DIMM slots (12-channel, 1DPC) DDR5 PCIe x16 slot PCIe x16 slot PCIe x16 slot PCIe x16 slot PCIe x16 slot (FH,HL) Gen5 x16 CPU1 GENOA Processor Gen5 x16 Gen5 x8 Gen5 x16 Gen5 x16 Socket SP5 (LGA6096) Gen4 SlimSAS cable for Gen5 x16 Gen5 MCIO cable for PCIe x16 slot (FH,HL) or OCP socket option PCIe x8 slot (LP,HL) Front PCIe x8 slot (LP,LL)(option) Up to TDP 400W Gen5 x16/x8 2 x 2.5” & 4 x 3.5” Hot-swap Storage Bays SKU1**: 2 x 2.
Notices Federal Communications Commission Statement This device complies with Part 15 of the FCC Rules. Operation is subject to the following two conditions: • This device may not cause harmful interference. • This device must accept any interference received including interference that may cause undesired operation. This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to part 15 of the FCC Rules.
Japan statement notice This product cannot be directly connected to the Internet (including public wireless LAN) of a telecom carrier (mobile network companies, landline network companies, Internet providers, etc.). When connecting this product to the Internet, be sure to connect it through a router or switch. Australia statement notice From 1 January 2012 updated warranties apply to all ASUS products, consistent with the Australian Consumer Law.
India RoHS This product complies with the “India E-Waste (Management) Rules, 2016” and prohibits use of lead, mercury, hexavalent chromium, polybrominated biphenyls (PBBs) and polybrominated diphenyl ethers (PBDEs) in concentrations exceeding 0.1% by weight in homogenous materials and 0.01% by weight in homogenous materials for cadmium, except for the exemptions listed in Schedule II of the Rule.
Service and Support Visit our multi-language website at https://www.asus.
