| Variable | Value |
|---|
Edit count of the user (user_editcount) | 1406 |
Name of the user account (user_name) | 'NeddySeagoon' |
Age of the user account (user_age) | 333223872 |
Page ID (page_id) | 309095 |
Page namespace (page_namespace) | 0 |
Page title (without namespace) (page_title) | 'Gentoo on Hawk' |
Full page title (page_prefixedtitle) | 'Gentoo on Hawk' |
Action (action) | 'edit' |
Edit summary/reason (summary) | '/* Sun U10 case */ ' |
Old content model (old_content_model) | 'wikitext' |
New content model (new_content_model) | 'wikitext' |
Old page wikitext, before the edit (old_wikitext) | 'Building on [[Gentoo_On_X-Gene_1_Mudan|Gentoo on Mudan]], which is an Applied Micro X-Gene 1 CPU, we have Gentoo on Hawk.
The Hawk motherboard is a 32 core Ampere Computing eMAG 8180 CPU. There is some history to be aware of here.
The Applied Micro ARM IP was sold to Ampere Computing after Applied Micro had been manufacturing and distributing the X-Gene 1 and X-Gene 2 ARM64 CPUs. Simplistically, think of the X-Gene 3 as four X-Gene 1 CPUs in the same package.
The X-Gene 3 was sampled, then the story passes to Ampere Computing.
The Ampere eMAG 8180 is based on the X-Gene 3
The board is intended to be used in an openEDGE half width 1U chassis, which makes finding a commodity case a challenge.
However, it does expect standard ATX power, so powering it up and operating it is not a problem.
== Get going ==
=== Cooling ===
{{Warning|Do not operate the system with only natural convection cooling for the CPU}}
The Hawk is intended to be fitted to a 1U half width chassis and use six fans for cooling.
With a 2200 RPM, 8cm fan mounted directly on the heatsink, the CPU reached 95°C at 90W CPU input power. Its rated at 125W too.
Even at 13W idling at the prompt, the CPU runs at 47°C
=== Boot/rescue media ===
Use the rescue mode of {{Path|debian-10.4.0-arm64-xfce-CD-1.iso}} to boot, write efivars and so on. It will only drive the serial over LAN console.
{{c|dd}} it to a USB stick. The Hawk firmware says it can boot from CDROM but that's not confirmed.
=== DDR4 RAM ===
Do use Registered ECC DIMMs. I did test unregistered non ECC RAM from my main AMD64 system and it would not boot.
All the reference material says to fit in pairs but my Hawk is running quite happily on one. In the CH0_DIMM0 slot. The eMAG 8180 CPU can support two DIMMS per channel but only DIMM0 sockets are fitted on the Hawk.
The reference material uses different identifies for the RAM. The above is the silk screening on the board.
{{Note|The connector numbers are silk screened onto the board in tiny text}}
=== Storage ===
Take your pick from SATA3 or NVME 4 lane PCIe. Being lazy, I put the Mudan SATA boot drive in to see what would happen. While the USB hardware and drivers are USB3, only USB2 ports are fitted. That's OK to get you going but not for long term use.
=== Kernel changes ===
Notice the absence of SATA on the PCIe bus:
{{RootCmd|lspci -nnk|output=<pre>
0000:00:00.0 PCI bridge [0604]: Ampere Computing, LLC eMAG PCI Express Root Port 0 [1def:e005] (rev 04)
Kernel driver in use: pcieport
0002:00:00.0 PCI bridge [0604]: Ampere Computing, LLC eMAG PCI Express Root Port 2 [1def:e007] (rev 04)
Kernel driver in use: pcieport
0004:00:00.0 PCI bridge [0604]: Ampere Computing, LLC eMAG PCI Express Root Port 4 [1def:e009] (rev 04)
Kernel driver in use: pcieport
0006:00:00.0 PCI bridge [0604]: Ampere Computing, LLC eMAG PCI Express Root Port 6 [1def:e00b] (rev 04)
Kernel driver in use: pcieport
0006:01:00.0 Ethernet controller [0200]: Intel Corporation I210 Gigabit Network Connection [8086:1533] (rev 03)
Subsystem: Intel Corporation Ethernet Server Adapter I210-T1 [8086:0002]
Kernel driver in use: igb
0007:00:00.0 PCI bridge [0604]: Ampere Computing, LLC eMAG PCI Express Root Port 7 [1def:e00c] (rev 04)
Kernel driver in use: pcieport
0007:01:00.0 PCI bridge [0604]: ASPEED Technology, Inc. AST1150 PCI-to-PCI Bridge [1a03:1150] (rev 04)
0007:02:00.0 VGA compatible controller [0300]: ASPEED Technology, Inc. ASPEED Graphics Family [1a03:2000] (rev 41)
Subsystem: ASPEED Technology, Inc. ASPEED Graphics Family [1a03:2000]
Kernel driver in use: ast
</pre>}}
The kernel needed three changes from the X-Gene 1 kernel:
# Max CPUs 32, not 8.
# The Intel IGB network driver added
# SATA_AHCI_PLATFORM added to be able to see the AHCI ports.
=== IPMI control ===
The Board Management Computer (BMC) is a ST2500. Use {{c|impitool}} on a remote host and enjoy all the good things that IPMI offers.
Activate the ADMIN login with password ADMIN, if required. e.g. after a factory reset. {{Cmd|ipmitool -I lanplus -H $REMOTEHOST -U ADMIN -P ADMIN raw 0x32 0x91 1}}
Then get three ipmi shells with {{Cmd|ipmitool -I lanplus -H $REMOTEHOST -U ADMIN -P ADMIN shell}} in three console windows.
One for power control, one for the debug Serial over LAN (SoL) console, and one for the SoL console.
Using each ipmi shell,
{{Cmd|sol activate|prompt=ipmitool}}
{{Cmd|sol activate instance{{=}}2|prompt=ipmitool}} and
{{Cmd|chassis power <power_command>|prompt=ipmitool}}
There are two more consoles too:
* The VGA console;
* the KVM console in the web interface.
The SoL console, VGA console and the KVM console all show different things.
==== Debug Sol example ====
Expect to see:
{{RootCmd|ipmitool -I lanplus -H 192.168.100.236 -U ADMIN -P ADMIN shell|output=<pre>
ipmitool> sol activate instance=2
[SOL Session operational. Use ~? for help]
DRAM FW v191001
DRAM Region[0]: 0x0080000000 - 0x00FFFFFFFF
DRAM Region[1]: 0x0880000000 - 0x0FFFFFFFFF
DRAM Region[2]: 0x8800000000 - 0x8FFFFFFFFF
MCU[0]-Slot[0]: RDIMM[ID:ce80] M393A4K40BB2-CTD 32GB 2 rank(s) x4 > 2667
MCU[4]-Slot[0]: RDIMM[ID:ce80] M393A4K40BB2-CTD 32GB 2 rank(s) x4 > 2667
DRAM: 64GB DDR4 2667 ECC
NOTICE: Booting Trusted Firmware
NOTICE: BL1: v1.2(release):1.02.200626
NOTICE: BL1: Built : 03:15:07, Jun 27 2020
NOTICE: BL1: Booting BL2
NOTICE: BL2: v1.2(release):1.02.200626
NOTICE: BL2: Built : 03:15:07, Jun 27 2020
NOTICE: BL1: Booting BL31
NOTICE: BL31: v1.2(release):1.02.200626
NOTICE: BL31: Built : 03:15:07, Jun 27 2020 </pre>}} on the debug SoL console at power up.
If it continues, then the RAM in MCU 4 is probably faulty.
<pre>Error: MCU4 {---U}
Error Info: ecc_errcl 0x0
Error Info: ecc_errch 0x0
Error Info: ecc_errdl 0x1
Error Info: ecc_errdh 0x0
Error Info: ram_err 0x0</pre>
=== Web interface ===
There is a web interface at https://$REMOTEHOST. openwebstart is not required.
== Power requirements ==
With the hardware configured as below:
* A 700W PSU
* The Hawk Board
* One 32G RDIMM-2666
* Two SATA3 SSDs in Raid 1
* One 2200 RPM 8cm fan
* Off, with 5vSTBY applied <5W
* One user logged in over ssh, otherwise idle 39W
* Building glibc with MAKEOPTS="-j32" 137W (Max)
* Building the kernel with make -j40 148W max (CPU Temp 93°C with a 22°C ambient.
All power readings measured at the input to the PSU.
For completeness. The power factor is about 0.6. That's pretty terrible but its not user adjustable.
== Random nuances ==
=== Serial port ===
The serial port is ttyS0 until openrc starts, then it becomes ttyAMA0.
The kernel command line needs
<pre>console=tty0 console=ttyS0,115200n8 console=ttyAMA0,115200n8</pre> to see everything except a login prompt on serial console.
The login prompt requires ttyAMA0 in /etc/inittab
<pre># SERIAL CONSOLES
s0:12345:respawn:/sbin/agetty -L 115200 ttyAMA0 vt100</pre>
=== PCIe slot ===
The references say that it is PCIe Gen 3, backwards compatible with Gen 1 and Gen 2. I can report that out of three cards I tested
two caused boot failures in the firmware.
=== Migrating QEMU/KVMs ===
The Hawk does not support GIC_v2. Use
{{RootCmd|virsh edit <domain>}}
<pre> <features>
<acpi/>
<gic version='2'/>
</features> </pre>
to change to gic version='3'
== Mechanical considerations ==
=== Arranging the parts ===
Without a case, the Hawk parts were spread out on the anti-static mat on my electronics workbench as illustrated.
[[ File:Hawk on Bench small.jpg | centre |text-bottom | thumb | Hawk System Laid Out Flat]]
Points to note:
# The board is mounted on 3mm stand offs to keep it away from the conductive surface.
# The ATX PSU is below the board. It won't need 700W, I hope.
# The HDD is at the left.
# The faulty RAM stick is at the top.
=== Cooling ===
==== CPU Cooling ====
An 8cm fan can be retained to the heatsink with a couple of cable ties as illustrated.
{{Warning| This is not adequate cooling. With 24 cores running, the CPU is 70°C above the ambient temperature}}
[[File:Fan Attachment small.jpg | centre |text-bottom | thumb | Fan retained to CPU heatsink]]
The fan is spaced off the heatsink with normal fan fixing screws. This was required to prevent the rotor clipping the heatsink fins.
There are a few disadvantages to this.
# The solid rotor centre is very close to the fins which will be bad for cooling that part of the heatsink.
# A soft mounting will probably be lower noise.
Whatever, the CPU needn to be kept under 96°C, which is the Upper Non-Critical temperature.
<pre>ipmitool> sensor get CPU_Temp
Locating sensor record...
Sensor ID : CPU_Temp (0x1)
Entity ID : 30.1
Sensor Type (Threshold) : Temperature
Sensor Reading : 57 (+/- 16) degrees C
Status : ok
Lower Non-Recoverable : 5.000
Lower Critical : 9.000
Lower Non-Critical : 20.000
Upper Non-Critical : 90.000
Upper Critical : 96.000
Upper Non-Recoverable : 100.000
Positive Hysteresis : Unspecified
Negative Hysteresis : Unspecified</pre>
==== CPU Cooling Maybe ====
{{Warning|This is not tested ... yet. Found one on ebay, so watch this space}}
There are images of a similar motherboard fitted with A Supermicro SNK-P0050AP4 cooler. Start reading at [https://www.anandtech.com/show/15733/ampere-emag-system-a-32core-arm64-workstation|Ampere eMag Workstation by Avantek] and zoom into the images of the linked hardware review. The part number on the side of the CPU cooler is clearly visible in one of the images.
That's not to say that its a drop in replacement for the 1U narrow LCA2011 passive heatsink with special screws, fitted to the Hawk now.
In its favour, it can do the job and the mounting holes line up.
Against, its intended for a 4U server but it should just fit in my modified U10 case.
==== Voltage regulator cooling ====
The voltage regulators, there are lots, are located in the area around the 12v_ATX connector.
Convection cooling is not adequate for voltage regulator cooling. The first one that complained was the PMD_VRD_Temp, which went critical even under light loads. Forced air cooling of this area is essential if the server is going to be operating at any more than a tickover.
==== Fan Control ====
Manual fan control using ipmitool works
From the ipmitool shell {{Cmd|raw 0x3c 0x3 0x01|prompt=ipmitool}} just once, followed by
{{Cmd|raw 0x3c 0x4 A B|prompt=ipmitool}}A is the fan number in the range 1..6 for the Hawk.
B is the desired fan speed in the range 0..100. Fan speed is a decimal number.
=== The PCI Express slot ===
It is not possible to fit a standard PCIe card into the PCIe slot as the bottom end of the bracket will hit the power switch. A right angle riser card is expected to be used. Either modify the bracket or relocate the power switch.
I did look on the web for a right angle PCIe riser card. There are lots but they are all the wrong handedness. However, I found a PCIe extender card in my box of bits which is just enough to lift a normal card bracket above the switch. However, with vertical mounting, the back of the PCIe card fouls straight SATA connectors.
== Finding a case ==
=== Standard ATX cases ===
The Hawk back panel is too wide for a commodity PC case back plate opening. Maybe it can be made to fit with some metalwork?
=== 3D Printed Case ===
There is a [https://primorobots.com/2020/04/09/hawk-diy-chassis-v0-5/|3D Printed Case] if you have access to a 3D printer.
It also deals with the cooling problem.
=== Sun U10 case ===
A Sun U10 case, with the electronics removed is about right. To fit the Hawk board the old motherboard stand offs need to be removed from the case and two small hacksaw cuts are required to allow clearance for the VGA connector.
Careful placement allows unmodifed half height PCIe cards to be fitted but there is no support for the backplate.
Full height cards would need the motherboard mounted on smaller stand offs than the 15mm x M3 I had to hand. That's probably worth while.
I've got as far as gutting the case, removing the original stand offs and cutting the back of the case then placing the board and front fan in position. I've ordered some 8mm and 10mm stand offs. The are actually spacers, for a screw each side. Its easier to slot a hole for a screw than to move a tapped hole that's in the wrong place.
The new ATX PSU is in. Two small hacksaw cuts, or a touch with the angle grinder, are required to clear the power input connector.
The original front fan has been replace by a 140mm fan. That's almost the width of the Hawk board, so there should be plenty of cooling for the on board power regulators.
Still to do. Drilling the U10 motherboard tray to suit the Hawk.
Photos will be added later.
== See also ==
* {{See also|Gentoo On X-Gene 1 Mudan}}
== References ==
* [http://files.opencompute.org/oc/public.php?service=files&t=ac831e5481cb7cdb1f3278b27cdca875&download Hawk Technical Specification]
* [https://146a55aca6f00848c565-a7635525d40ac1c70300198708936b4e.ssl.cf1.rackcdn.com/images/abae5b679799253dbda0bff990b6ec400d3014c4.pdf Hawk Board Overview]
* [https://github.com/ampere-openbmc/ampere-ipmi-oem ampere-openbmc/ampere-ipmi-oem ]
== External resources ==
* [https://en.wikichip.org/wiki/apm/x-gene/apm883832-x3 Applied Micro X-Gene 3]
* [https://en.wikichip.org/wiki/ampere_computing/emag/8180 Ampere eMAG 8180]
[[Category:ARM]]' |
New page wikitext, after the edit (new_wikitext) | 'Building on [[Gentoo_On_X-Gene_1_Mudan|Gentoo on Mudan]], which is an Applied Micro X-Gene 1 CPU, we have Gentoo on Hawk.
The Hawk motherboard is a 32 core Ampere Computing eMAG 8180 CPU. There is some history to be aware of here.
The Applied Micro ARM IP was sold to Ampere Computing after Applied Micro had been manufacturing and distributing the X-Gene 1 and X-Gene 2 ARM64 CPUs. Simplistically, think of the X-Gene 3 as four X-Gene 1 CPUs in the same package.
The X-Gene 3 was sampled, then the story passes to Ampere Computing.
The Ampere eMAG 8180 is based on the X-Gene 3
The board is intended to be used in an openEDGE half width 1U chassis, which makes finding a commodity case a challenge.
However, it does expect standard ATX power, so powering it up and operating it is not a problem.
== Get going ==
=== Cooling ===
{{Warning|Do not operate the system with only natural convection cooling for the CPU}}
The Hawk is intended to be fitted to a 1U half width chassis and use six fans for cooling.
With a 2200 RPM, 8cm fan mounted directly on the heatsink, the CPU reached 95°C at 90W CPU input power. Its rated at 125W too.
Even at 13W idling at the prompt, the CPU runs at 47°C
=== Boot/rescue media ===
Use the rescue mode of {{Path|debian-10.4.0-arm64-xfce-CD-1.iso}} to boot, write efivars and so on. It will only drive the serial over LAN console.
{{c|dd}} it to a USB stick. The Hawk firmware says it can boot from CDROM but that's not confirmed.
=== DDR4 RAM ===
Do use Registered ECC DIMMs. I did test unregistered non ECC RAM from my main AMD64 system and it would not boot.
All the reference material says to fit in pairs but my Hawk is running quite happily on one. In the CH0_DIMM0 slot. The eMAG 8180 CPU can support two DIMMS per channel but only DIMM0 sockets are fitted on the Hawk.
The reference material uses different identifies for the RAM. The above is the silk screening on the board.
{{Note|The connector numbers are silk screened onto the board in tiny text}}
=== Storage ===
Take your pick from SATA3 or NVME 4 lane PCIe. Being lazy, I put the Mudan SATA boot drive in to see what would happen. While the USB hardware and drivers are USB3, only USB2 ports are fitted. That's OK to get you going but not for long term use.
=== Kernel changes ===
Notice the absence of SATA on the PCIe bus:
{{RootCmd|lspci -nnk|output=<pre>
0000:00:00.0 PCI bridge [0604]: Ampere Computing, LLC eMAG PCI Express Root Port 0 [1def:e005] (rev 04)
Kernel driver in use: pcieport
0002:00:00.0 PCI bridge [0604]: Ampere Computing, LLC eMAG PCI Express Root Port 2 [1def:e007] (rev 04)
Kernel driver in use: pcieport
0004:00:00.0 PCI bridge [0604]: Ampere Computing, LLC eMAG PCI Express Root Port 4 [1def:e009] (rev 04)
Kernel driver in use: pcieport
0006:00:00.0 PCI bridge [0604]: Ampere Computing, LLC eMAG PCI Express Root Port 6 [1def:e00b] (rev 04)
Kernel driver in use: pcieport
0006:01:00.0 Ethernet controller [0200]: Intel Corporation I210 Gigabit Network Connection [8086:1533] (rev 03)
Subsystem: Intel Corporation Ethernet Server Adapter I210-T1 [8086:0002]
Kernel driver in use: igb
0007:00:00.0 PCI bridge [0604]: Ampere Computing, LLC eMAG PCI Express Root Port 7 [1def:e00c] (rev 04)
Kernel driver in use: pcieport
0007:01:00.0 PCI bridge [0604]: ASPEED Technology, Inc. AST1150 PCI-to-PCI Bridge [1a03:1150] (rev 04)
0007:02:00.0 VGA compatible controller [0300]: ASPEED Technology, Inc. ASPEED Graphics Family [1a03:2000] (rev 41)
Subsystem: ASPEED Technology, Inc. ASPEED Graphics Family [1a03:2000]
Kernel driver in use: ast
</pre>}}
The kernel needed three changes from the X-Gene 1 kernel:
# Max CPUs 32, not 8.
# The Intel IGB network driver added
# SATA_AHCI_PLATFORM added to be able to see the AHCI ports.
=== IPMI control ===
The Board Management Computer (BMC) is a ST2500. Use {{c|impitool}} on a remote host and enjoy all the good things that IPMI offers.
Activate the ADMIN login with password ADMIN, if required. e.g. after a factory reset. {{Cmd|ipmitool -I lanplus -H $REMOTEHOST -U ADMIN -P ADMIN raw 0x32 0x91 1}}
Then get three ipmi shells with {{Cmd|ipmitool -I lanplus -H $REMOTEHOST -U ADMIN -P ADMIN shell}} in three console windows.
One for power control, one for the debug Serial over LAN (SoL) console, and one for the SoL console.
Using each ipmi shell,
{{Cmd|sol activate|prompt=ipmitool}}
{{Cmd|sol activate instance{{=}}2|prompt=ipmitool}} and
{{Cmd|chassis power <power_command>|prompt=ipmitool}}
There are two more consoles too:
* The VGA console;
* the KVM console in the web interface.
The SoL console, VGA console and the KVM console all show different things.
==== Debug Sol example ====
Expect to see:
{{RootCmd|ipmitool -I lanplus -H 192.168.100.236 -U ADMIN -P ADMIN shell|output=<pre>
ipmitool> sol activate instance=2
[SOL Session operational. Use ~? for help]
DRAM FW v191001
DRAM Region[0]: 0x0080000000 - 0x00FFFFFFFF
DRAM Region[1]: 0x0880000000 - 0x0FFFFFFFFF
DRAM Region[2]: 0x8800000000 - 0x8FFFFFFFFF
MCU[0]-Slot[0]: RDIMM[ID:ce80] M393A4K40BB2-CTD 32GB 2 rank(s) x4 > 2667
MCU[4]-Slot[0]: RDIMM[ID:ce80] M393A4K40BB2-CTD 32GB 2 rank(s) x4 > 2667
DRAM: 64GB DDR4 2667 ECC
NOTICE: Booting Trusted Firmware
NOTICE: BL1: v1.2(release):1.02.200626
NOTICE: BL1: Built : 03:15:07, Jun 27 2020
NOTICE: BL1: Booting BL2
NOTICE: BL2: v1.2(release):1.02.200626
NOTICE: BL2: Built : 03:15:07, Jun 27 2020
NOTICE: BL1: Booting BL31
NOTICE: BL31: v1.2(release):1.02.200626
NOTICE: BL31: Built : 03:15:07, Jun 27 2020 </pre>}} on the debug SoL console at power up.
If it continues, then the RAM in MCU 4 is probably faulty.
<pre>Error: MCU4 {---U}
Error Info: ecc_errcl 0x0
Error Info: ecc_errch 0x0
Error Info: ecc_errdl 0x1
Error Info: ecc_errdh 0x0
Error Info: ram_err 0x0</pre>
=== Web interface ===
There is a web interface at https://$REMOTEHOST. openwebstart is not required.
== Power requirements ==
With the hardware configured as below:
* A 700W PSU
* The Hawk Board
* One 32G RDIMM-2666
* Two SATA3 SSDs in Raid 1
* One 2200 RPM 8cm fan
* Off, with 5vSTBY applied <5W
* One user logged in over ssh, otherwise idle 39W
* Building glibc with MAKEOPTS="-j32" 137W (Max)
* Building the kernel with make -j40 148W max (CPU Temp 93°C with a 22°C ambient.
All power readings measured at the input to the PSU.
For completeness. The power factor is about 0.6. That's pretty terrible but its not user adjustable.
== Random nuances ==
=== Serial port ===
The serial port is ttyS0 until openrc starts, then it becomes ttyAMA0.
The kernel command line needs
<pre>console=tty0 console=ttyS0,115200n8 console=ttyAMA0,115200n8</pre> to see everything except a login prompt on serial console.
The login prompt requires ttyAMA0 in /etc/inittab
<pre># SERIAL CONSOLES
s0:12345:respawn:/sbin/agetty -L 115200 ttyAMA0 vt100</pre>
=== PCIe slot ===
The references say that it is PCIe Gen 3, backwards compatible with Gen 1 and Gen 2. I can report that out of three cards I tested
two caused boot failures in the firmware.
=== Migrating QEMU/KVMs ===
The Hawk does not support GIC_v2. Use
{{RootCmd|virsh edit <domain>}}
<pre> <features>
<acpi/>
<gic version='2'/>
</features> </pre>
to change to gic version='3'
== Mechanical considerations ==
=== Arranging the parts ===
Without a case, the Hawk parts were spread out on the anti-static mat on my electronics workbench as illustrated.
[[ File:Hawk on Bench small.jpg | centre |text-bottom | thumb | Hawk System Laid Out Flat]]
Points to note:
# The board is mounted on 3mm stand offs to keep it away from the conductive surface.
# The ATX PSU is below the board. It won't need 700W, I hope.
# The HDD is at the left.
# The faulty RAM stick is at the top.
=== Cooling ===
==== CPU Cooling ====
An 8cm fan can be retained to the heatsink with a couple of cable ties as illustrated.
{{Warning| This is not adequate cooling. With 24 cores running, the CPU is 70°C above the ambient temperature}}
[[File:Fan Attachment small.jpg | centre |text-bottom | thumb | Fan retained to CPU heatsink]]
The fan is spaced off the heatsink with normal fan fixing screws. This was required to prevent the rotor clipping the heatsink fins.
There are a few disadvantages to this.
# The solid rotor centre is very close to the fins which will be bad for cooling that part of the heatsink.
# A soft mounting will probably be lower noise.
Whatever, the CPU needn to be kept under 96°C, which is the Upper Non-Critical temperature.
<pre>ipmitool> sensor get CPU_Temp
Locating sensor record...
Sensor ID : CPU_Temp (0x1)
Entity ID : 30.1
Sensor Type (Threshold) : Temperature
Sensor Reading : 57 (+/- 16) degrees C
Status : ok
Lower Non-Recoverable : 5.000
Lower Critical : 9.000
Lower Non-Critical : 20.000
Upper Non-Critical : 90.000
Upper Critical : 96.000
Upper Non-Recoverable : 100.000
Positive Hysteresis : Unspecified
Negative Hysteresis : Unspecified</pre>
==== CPU Cooling Maybe ====
{{Warning|This is not tested ... yet. Found one on ebay, so watch this space}}
There are images of a similar motherboard fitted with A Supermicro SNK-P0050AP4 cooler. Start reading at [https://www.anandtech.com/show/15733/ampere-emag-system-a-32core-arm64-workstation|Ampere eMag Workstation by Avantek] and zoom into the images of the linked hardware review. The part number on the side of the CPU cooler is clearly visible in one of the images.
That's not to say that its a drop in replacement for the 1U narrow LCA2011 passive heatsink with special screws, fitted to the Hawk now.
In its favour, it can do the job and the mounting holes line up.
Against, its intended for a 4U server but it should just fit in my modified U10 case.
==== Voltage regulator cooling ====
The voltage regulators, there are lots, are located in the area around the 12v_ATX connector.
Convection cooling is not adequate for voltage regulator cooling. The first one that complained was the PMD_VRD_Temp, which went critical even under light loads. Forced air cooling of this area is essential if the server is going to be operating at any more than a tickover.
==== Fan Control ====
Manual fan control using ipmitool works
From the ipmitool shell {{Cmd|raw 0x3c 0x3 0x01|prompt=ipmitool}} just once, followed by
{{Cmd|raw 0x3c 0x4 A B|prompt=ipmitool}}A is the fan number in the range 1..6 for the Hawk.
B is the desired fan speed in the range 0..100. Fan speed is a decimal number.
=== The PCI Express slot ===
It is not possible to fit a standard PCIe card into the PCIe slot as the bottom end of the bracket will hit the power switch. A right angle riser card is expected to be used. Either modify the bracket or relocate the power switch.
I did look on the web for a right angle PCIe riser card. There are lots but they are all the wrong handedness. However, I found a PCIe extender card in my box of bits which is just enough to lift a normal card bracket above the switch. However, with vertical mounting, the back of the PCIe card fouls straight SATA connectors.
== Finding a case ==
=== Standard ATX cases ===
The Hawk back panel is too wide for a commodity PC case back plate opening. Maybe it can be made to fit with some metalwork?
=== 3D Printed Case ===
There is a [https://primorobots.com/2020/04/09/hawk-diy-chassis-v0-5/|3D Printed Case] if you have access to a 3D printer.
It also deals with the cooling problem.
=== Sun U10 case ===
A Sun U10 case, with the electronics removed is about right.
[[https://wiki.gentoo.org/wiki/File:Empty_Chassis.jpg | centre | text-bottom | thumb | Sun U10 Chassis with Electronics Removed]]
To fit the Hawk board the old motherboard stand offs need to be removed from the case and two small hacksaw cuts are required to allow clearance for the VGA connector.
Careful placement allows unmodifed half height PCIe cards to be fitted but there is no support for the backplate.
Full height cards would need the motherboard mounted on smaller stand offs than the 15mm x M3 I had to hand. That's probably worth while.
I've got as far as gutting the case, removing the original stand offs and cutting the back of the case then placing the board and front fan in position. I've ordered some 8mm and 10mm stand offs. The are actually spacers, for a screw each side. Its easier to slot a hole for a screw than to move a tapped hole that's in the wrong place.
The new ATX PSU is in. Two small hacksaw cuts, or a touch with the angle grinder, are required to clear the power input connector.
The original front fan has been replace by a 140mm fan. That's almost the width of the Hawk board, so there should be plenty of cooling for the on board power regulators.
Still to do. Drilling the U10 motherboard tray to suit the Hawk.
Photos will be added later.
== See also ==
* {{See also|Gentoo On X-Gene 1 Mudan}}
== References ==
* [http://files.opencompute.org/oc/public.php?service=files&t=ac831e5481cb7cdb1f3278b27cdca875&download Hawk Technical Specification]
* [https://146a55aca6f00848c565-a7635525d40ac1c70300198708936b4e.ssl.cf1.rackcdn.com/images/abae5b679799253dbda0bff990b6ec400d3014c4.pdf Hawk Board Overview]
* [https://github.com/ampere-openbmc/ampere-ipmi-oem ampere-openbmc/ampere-ipmi-oem ]
== External resources ==
* [https://en.wikichip.org/wiki/apm/x-gene/apm883832-x3 Applied Micro X-Gene 3]
* [https://en.wikichip.org/wiki/ampere_computing/emag/8180 Ampere eMAG 8180]
[[Category:ARM]]' |
Unified diff of changes made by edit (edit_diff) | '@@ -268,5 +268,9 @@
=== Sun U10 case ===
-A Sun U10 case, with the electronics removed is about right. To fit the Hawk board the old motherboard stand offs need to be removed from the case and two small hacksaw cuts are required to allow clearance for the VGA connector.
+A Sun U10 case, with the electronics removed is about right.
+
+[[https://wiki.gentoo.org/wiki/File:Empty_Chassis.jpg | centre | text-bottom | thumb | Sun U10 Chassis with Electronics Removed]]
+
+To fit the Hawk board the old motherboard stand offs need to be removed from the case and two small hacksaw cuts are required to allow clearance for the VGA connector.
Careful placement allows unmodifed half height PCIe cards to be fitted but there is no support for the backplate.
' |
Old page size (old_size) | 13422 |
Lines added in edit (added_lines) | [
0 => 'A Sun U10 case, with the electronics removed is about right. ',
1 => '',
2 => '[[https://wiki.gentoo.org/wiki/File:Empty_Chassis.jpg | centre | text-bottom | thumb | Sun U10 Chassis with Electronics Removed]] ',
3 => '',
4 => 'To fit the Hawk board the old motherboard stand offs need to be removed from the case and two small hacksaw cuts are required to allow clearance for the VGA connector.'
] |
Lines removed in edit (removed_lines) | [
0 => 'A Sun U10 case, with the electronics removed is about right. To fit the Hawk board the old motherboard stand offs need to be removed from the case and two small hacksaw cuts are required to allow clearance for the VGA connector.'
] |
New page text, stripped of any markup (new_text) | 'Building on Gentoo on Mudan, which is an Applied Micro X-Gene 1 CPU, we have Gentoo on Hawk.
The Hawk motherboard is a 32 core Ampere Computing eMAG 8180 CPU. There is some history to be aware of here.
The Applied Micro ARM IP was sold to Ampere Computing after Applied Micro had been manufacturing and distributing the X-Gene 1 and X-Gene 2 ARM64 CPUs. Simplistically, think of the X-Gene 3 as four X-Gene 1 CPUs in the same package.
The X-Gene 3 was sampled, then the story passes to Ampere Computing.
The Ampere eMAG 8180 is based on the X-Gene 3
The board is intended to be used in an openEDGE half width 1U chassis, which makes finding a commodity case a challenge.
However, it does expect standard ATX power, so powering it up and operating it is not a problem.
Contents
1 Get going
1.1 Cooling
1.2 Boot/rescue media
1.3 DDR4 RAM
1.4 Storage
1.5 Kernel changes
1.6 IPMI control
1.6.1 Debug Sol example
1.7 Web interface
2 Power requirements
3 Random nuances
3.1 Serial port
3.2 PCIe slot
3.3 Migrating QEMU/KVMs
4 Mechanical considerations
4.1 Arranging the parts
4.2 Cooling
4.2.1 CPU Cooling
4.2.2 CPU Cooling Maybe
4.2.3 Voltage regulator cooling
4.2.4 Fan Control
4.3 The PCI Express slot
5 Finding a case
5.1 Standard ATX cases
5.2 3D Printed Case
5.3 Sun U10 case
6 See also
7 References
8 External resources
Get going[edit | edit source]
Cooling[edit | edit source]
WarningDo not operate the system with only natural convection cooling for the CPU
The Hawk is intended to be fitted to a 1U half width chassis and use six fans for cooling.
With a 2200 RPM, 8cm fan mounted directly on the heatsink, the CPU reached 95°C at 90W CPU input power. Its rated at 125W too.
Even at 13W idling at the prompt, the CPU runs at 47°C
Boot/rescue media[edit | edit source]
Use the rescue mode of debian-10.4.0-arm64-xfce-CD-1.iso to boot, write efivars and so on. It will only drive the serial over LAN console.
dd it to a USB stick. The Hawk firmware says it can boot from CDROM but that's not confirmed.
DDR4 RAM[edit | edit source]
Do use Registered ECC DIMMs. I did test unregistered non ECC RAM from my main AMD64 system and it would not boot.
All the reference material says to fit in pairs but my Hawk is running quite happily on one. In the CH0_DIMM0 slot. The eMAG 8180 CPU can support two DIMMS per channel but only DIMM0 sockets are fitted on the Hawk.
The reference material uses different identifies for the RAM. The above is the silk screening on the board.
NoteThe connector numbers are silk screened onto the board in tiny text
Storage[edit | edit source]
Take your pick from SATA3 or NVME 4 lane PCIe. Being lazy, I put the Mudan SATA boot drive in to see what would happen. While the USB hardware and drivers are USB3, only USB2 ports are fitted. That's OK to get you going but not for long term use.
Kernel changes[edit | edit source]
Notice the absence of SATA on the PCIe bus:
root #lspci -nnk0000:00:00.0 PCI bridge [0604]: Ampere Computing, LLC eMAG PCI Express Root Port 0 [1def:e005] (rev 04)
Kernel driver in use: pcieport
0002:00:00.0 PCI bridge [0604]: Ampere Computing, LLC eMAG PCI Express Root Port 2 [1def:e007] (rev 04)
Kernel driver in use: pcieport
0004:00:00.0 PCI bridge [0604]: Ampere Computing, LLC eMAG PCI Express Root Port 4 [1def:e009] (rev 04)
Kernel driver in use: pcieport
0006:00:00.0 PCI bridge [0604]: Ampere Computing, LLC eMAG PCI Express Root Port 6 [1def:e00b] (rev 04)
Kernel driver in use: pcieport
0006:01:00.0 Ethernet controller [0200]: Intel Corporation I210 Gigabit Network Connection [8086:1533] (rev 03)
Subsystem: Intel Corporation Ethernet Server Adapter I210-T1 [8086:0002]
Kernel driver in use: igb
0007:00:00.0 PCI bridge [0604]: Ampere Computing, LLC eMAG PCI Express Root Port 7 [1def:e00c] (rev 04)
Kernel driver in use: pcieport
0007:01:00.0 PCI bridge [0604]: ASPEED Technology, Inc. AST1150 PCI-to-PCI Bridge [1a03:1150] (rev 04)
0007:02:00.0 VGA compatible controller [0300]: ASPEED Technology, Inc. ASPEED Graphics Family [1a03:2000] (rev 41)
Subsystem: ASPEED Technology, Inc. ASPEED Graphics Family [1a03:2000]
Kernel driver in use: ast
The kernel needed three changes from the X-Gene 1 kernel:
Max CPUs 32, not 8.
The Intel IGB network driver added
SATA_AHCI_PLATFORM added to be able to see the AHCI ports.
IPMI control[edit | edit source]
The Board Management Computer (BMC) is a ST2500. Use impitool on a remote host and enjoy all the good things that IPMI offers.
Activate the ADMIN login with password ADMIN, if required. e.g. after a factory reset. user $ipmitool -I lanplus -H $REMOTEHOST -U ADMIN -P ADMIN raw 0x32 0x91 1
Then get three ipmi shells with user $ipmitool -I lanplus -H $REMOTEHOST -U ADMIN -P ADMIN shell in three console windows.
One for power control, one for the debug Serial over LAN (SoL) console, and one for the SoL console.
Using each ipmi shell,
ipmitoolsol activate
ipmitoolsol activate instance=2 and
ipmitoolchassis power <power_command>
There are two more consoles too:
The VGA console;
the KVM console in the web interface.
The SoL console, VGA console and the KVM console all show different things.
Debug Sol example[edit | edit source]
Expect to see:
root #ipmitool -I lanplus -H 192.168.100.236 -U ADMIN -P ADMIN shellipmitool> sol activate instance=2
[SOL Session operational. Use ~? for help]
DRAM FW v191001
DRAM Region[0]: 0x0080000000 - 0x00FFFFFFFF
DRAM Region[1]: 0x0880000000 - 0x0FFFFFFFFF
DRAM Region[2]: 0x8800000000 - 0x8FFFFFFFFF
MCU[0]-Slot[0]: RDIMM[ID:ce80] M393A4K40BB2-CTD 32GB 2 rank(s) x4 > 2667
MCU[4]-Slot[0]: RDIMM[ID:ce80] M393A4K40BB2-CTD 32GB 2 rank(s) x4 > 2667
DRAM: 64GB DDR4 2667 ECC
NOTICE: Booting Trusted Firmware
NOTICE: BL1: v1.2(release):1.02.200626
NOTICE: BL1: Built : 03:15:07, Jun 27 2020
NOTICE: BL1: Booting BL2
NOTICE: BL2: v1.2(release):1.02.200626
NOTICE: BL2: Built : 03:15:07, Jun 27 2020
NOTICE: BL1: Booting BL31
NOTICE: BL31: v1.2(release):1.02.200626
NOTICE: BL31: Built : 03:15:07, Jun 27 2020 on the debug SoL console at power up.
If it continues, then the RAM in MCU 4 is probably faulty.
Error: MCU4 {---U}
Error Info: ecc_errcl 0x0
Error Info: ecc_errch 0x0
Error Info: ecc_errdl 0x1
Error Info: ecc_errdh 0x0
Error Info: ram_err 0x0
Web interface[edit | edit source]
There is a web interface at https://$REMOTEHOST. openwebstart is not required.
Power requirements[edit | edit source]
With the hardware configured as below:
A 700W PSU
The Hawk Board
One 32G RDIMM-2666
Two SATA3 SSDs in Raid 1
One 2200 RPM 8cm fan
Off, with 5vSTBY applied <5W
One user logged in over ssh, otherwise idle 39W
Building glibc with MAKEOPTS="-j32" 137W (Max)
Building the kernel with make -j40 148W max (CPU Temp 93°C with a 22°C ambient.
All power readings measured at the input to the PSU.
For completeness. The power factor is about 0.6. That's pretty terrible but its not user adjustable.
Random nuances[edit | edit source]
Serial port[edit | edit source]
The serial port is ttyS0 until openrc starts, then it becomes ttyAMA0.
The kernel command line needs
console=tty0 console=ttyS0,115200n8 console=ttyAMA0,115200n8 to see everything except a login prompt on serial console.
The login prompt requires ttyAMA0 in /etc/inittab
# SERIAL CONSOLES
s0:12345:respawn:/sbin/agetty -L 115200 ttyAMA0 vt100
PCIe slot[edit | edit source]
The references say that it is PCIe Gen 3, backwards compatible with Gen 1 and Gen 2. I can report that out of three cards I tested
two caused boot failures in the firmware.
Migrating QEMU/KVMs[edit | edit source]
The Hawk does not support GIC_v2. Use
root #virsh edit <domain>
<features>
<acpi/>
<gic version='2'/>
</features>
to change to gic version='3'
Mechanical considerations[edit | edit source]
Arranging the parts[edit | edit source]
Without a case, the Hawk parts were spread out on the anti-static mat on my electronics workbench as illustrated.
Hawk System Laid Out Flat
Points to note:
The board is mounted on 3mm stand offs to keep it away from the conductive surface.
The ATX PSU is below the board. It won't need 700W, I hope.
The HDD is at the left.
The faulty RAM stick is at the top.
Cooling[edit | edit source]
CPU Cooling[edit | edit source]
An 8cm fan can be retained to the heatsink with a couple of cable ties as illustrated.
Warning This is not adequate cooling. With 24 cores running, the CPU is 70°C above the ambient temperature
Fan retained to CPU heatsink
The fan is spaced off the heatsink with normal fan fixing screws. This was required to prevent the rotor clipping the heatsink fins.
There are a few disadvantages to this.
The solid rotor centre is very close to the fins which will be bad for cooling that part of the heatsink.
A soft mounting will probably be lower noise.
Whatever, the CPU needn to be kept under 96°C, which is the Upper Non-Critical temperature.
ipmitool> sensor get CPU_Temp
Locating sensor record...
Sensor ID : CPU_Temp (0x1)
Entity ID : 30.1
Sensor Type (Threshold) : Temperature
Sensor Reading : 57 (+/- 16) degrees C
Status : ok
Lower Non-Recoverable : 5.000
Lower Critical : 9.000
Lower Non-Critical : 20.000
Upper Non-Critical : 90.000
Upper Critical : 96.000
Upper Non-Recoverable : 100.000
Positive Hysteresis : Unspecified
Negative Hysteresis : Unspecified
CPU Cooling Maybe[edit | edit source]
WarningThis is not tested ... yet. Found one on ebay, so watch this space
There are images of a similar motherboard fitted with A Supermicro SNK-P0050AP4 cooler. Start reading at eMag Workstation by Avantek and zoom into the images of the linked hardware review. The part number on the side of the CPU cooler is clearly visible in one of the images.
That's not to say that its a drop in replacement for the 1U narrow LCA2011 passive heatsink with special screws, fitted to the Hawk now.
In its favour, it can do the job and the mounting holes line up.
Against, its intended for a 4U server but it should just fit in my modified U10 case.
Voltage regulator cooling[edit | edit source]
The voltage regulators, there are lots, are located in the area around the 12v_ATX connector.
Convection cooling is not adequate for voltage regulator cooling. The first one that complained was the PMD_VRD_Temp, which went critical even under light loads. Forced air cooling of this area is essential if the server is going to be operating at any more than a tickover.
Fan Control[edit | edit source]
Manual fan control using ipmitool works
From the ipmitool shell ipmitoolraw 0x3c 0x3 0x01 just once, followed by
ipmitoolraw 0x3c 0x4 A BA is the fan number in the range 1..6 for the Hawk.
B is the desired fan speed in the range 0..100. Fan speed is a decimal number.
The PCI Express slot[edit | edit source]
It is not possible to fit a standard PCIe card into the PCIe slot as the bottom end of the bracket will hit the power switch. A right angle riser card is expected to be used. Either modify the bracket or relocate the power switch.
I did look on the web for a right angle PCIe riser card. There are lots but they are all the wrong handedness. However, I found a PCIe extender card in my box of bits which is just enough to lift a normal card bracket above the switch. However, with vertical mounting, the back of the PCIe card fouls straight SATA connectors.
Finding a case[edit | edit source]
Standard ATX cases[edit | edit source]
The Hawk back panel is too wide for a commodity PC case back plate opening. Maybe it can be made to fit with some metalwork?
3D Printed Case[edit | edit source]
There is a Printed Case if you have access to a 3D printer.
It also deals with the cooling problem.
Sun U10 case[edit | edit source]
A Sun U10 case, with the electronics removed is about right.
[]
To fit the Hawk board the old motherboard stand offs need to be removed from the case and two small hacksaw cuts are required to allow clearance for the VGA connector.
Careful placement allows unmodifed half height PCIe cards to be fitted but there is no support for the backplate.
Full height cards would need the motherboard mounted on smaller stand offs than the 15mm x M3 I had to hand. That's probably worth while.
I've got as far as gutting the case, removing the original stand offs and cutting the back of the case then placing the board and front fan in position. I've ordered some 8mm and 10mm stand offs. The are actually spacers, for a screw each side. Its easier to slot a hole for a screw than to move a tapped hole that's in the wrong place.
The new ATX PSU is in. Two small hacksaw cuts, or a touch with the angle grinder, are required to clear the power input connector.
The original front fan has been replace by a 140mm fan. That's almost the width of the Hawk board, so there should be plenty of cooling for the on board power regulators.
Still to do. Drilling the U10 motherboard tray to suit the Hawk.
Photos will be added later.
See also[edit | edit source]
Gentoo On X-Gene 1 Mudan — an AARCH64 (arm64) server board based on the APM X-Gene 1 CPU.
References[edit | edit source]
Hawk Technical Specification
Hawk Board Overview
ampere-openbmc/ampere-ipmi-oem
External resources[edit | edit source]
Applied Micro X-Gene 3
Ampere eMAG 8180' |
Parsed HTML source of the new revision (new_html) | '<div class="mw-parser-output"><p>Building on <a href="/wiki/Gentoo_On_X-Gene_1_Mudan" title="Gentoo On X-Gene 1 Mudan">Gentoo on Mudan</a>, which is an Applied Micro X-Gene 1 CPU, we have Gentoo on Hawk.
</p><p>The Hawk motherboard is a 32 core Ampere Computing eMAG 8180 CPU. There is some history to be aware of here.
The Applied Micro ARM IP was sold to Ampere Computing after Applied Micro had been manufacturing and distributing the X-Gene 1 and X-Gene 2 ARM64 CPUs. Simplistically, think of the X-Gene 3 as four X-Gene 1 CPUs in the same package.
</p><p>The X-Gene 3 was sampled, then the story passes to Ampere Computing.
</p><p>The Ampere eMAG 8180 is based on the X-Gene 3
</p><p>The board is intended to be used in an openEDGE half width 1U chassis, which makes finding a commodity case a challenge.
However, it does expect standard ATX power, so powering it up and operating it is not a problem.
</p>
<div id="toc" class="toc" role="navigation" aria-labelledby="mw-toc-heading"><input type="checkbox" role="button" id="toctogglecheckbox" class="toctogglecheckbox" style="display:none" /><div class="toctitle" lang="en" dir="ltr"><h2 id="mw-toc-heading">Contents</h2><span class="toctogglespan"><label class="toctogglelabel" for="toctogglecheckbox"></label></span></div>
<ul>
<li class="toclevel-1 tocsection-1"><a href="#Get_going"><span class="tocnumber">1</span> <span class="toctext">Get going</span></a>
<ul>
<li class="toclevel-2 tocsection-2"><a href="#Cooling"><span class="tocnumber">1.1</span> <span class="toctext">Cooling</span></a></li>
<li class="toclevel-2 tocsection-3"><a href="#Boot.2Frescue_media"><span class="tocnumber">1.2</span> <span class="toctext">Boot/rescue media</span></a></li>
<li class="toclevel-2 tocsection-4"><a href="#DDR4_RAM"><span class="tocnumber">1.3</span> <span class="toctext">DDR4 RAM</span></a></li>
<li class="toclevel-2 tocsection-5"><a href="#Storage"><span class="tocnumber">1.4</span> <span class="toctext">Storage</span></a></li>
<li class="toclevel-2 tocsection-6"><a href="#Kernel_changes"><span class="tocnumber">1.5</span> <span class="toctext">Kernel changes</span></a></li>
<li class="toclevel-2 tocsection-7"><a href="#IPMI_control"><span class="tocnumber">1.6</span> <span class="toctext">IPMI control</span></a>
<ul>
<li class="toclevel-3 tocsection-8"><a href="#Debug_Sol_example"><span class="tocnumber">1.6.1</span> <span class="toctext">Debug Sol example</span></a></li>
</ul>
</li>
<li class="toclevel-2 tocsection-9"><a href="#Web_interface"><span class="tocnumber">1.7</span> <span class="toctext">Web interface</span></a></li>
</ul>
</li>
<li class="toclevel-1 tocsection-10"><a href="#Power_requirements"><span class="tocnumber">2</span> <span class="toctext">Power requirements</span></a></li>
<li class="toclevel-1 tocsection-11"><a href="#Random_nuances"><span class="tocnumber">3</span> <span class="toctext">Random nuances</span></a>
<ul>
<li class="toclevel-2 tocsection-12"><a href="#Serial_port"><span class="tocnumber">3.1</span> <span class="toctext">Serial port</span></a></li>
<li class="toclevel-2 tocsection-13"><a href="#PCIe_slot"><span class="tocnumber">3.2</span> <span class="toctext">PCIe slot</span></a></li>
<li class="toclevel-2 tocsection-14"><a href="#Migrating_QEMU.2FKVMs"><span class="tocnumber">3.3</span> <span class="toctext">Migrating QEMU/KVMs</span></a></li>
</ul>
</li>
<li class="toclevel-1 tocsection-15"><a href="#Mechanical_considerations"><span class="tocnumber">4</span> <span class="toctext">Mechanical considerations</span></a>
<ul>
<li class="toclevel-2 tocsection-16"><a href="#Arranging_the_parts"><span class="tocnumber">4.1</span> <span class="toctext">Arranging the parts</span></a></li>
<li class="toclevel-2 tocsection-17"><a href="#Cooling_2"><span class="tocnumber">4.2</span> <span class="toctext">Cooling</span></a>
<ul>
<li class="toclevel-3 tocsection-18"><a href="#CPU_Cooling"><span class="tocnumber">4.2.1</span> <span class="toctext">CPU Cooling</span></a></li>
<li class="toclevel-3 tocsection-19"><a href="#CPU_Cooling_Maybe"><span class="tocnumber">4.2.2</span> <span class="toctext">CPU Cooling Maybe</span></a></li>
<li class="toclevel-3 tocsection-20"><a href="#Voltage_regulator_cooling"><span class="tocnumber">4.2.3</span> <span class="toctext">Voltage regulator cooling</span></a></li>
<li class="toclevel-3 tocsection-21"><a href="#Fan_Control"><span class="tocnumber">4.2.4</span> <span class="toctext">Fan Control</span></a></li>
</ul>
</li>
<li class="toclevel-2 tocsection-22"><a href="#The_PCI_Express_slot"><span class="tocnumber">4.3</span> <span class="toctext">The PCI Express slot</span></a></li>
</ul>
</li>
<li class="toclevel-1 tocsection-23"><a href="#Finding_a_case"><span class="tocnumber">5</span> <span class="toctext">Finding a case</span></a>
<ul>
<li class="toclevel-2 tocsection-24"><a href="#Standard_ATX_cases"><span class="tocnumber">5.1</span> <span class="toctext">Standard ATX cases</span></a></li>
<li class="toclevel-2 tocsection-25"><a href="#3D_Printed_Case"><span class="tocnumber">5.2</span> <span class="toctext">3D Printed Case</span></a></li>
<li class="toclevel-2 tocsection-26"><a href="#Sun_U10_case"><span class="tocnumber">5.3</span> <span class="toctext">Sun U10 case</span></a></li>
</ul>
</li>
<li class="toclevel-1 tocsection-27"><a href="#See_also"><span class="tocnumber">6</span> <span class="toctext">See also</span></a></li>
<li class="toclevel-1 tocsection-28"><a href="#References"><span class="tocnumber">7</span> <span class="toctext">References</span></a></li>
<li class="toclevel-1 tocsection-29"><a href="#External_resources"><span class="tocnumber">8</span> <span class="toctext">External resources</span></a></li>
</ul>
</div>
<h2><span class="mw-headline" id="Get_going">Get going</span><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/index.php?title=Gentoo_on_Hawk&veaction=edit&section=1" class="mw-editsection-visualeditor" title="Edit section: Get going">edit</a><span class="mw-editsection-divider"> | </span><a href="/index.php?title=Gentoo_on_Hawk&action=edit&section=1" title="Edit section: Get going">edit source</a><span class="mw-editsection-bracket">]</span></span></h2>
<h3><span class="mw-headline" id="Cooling">Cooling</span><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/index.php?title=Gentoo_on_Hawk&veaction=edit&section=2" class="mw-editsection-visualeditor" title="Edit section: Cooling">edit</a><span class="mw-editsection-divider"> | </span><a href="/index.php?title=Gentoo_on_Hawk&action=edit&section=2" title="Edit section: Cooling">edit source</a><span class="mw-editsection-bracket">]</span></span></h3>
<div class="alert alert-danger gw-box" style="padding-top: 8px; padding-bottom: 8px;"><strong><i class="fa fa-exclamation-triangle"></i> Warning</strong><br />Do not operate the system with only natural convection cooling for the CPU</div>
<p>The Hawk is intended to be fitted to a 1U half width chassis and use six fans for cooling.
</p><p>With a 2200 RPM, 8cm fan mounted directly on the heatsink, the CPU reached 95°C at 90W CPU input power. Its rated at 125W too.
</p><p>Even at 13W idling at the prompt, the CPU runs at 47°C
</p>
<h3><span id="Boot/rescue_media"></span><span class="mw-headline" id="Boot.2Frescue_media">Boot/rescue media</span><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/index.php?title=Gentoo_on_Hawk&veaction=edit&section=3" class="mw-editsection-visualeditor" title="Edit section: Boot/rescue media">edit</a><span class="mw-editsection-divider"> | </span><a href="/index.php?title=Gentoo_on_Hawk&action=edit&section=3" title="Edit section: Boot/rescue media">edit source</a><span class="mw-editsection-bracket">]</span></span></h3>
<p>Use the rescue mode of <span style="font-family: monospace; font-size: 95%">debian-10.4.0-arm64-xfce-CD-1.iso</span> to boot, write efivars and so on. It will only drive the serial over LAN console.
</p><p><span style="font-family: monospace; font-size: 95%; font-weight: bold;" class="tripleclick-separator">dd</span> it to a USB stick. The Hawk firmware says it can boot from CDROM but that's not confirmed.
</p>
<h3><span class="mw-headline" id="DDR4_RAM">DDR4 RAM</span><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/index.php?title=Gentoo_on_Hawk&veaction=edit&section=4" class="mw-editsection-visualeditor" title="Edit section: DDR4 RAM">edit</a><span class="mw-editsection-divider"> | </span><a href="/index.php?title=Gentoo_on_Hawk&action=edit&section=4" title="Edit section: DDR4 RAM">edit source</a><span class="mw-editsection-bracket">]</span></span></h3>
<p>Do use Registered ECC DIMMs. I did test unregistered non ECC RAM from my main AMD64 system and it would not boot.
</p><p>All the reference material says to fit in pairs but my Hawk is running quite happily on one. In the CH0_DIMM0 slot. The eMAG 8180 CPU can support two DIMMS per channel but only DIMM0 sockets are fitted on the Hawk.
</p><p>The reference material uses different identifies for the RAM. The above is the silk screening on the board.
</p>
<div class="alert alert-info gw-box" style="padding-top: 8px; padding-bottom: 8px;"><strong><i class="fa fa-sticky-note-o fa-rotate-180"></i> Note</strong><br />The connector numbers are silk screened onto the board in tiny text</div>
<h3><span class="mw-headline" id="Storage">Storage</span><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/index.php?title=Gentoo_on_Hawk&veaction=edit&section=5" class="mw-editsection-visualeditor" title="Edit section: Storage">edit</a><span class="mw-editsection-divider"> | </span><a href="/index.php?title=Gentoo_on_Hawk&action=edit&section=5" title="Edit section: Storage">edit source</a><span class="mw-editsection-bracket">]</span></span></h3>
<p>Take your pick from SATA3 or NVME 4 lane PCIe. Being lazy, I put the Mudan SATA boot drive in to see what would happen. While the USB hardware and drivers are USB3, only USB2 ports are fitted. That's OK to get you going but not for long term use.
</p>
<h3><span class="mw-headline" id="Kernel_changes">Kernel changes</span><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/index.php?title=Gentoo_on_Hawk&veaction=edit&section=6" class="mw-editsection-visualeditor" title="Edit section: Kernel changes">edit</a><span class="mw-editsection-divider"> | </span><a href="/index.php?title=Gentoo_on_Hawk&action=edit&section=6" title="Edit section: Kernel changes">edit source</a><span class="mw-editsection-bracket">]</span></span></h3>
<p>Notice the absence of SATA on the PCIe bus:
</p>
<div class="cmd-box"><div><code style="color: #ef2929; font-weight: bold;">root <span style="color:royalblue;">#</span></code><span class="tripleclick-separator"></span><span style="-moz-user-select: all; -webkit-user-select: all; -ms-user-select: all; user-select: all;"><code>lspci -nnk</code></span></div><pre>0000:00:00.0 PCI bridge [0604]: Ampere Computing, LLC eMAG PCI Express Root Port 0 [1def:e005] (rev 04)
Kernel driver in use: pcieport
0002:00:00.0 PCI bridge [0604]: Ampere Computing, LLC eMAG PCI Express Root Port 2 [1def:e007] (rev 04)
Kernel driver in use: pcieport
0004:00:00.0 PCI bridge [0604]: Ampere Computing, LLC eMAG PCI Express Root Port 4 [1def:e009] (rev 04)
Kernel driver in use: pcieport
0006:00:00.0 PCI bridge [0604]: Ampere Computing, LLC eMAG PCI Express Root Port 6 [1def:e00b] (rev 04)
Kernel driver in use: pcieport
0006:01:00.0 Ethernet controller [0200]: Intel Corporation I210 Gigabit Network Connection [8086:1533] (rev 03)
Subsystem: Intel Corporation Ethernet Server Adapter I210-T1 [8086:0002]
Kernel driver in use: igb
0007:00:00.0 PCI bridge [0604]: Ampere Computing, LLC eMAG PCI Express Root Port 7 [1def:e00c] (rev 04)
Kernel driver in use: pcieport
0007:01:00.0 PCI bridge [0604]: ASPEED Technology, Inc. AST1150 PCI-to-PCI Bridge [1a03:1150] (rev 04)
0007:02:00.0 VGA compatible controller [0300]: ASPEED Technology, Inc. ASPEED Graphics Family [1a03:2000] (rev 41)
Subsystem: ASPEED Technology, Inc. ASPEED Graphics Family [1a03:2000]
Kernel driver in use: ast
</pre></div>
<p>The kernel needed three changes from the X-Gene 1 kernel:
</p>
<ol><li>Max CPUs 32, not 8.</li>
<li>The Intel IGB network driver added</li>
<li>SATA_AHCI_PLATFORM added to be able to see the AHCI ports.</li></ol>
<h3><span class="mw-headline" id="IPMI_control">IPMI control</span><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/index.php?title=Gentoo_on_Hawk&veaction=edit&section=7" class="mw-editsection-visualeditor" title="Edit section: IPMI control">edit</a><span class="mw-editsection-divider"> | </span><a href="/index.php?title=Gentoo_on_Hawk&action=edit&section=7" title="Edit section: IPMI control">edit source</a><span class="mw-editsection-bracket">]</span></span></h3>
<p>The Board Management Computer (BMC) is a ST2500. Use <span style="font-family: monospace; font-size: 95%; font-weight: bold;" class="tripleclick-separator">impitool</span> on a remote host and enjoy all the good things that IPMI offers.
</p><p>
Activate the ADMIN login with password ADMIN, if required. e.g. after a factory reset. </p><div class="cmd-box"><div><code style="color: #4E9A06; font-weight: bold;">user <span style="color:royalblue;">$</span></code><span class="tripleclick-separator"></span><span style="-moz-user-select: all; -webkit-user-select: all; -ms-user-select: all; user-select: all;"><code>ipmitool -I lanplus -H $REMOTEHOST -U ADMIN -P ADMIN raw 0x32 0x91 1</code></span></div></div><p>
Then get three ipmi shells with </p><div class="cmd-box"><div><code style="color: #4E9A06; font-weight: bold;">user <span style="color:royalblue;">$</span></code><span class="tripleclick-separator"></span><span style="-moz-user-select: all; -webkit-user-select: all; -ms-user-select: all; user-select: all;"><code>ipmitool -I lanplus -H $REMOTEHOST -U ADMIN -P ADMIN shell</code></span></div></div><p> in three console windows.
</p><p>One for power control, one for the debug Serial over LAN (SoL) console, and one for the SoL console.
Using each ipmi shell,
</p>
<div class="cmd-box"><div><code style="color: #4E9A06; font-weight: bold;">ipmitool</code><span class="tripleclick-separator"></span><span style="-moz-user-select: all; -webkit-user-select: all; -ms-user-select: all; user-select: all;"><code>sol activate</code></span></div></div>
<div class="cmd-box"><div><code style="color: #4E9A06; font-weight: bold;">ipmitool</code><span class="tripleclick-separator"></span><span style="-moz-user-select: all; -webkit-user-select: all; -ms-user-select: all; user-select: all;"><code>sol activate instance=2</code></span></div></div><p> and
</p><div class="cmd-box"><div><code style="color: #4E9A06; font-weight: bold;">ipmitool</code><span class="tripleclick-separator"></span><span style="-moz-user-select: all; -webkit-user-select: all; -ms-user-select: all; user-select: all;"><code>chassis power <power_command></code></span></div></div>
<p>There are two more consoles too:
</p>
<ul><li>The VGA console;</li>
<li>the KVM console in the web interface.</li></ul>
<p>The SoL console, VGA console and the KVM console all show different things.
</p>
<h4><span class="mw-headline" id="Debug_Sol_example">Debug Sol example</span><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/index.php?title=Gentoo_on_Hawk&veaction=edit&section=8" class="mw-editsection-visualeditor" title="Edit section: Debug Sol example">edit</a><span class="mw-editsection-divider"> | </span><a href="/index.php?title=Gentoo_on_Hawk&action=edit&section=8" title="Edit section: Debug Sol example">edit source</a><span class="mw-editsection-bracket">]</span></span></h4>
<p>Expect to see:
</p>
<div class="cmd-box"><div><code style="color: #ef2929; font-weight: bold;">root <span style="color:royalblue;">#</span></code><span class="tripleclick-separator"></span><span style="-moz-user-select: all; -webkit-user-select: all; -ms-user-select: all; user-select: all;"><code>ipmitool -I lanplus -H 192.168.100.236 -U ADMIN -P ADMIN shell</code></span></div><pre>ipmitool> sol activate instance=2
[SOL Session operational. Use ~? for help]
DRAM FW v191001
DRAM Region[0]: 0x0080000000 - 0x00FFFFFFFF
DRAM Region[1]: 0x0880000000 - 0x0FFFFFFFFF
DRAM Region[2]: 0x8800000000 - 0x8FFFFFFFFF
MCU[0]-Slot[0]: RDIMM[ID:ce80] M393A4K40BB2-CTD 32GB 2 rank(s) x4 > 2667
MCU[4]-Slot[0]: RDIMM[ID:ce80] M393A4K40BB2-CTD 32GB 2 rank(s) x4 > 2667
DRAM: 64GB DDR4 2667 ECC
NOTICE: Booting Trusted Firmware
NOTICE: BL1: v1.2(release):1.02.200626
NOTICE: BL1: Built : 03:15:07, Jun 27 2020
NOTICE: BL1: Booting BL2
NOTICE: BL2: v1.2(release):1.02.200626
NOTICE: BL2: Built : 03:15:07, Jun 27 2020
NOTICE: BL1: Booting BL31
NOTICE: BL31: v1.2(release):1.02.200626
NOTICE: BL31: Built : 03:15:07, Jun 27 2020 </pre></div><p> on the debug SoL console at power up.
</p><p>If it continues, then the RAM in MCU 4 is probably faulty.
</p>
<pre>Error: MCU4 {---U}
Error Info: ecc_errcl 0x0
Error Info: ecc_errch 0x0
Error Info: ecc_errdl 0x1
Error Info: ecc_errdh 0x0
Error Info: ram_err 0x0</pre>
<h3><span class="mw-headline" id="Web_interface">Web interface</span><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/index.php?title=Gentoo_on_Hawk&veaction=edit&section=9" class="mw-editsection-visualeditor" title="Edit section: Web interface">edit</a><span class="mw-editsection-divider"> | </span><a href="/index.php?title=Gentoo_on_Hawk&action=edit&section=9" title="Edit section: Web interface">edit source</a><span class="mw-editsection-bracket">]</span></span></h3>
<p>There is a web interface at <a rel="nofollow" class="external free" href="https://$REMOTEHOST">https://$REMOTEHOST</a>. openwebstart is not required.
</p>
<h2><span class="mw-headline" id="Power_requirements">Power requirements</span><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/index.php?title=Gentoo_on_Hawk&veaction=edit&section=10" class="mw-editsection-visualeditor" title="Edit section: Power requirements">edit</a><span class="mw-editsection-divider"> | </span><a href="/index.php?title=Gentoo_on_Hawk&action=edit&section=10" title="Edit section: Power requirements">edit source</a><span class="mw-editsection-bracket">]</span></span></h2>
<p>With the hardware configured as below:
</p>
<ul><li>A 700W PSU</li>
<li>The Hawk Board</li>
<li>One 32G RDIMM-2666</li>
<li>Two SATA3 SSDs in Raid 1</li>
<li>One 2200 RPM 8cm fan</li></ul>
<p><br />
</p>
<ul><li>Off, with 5vSTBY applied <5W</li>
<li>One user logged in over ssh, otherwise idle 39W</li>
<li>Building glibc with MAKEOPTS="-j32" 137W (Max)</li>
<li>Building the kernel with make -j40 148W max (CPU Temp 93°C with a 22°C ambient.</li></ul>
<p><br />
All power readings measured at the input to the PSU.
</p><p>For completeness. The power factor is about 0.6. That's pretty terrible but its not user adjustable.
</p>
<h2><span class="mw-headline" id="Random_nuances">Random nuances</span><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/index.php?title=Gentoo_on_Hawk&veaction=edit&section=11" class="mw-editsection-visualeditor" title="Edit section: Random nuances">edit</a><span class="mw-editsection-divider"> | </span><a href="/index.php?title=Gentoo_on_Hawk&action=edit&section=11" title="Edit section: Random nuances">edit source</a><span class="mw-editsection-bracket">]</span></span></h2>
<h3><span class="mw-headline" id="Serial_port">Serial port</span><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/index.php?title=Gentoo_on_Hawk&veaction=edit&section=12" class="mw-editsection-visualeditor" title="Edit section: Serial port">edit</a><span class="mw-editsection-divider"> | </span><a href="/index.php?title=Gentoo_on_Hawk&action=edit&section=12" title="Edit section: Serial port">edit source</a><span class="mw-editsection-bracket">]</span></span></h3>
<p>The serial port is ttyS0 until openrc starts, then it becomes ttyAMA0.
The kernel command line needs
</p>
<pre>console=tty0 console=ttyS0,115200n8 console=ttyAMA0,115200n8</pre><p> to see everything except a login prompt on serial console.
</p><p>The login prompt requires ttyAMA0 in /etc/inittab
</p>
<pre># SERIAL CONSOLES
s0:12345:respawn:/sbin/agetty -L 115200 ttyAMA0 vt100</pre>
<h3><span class="mw-headline" id="PCIe_slot">PCIe slot</span><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/index.php?title=Gentoo_on_Hawk&veaction=edit&section=13" class="mw-editsection-visualeditor" title="Edit section: PCIe slot">edit</a><span class="mw-editsection-divider"> | </span><a href="/index.php?title=Gentoo_on_Hawk&action=edit&section=13" title="Edit section: PCIe slot">edit source</a><span class="mw-editsection-bracket">]</span></span></h3>
<p>The references say that it is PCIe Gen 3, backwards compatible with Gen 1 and Gen 2. I can report that out of three cards I tested
two caused boot failures in the firmware.
</p>
<h3><span id="Migrating_QEMU/KVMs"></span><span class="mw-headline" id="Migrating_QEMU.2FKVMs">Migrating QEMU/KVMs</span><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/index.php?title=Gentoo_on_Hawk&veaction=edit&section=14" class="mw-editsection-visualeditor" title="Edit section: Migrating QEMU/KVMs">edit</a><span class="mw-editsection-divider"> | </span><a href="/index.php?title=Gentoo_on_Hawk&action=edit&section=14" title="Edit section: Migrating QEMU/KVMs">edit source</a><span class="mw-editsection-bracket">]</span></span></h3>
<p>The Hawk does not support GIC_v2. Use
</p>
<div class="cmd-box"><div><code style="color: #ef2929; font-weight: bold;">root <span style="color:royalblue;">#</span></code><span class="tripleclick-separator"></span><span style="-moz-user-select: all; -webkit-user-select: all; -ms-user-select: all; user-select: all;"><code>virsh edit <domain></code></span></div></div>
<pre> <features>
<acpi/>
<gic version='2'/>
</features> </pre>
<p>to change to gic version='3'
</p>
<h2><span class="mw-headline" id="Mechanical_considerations">Mechanical considerations</span><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/index.php?title=Gentoo_on_Hawk&veaction=edit&section=15" class="mw-editsection-visualeditor" title="Edit section: Mechanical considerations">edit</a><span class="mw-editsection-divider"> | </span><a href="/index.php?title=Gentoo_on_Hawk&action=edit&section=15" title="Edit section: Mechanical considerations">edit source</a><span class="mw-editsection-bracket">]</span></span></h2>
<h3><span class="mw-headline" id="Arranging_the_parts">Arranging the parts</span><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/index.php?title=Gentoo_on_Hawk&veaction=edit&section=16" class="mw-editsection-visualeditor" title="Edit section: Arranging the parts">edit</a><span class="mw-editsection-divider"> | </span><a href="/index.php?title=Gentoo_on_Hawk&action=edit&section=16" title="Edit section: Arranging the parts">edit source</a><span class="mw-editsection-bracket">]</span></span></h3>
<p>Without a case, the Hawk parts were spread out on the anti-static mat on my electronics workbench as illustrated.
</p>
<div class="center"><div class="thumb tnone"><div class="thumbinner" style="width:302px;"><a href="/wiki/File:Hawk_on_Bench_small.jpg" class="image"><img alt="" src="/images/thumb/7/72/Hawk_on_Bench_small.jpg/300px-Hawk_on_Bench_small.jpg" decoding="async" width="300" height="169" class="thumbimage" srcset="/images/thumb/7/72/Hawk_on_Bench_small.jpg/450px-Hawk_on_Bench_small.jpg 1.5x, /images/thumb/7/72/Hawk_on_Bench_small.jpg/600px-Hawk_on_Bench_small.jpg 2x" /></a> <div class="thumbcaption"><div class="magnify"><a href="/wiki/File:Hawk_on_Bench_small.jpg" class="internal" title="Enlarge"></a></div>Hawk System Laid Out Flat</div></div></div></div>
<p>Points to note:
</p>
<ol><li>The board is mounted on 3mm stand offs to keep it away from the conductive surface.</li>
<li>The ATX PSU is below the board. It won't need 700W, I hope.</li>
<li>The HDD is at the left.</li>
<li>The faulty RAM stick is at the top.</li></ol>
<h3><span class="mw-headline" id="Cooling_2">Cooling</span><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/index.php?title=Gentoo_on_Hawk&veaction=edit&section=17" class="mw-editsection-visualeditor" title="Edit section: Cooling">edit</a><span class="mw-editsection-divider"> | </span><a href="/index.php?title=Gentoo_on_Hawk&action=edit&section=17" title="Edit section: Cooling">edit source</a><span class="mw-editsection-bracket">]</span></span></h3>
<h4><span class="mw-headline" id="CPU_Cooling">CPU Cooling</span><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/index.php?title=Gentoo_on_Hawk&veaction=edit&section=18" class="mw-editsection-visualeditor" title="Edit section: CPU Cooling">edit</a><span class="mw-editsection-divider"> | </span><a href="/index.php?title=Gentoo_on_Hawk&action=edit&section=18" title="Edit section: CPU Cooling">edit source</a><span class="mw-editsection-bracket">]</span></span></h4>
<p>An 8cm fan can be retained to the heatsink with a couple of cable ties as illustrated.
</p>
<div class="alert alert-danger gw-box" style="padding-top: 8px; padding-bottom: 8px;"><strong><i class="fa fa-exclamation-triangle"></i> Warning</strong><br /> This is not adequate cooling. With 24 cores running, the CPU is 70°C above the ambient temperature</div>
<div class="center"><div class="thumb tnone"><div class="thumbinner" style="width:302px;"><a href="/wiki/File:Fan_Attachment_small.jpg" class="image"><img alt="" src="/images/thumb/c/c3/Fan_Attachment_small.jpg/300px-Fan_Attachment_small.jpg" decoding="async" width="300" height="169" class="thumbimage" srcset="/images/thumb/c/c3/Fan_Attachment_small.jpg/450px-Fan_Attachment_small.jpg 1.5x, /images/thumb/c/c3/Fan_Attachment_small.jpg/600px-Fan_Attachment_small.jpg 2x" /></a> <div class="thumbcaption"><div class="magnify"><a href="/wiki/File:Fan_Attachment_small.jpg" class="internal" title="Enlarge"></a></div>Fan retained to CPU heatsink</div></div></div></div>
<p>The fan is spaced off the heatsink with normal fan fixing screws. This was required to prevent the rotor clipping the heatsink fins.
</p><p>There are a few disadvantages to this.
</p>
<ol><li>The solid rotor centre is very close to the fins which will be bad for cooling that part of the heatsink.</li>
<li>A soft mounting will probably be lower noise.</li></ol>
<p>Whatever, the CPU needn to be kept under 96°C, which is the Upper Non-Critical temperature.
</p>
<pre>ipmitool> sensor get CPU_Temp
Locating sensor record...
Sensor ID : CPU_Temp (0x1)
Entity ID : 30.1
Sensor Type (Threshold) : Temperature
Sensor Reading : 57 (+/- 16) degrees C
Status : ok
Lower Non-Recoverable : 5.000
Lower Critical : 9.000
Lower Non-Critical : 20.000
Upper Non-Critical : 90.000
Upper Critical : 96.000
Upper Non-Recoverable : 100.000
Positive Hysteresis : Unspecified
Negative Hysteresis : Unspecified</pre>
<h4><span class="mw-headline" id="CPU_Cooling_Maybe">CPU Cooling Maybe</span><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/index.php?title=Gentoo_on_Hawk&veaction=edit&section=19" class="mw-editsection-visualeditor" title="Edit section: CPU Cooling Maybe">edit</a><span class="mw-editsection-divider"> | </span><a href="/index.php?title=Gentoo_on_Hawk&action=edit&section=19" title="Edit section: CPU Cooling Maybe">edit source</a><span class="mw-editsection-bracket">]</span></span></h4>
<div class="alert alert-danger gw-box" style="padding-top: 8px; padding-bottom: 8px;"><strong><i class="fa fa-exclamation-triangle"></i> Warning</strong><br />This is not tested ... yet. Found one on ebay, so watch this space</div>
<p>There are images of a similar motherboard fitted with A Supermicro SNK-P0050AP4 cooler. Start reading at <a rel="nofollow" class="external text" href="https://www.anandtech.com/show/15733/ampere-emag-system-a-32core-arm64-workstation%7CAmpere">eMag Workstation by Avantek</a> and zoom into the images of the linked hardware review. The part number on the side of the CPU cooler is clearly visible in one of the images.
</p><p>That's not to say that its a drop in replacement for the 1U narrow LCA2011 passive heatsink with special screws, fitted to the Hawk now.
</p><p>In its favour, it can do the job and the mounting holes line up.
</p><p>Against, its intended for a 4U server but it should just fit in my modified U10 case.
</p>
<h4><span class="mw-headline" id="Voltage_regulator_cooling">Voltage regulator cooling</span><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/index.php?title=Gentoo_on_Hawk&veaction=edit&section=20" class="mw-editsection-visualeditor" title="Edit section: Voltage regulator cooling">edit</a><span class="mw-editsection-divider"> | </span><a href="/index.php?title=Gentoo_on_Hawk&action=edit&section=20" title="Edit section: Voltage regulator cooling">edit source</a><span class="mw-editsection-bracket">]</span></span></h4>
<p>The voltage regulators, there are lots, are located in the area around the 12v_ATX connector.
</p><p>Convection cooling is not adequate for voltage regulator cooling. The first one that complained was the PMD_VRD_Temp, which went critical even under light loads. Forced air cooling of this area is essential if the server is going to be operating at any more than a tickover.
</p>
<h4><span class="mw-headline" id="Fan_Control">Fan Control</span><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/index.php?title=Gentoo_on_Hawk&veaction=edit&section=21" class="mw-editsection-visualeditor" title="Edit section: Fan Control">edit</a><span class="mw-editsection-divider"> | </span><a href="/index.php?title=Gentoo_on_Hawk&action=edit&section=21" title="Edit section: Fan Control">edit source</a><span class="mw-editsection-bracket">]</span></span></h4>
<p>Manual fan control using ipmitool works
</p><p>
From the ipmitool shell </p><div class="cmd-box"><div><code style="color: #4E9A06; font-weight: bold;">ipmitool</code><span class="tripleclick-separator"></span><span style="-moz-user-select: all; -webkit-user-select: all; -ms-user-select: all; user-select: all;"><code>raw 0x3c 0x3 0x01</code></span></div></div><p> just once, followed by
</p><div class="cmd-box"><div><code style="color: #4E9A06; font-weight: bold;">ipmitool</code><span class="tripleclick-separator"></span><span style="-moz-user-select: all; -webkit-user-select: all; -ms-user-select: all; user-select: all;"><code>raw 0x3c 0x4 A B</code></span></div></div><p>A is the fan number in the range 1..6 for the Hawk.
</p><p>B is the desired fan speed in the range 0..100. Fan speed is a decimal number.
</p>
<h3><span class="mw-headline" id="The_PCI_Express_slot">The PCI Express slot</span><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/index.php?title=Gentoo_on_Hawk&veaction=edit&section=22" class="mw-editsection-visualeditor" title="Edit section: The PCI Express slot">edit</a><span class="mw-editsection-divider"> | </span><a href="/index.php?title=Gentoo_on_Hawk&action=edit&section=22" title="Edit section: The PCI Express slot">edit source</a><span class="mw-editsection-bracket">]</span></span></h3>
<p>It is not possible to fit a standard PCIe card into the PCIe slot as the bottom end of the bracket will hit the power switch. A right angle riser card is expected to be used. Either modify the bracket or relocate the power switch.
</p><p>I did look on the web for a right angle PCIe riser card. There are lots but they are all the wrong handedness. However, I found a PCIe extender card in my box of bits which is just enough to lift a normal card bracket above the switch. However, with vertical mounting, the back of the PCIe card fouls straight SATA connectors.
</p>
<h2><span class="mw-headline" id="Finding_a_case">Finding a case</span><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/index.php?title=Gentoo_on_Hawk&veaction=edit&section=23" class="mw-editsection-visualeditor" title="Edit section: Finding a case">edit</a><span class="mw-editsection-divider"> | </span><a href="/index.php?title=Gentoo_on_Hawk&action=edit&section=23" title="Edit section: Finding a case">edit source</a><span class="mw-editsection-bracket">]</span></span></h2>
<h3><span class="mw-headline" id="Standard_ATX_cases">Standard ATX cases</span><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/index.php?title=Gentoo_on_Hawk&veaction=edit&section=24" class="mw-editsection-visualeditor" title="Edit section: Standard ATX cases">edit</a><span class="mw-editsection-divider"> | </span><a href="/index.php?title=Gentoo_on_Hawk&action=edit&section=24" title="Edit section: Standard ATX cases">edit source</a><span class="mw-editsection-bracket">]</span></span></h3>
<p>The Hawk back panel is too wide for a commodity PC case back plate opening. Maybe it can be made to fit with some metalwork?
</p>
<h3><span class="mw-headline" id="3D_Printed_Case">3D Printed Case</span><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/index.php?title=Gentoo_on_Hawk&veaction=edit&section=25" class="mw-editsection-visualeditor" title="Edit section: 3D Printed Case">edit</a><span class="mw-editsection-divider"> | </span><a href="/index.php?title=Gentoo_on_Hawk&action=edit&section=25" title="Edit section: 3D Printed Case">edit source</a><span class="mw-editsection-bracket">]</span></span></h3>
<p>There is a <a rel="nofollow" class="external text" href="https://primorobots.com/2020/04/09/hawk-diy-chassis-v0-5/%7C3D">Printed Case</a> if you have access to a 3D printer.
It also deals with the cooling problem.
</p>
<h3><span class="mw-headline" id="Sun_U10_case">Sun U10 case</span><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/index.php?title=Gentoo_on_Hawk&veaction=edit&section=26" class="mw-editsection-visualeditor" title="Edit section: Sun U10 case">edit</a><span class="mw-editsection-divider"> | </span><a href="/index.php?title=Gentoo_on_Hawk&action=edit&section=26" title="Edit section: Sun U10 case">edit source</a><span class="mw-editsection-bracket">]</span></span></h3>
<p>A Sun U10 case, with the electronics removed is about right.
</p><p>[<a rel="nofollow" class="external text" href="https://wiki.gentoo.org/wiki/File:Empty_Chassis.jpg"></a>]
</p><p>To fit the Hawk board the old motherboard stand offs need to be removed from the case and two small hacksaw cuts are required to allow clearance for the VGA connector.
</p><p>Careful placement allows unmodifed half height PCIe cards to be fitted but there is no support for the backplate.
</p><p>Full height cards would need the motherboard mounted on smaller stand offs than the 15mm x M3 I had to hand. That's probably worth while.
</p><p>I've got as far as gutting the case, removing the original stand offs and cutting the back of the case then placing the board and front fan in position. I've ordered some 8mm and 10mm stand offs. The are actually spacers, for a screw each side. Its easier to slot a hole for a screw than to move a tapped hole that's in the wrong place.
</p><p>The new ATX PSU is in. Two small hacksaw cuts, or a touch with the angle grinder, are required to clear the power input connector.
</p><p>The original front fan has been replace by a 140mm fan. That's almost the width of the Hawk board, so there should be plenty of cooling for the on board power regulators.
</p><p>Still to do. Drilling the U10 motherboard tray to suit the Hawk.
</p><p>Photos will be added later.
</p>
<h2><span class="mw-headline" id="See_also">See also</span><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/index.php?title=Gentoo_on_Hawk&veaction=edit&section=27" class="mw-editsection-visualeditor" title="Edit section: See also">edit</a><span class="mw-editsection-divider"> | </span><a href="/index.php?title=Gentoo_on_Hawk&action=edit&section=27" title="Edit section: See also">edit source</a><span class="mw-editsection-bracket">]</span></span></h2>
<ul><li><a href="/wiki/Gentoo_On_X-Gene_1_Mudan" title="Gentoo On X-Gene 1 Mudan">Gentoo On X-Gene 1 Mudan</a> — an AARCH64 (arm64) server board based on the APM X-Gene 1 CPU.</li></ul>
<h2><span class="mw-headline" id="References">References</span><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/index.php?title=Gentoo_on_Hawk&veaction=edit&section=28" class="mw-editsection-visualeditor" title="Edit section: References">edit</a><span class="mw-editsection-divider"> | </span><a href="/index.php?title=Gentoo_on_Hawk&action=edit&section=28" title="Edit section: References">edit source</a><span class="mw-editsection-bracket">]</span></span></h2>
<ul><li><a rel="nofollow" class="external text" href="http://files.opencompute.org/oc/public.php?service=files&t=ac831e5481cb7cdb1f3278b27cdca875&download">Hawk Technical Specification</a></li>
<li><a rel="nofollow" class="external text" href="https://146a55aca6f00848c565-a7635525d40ac1c70300198708936b4e.ssl.cf1.rackcdn.com/images/abae5b679799253dbda0bff990b6ec400d3014c4.pdf">Hawk Board Overview</a></li>
<li><a rel="nofollow" class="external text" href="https://github.com/ampere-openbmc/ampere-ipmi-oem">ampere-openbmc/ampere-ipmi-oem </a></li></ul>
<h2><span class="mw-headline" id="External_resources">External resources</span><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/index.php?title=Gentoo_on_Hawk&veaction=edit&section=29" class="mw-editsection-visualeditor" title="Edit section: External resources">edit</a><span class="mw-editsection-divider"> | </span><a href="/index.php?title=Gentoo_on_Hawk&action=edit&section=29" title="Edit section: External resources">edit source</a><span class="mw-editsection-bracket">]</span></span></h2>
<ul><li><a rel="nofollow" class="external text" href="https://en.wikichip.org/wiki/apm/x-gene/apm883832-x3">Applied Micro X-Gene 3</a></li>
<li><a rel="nofollow" class="external text" href="https://en.wikichip.org/wiki/ampere_computing/emag/8180">Ampere eMAG 8180</a></li></ul>
' |
Unix timestamp of change (timestamp) | 1650191479 |
Wiki