The National Institute for Computational Sciences

ACF Open Research Enclave System Overview

Table 1 lists the compute nodes available to users of the ACF Open Research Enclave. Figure 1 provides a complete diagram of the ACF Open Research Enclave compute and storage resources.

Table 1 - All ACF Compute Nodes

Node Set

Intel® Xeon® CPU

Nodes

Cores/Node

GB Mem/Node

Total Cores

Interconnect
beacon E5-2670 44 16 256 704 FDR
beacon-gpu E5-2670
NVIDIA K20X GPU		 4 16 256 64 FDR
rho E5-2670 48 16 32 768 QDR
sigma E5-2680 v3 108 24 128 2,592 FDR
sigma_bigcore E5-2680 v4 10 28 128 280 FDR
monster E5-2687W v4 1 24 1,024 24 Ethernet
skylake Gold 6148 73 40 192 2,920 EDR
rome AMD EPYC 7542 1 32 128 32 HDR
Totals   289   44,096 7,384  

Table 2 lists the nodes available in the UTK Institutional Condo.

Table 2 - Compute Nodes in the UTK Institutional Condo

Node Set

Intel® Xeon® CPU

Nodes

Cores/Node

GB Mem/Node

Total Cores

Interconnect
beacon E5-2670 36 16 256 576 FDR
skylake Gold 6148 7 40 192 280 EDR
beacon-gpu E5-2670
NVIDIA K20X GPU		 2 16 256 32 FDR
rho E5-2670 45 16 32 720 QDR
sigma E5-2680 33 24 128 840 FDR
sigma_bigcore E5-2680 v4 2 28 128 56 FDR
monster E5-2687W 1 24 1,024 24 Ethernet
Totals   125   18,016 2,472  

Table 3 lists the nodes available in the UTHSC Institutional Condo.

Table 3 - Compute Nodes in the UTHSC Institutional Condo

Node Set

Intel® Xeon® CPU

Nodes

Cores/Node

GB Mem/Node

Total Cores

Interconnect
beacon E5-2670 7 16 256 112 FDR
beacon-gpu E5-2670
NVIDIA K20X GPU		 2 16 256 32 FDR
skylake Gold 6148 8 40 192 320 EDR
Totals   17   3,840 464  

Table 4 lists the nodes that are in investor condos. These are private condos available only to the users who own them. If you want to learn more about investing in the ACF, please visit the Node and Storage Investments document. The document contains the technical specifications and prices of the standard nodes investors can purchase for their use.

Table 4 - Compute Nodes in Investor Condos

Node Set

Intel® Xeon® CPU

Nodes

Cores/Node

GB Mem/Node

Total Cores

Interconnect
sigma E5-2680 75 24 128 1,800 FDR
sigma_bigcore E5-2680 v4 8 28 128 224 FDR
skylake Gold 6148 54 40 192 2,160 EDR
Totals   137   20,992 4,184  

Figure 1 - ACF Compute and Storage Resources

Last Updated: 02 / 26 / 2020