Category: infrastructure

PARAM Himalaya

About PARAM Himalaya

The supercomputing facility established under the build approach of National Supercomputing Mission with a peak computing power of 838 TeraFlops. Param Himalaya is designed and commissioned by C-DAC to cater to the computational needs of IIT, Mandi and various Research and Engineering institutes of the region. It is based on Intel Xeon Cascade lake processors, and NVIDIA Tesla V100 and HDR100. The system is built with the latest cutting edge hardware and software technologies. Substantial components utilized to build this system are manufactured and assembled within India, which is a step towards the Make in India initiative of the Government.

  • PARAM Himalaya Details

    System Specifications
    Theoretical Peak Floating-point Performance Total (Rpeak) 838 TFLOPS
    Base Specifications (Compute Nodes) 2 X Intel Xeon Cascadelake 8268, 24 Cores, 2.9 GHz, Processors per node, 192 GB Memory, 480 GB SSD
    Master/Service/Login Nodes 10 nos.
    CPU only Compute Nodes (Memory) 107 nos. (192GB) )
    GPU Nodes (Memory) 10 nos. (192GB)
    High Memory Compute Nodes 39 nos. (768GB)
    Total Memory 52.416 TB
    Interconnect Primary: 100Gbps Mellanox Infiniband Interconnect network 100% non-blocking, fat tree topology
    Secondary: 10G/1G Ethernet Network
    Management network: 1G Ethernet
    Storage 1PiB PFS based storage
    CPU Only Compute Nodes
    Nodes 107
    Cores 5136
    Compute Power of Rpeak 476.06 TFLOPS
    Each Node with 2 X Intel Xeon Cascadelake 8268, 24 cores, 2.9 GHz, processors
    192 GB memory
    480 GB SSD
    GPU Only Compute Nodes
    Nodes 10
    CPU Cores 400
    CUDA Cores 102400
    Rpeak CPU 32 TFLOPS + GPU 156 TF
    Each Node with 2 X Intel Xeon Skylake 6248, 20 cores, 2.5 GHz, processors
    192 GB Memory
    2 x NVIDIA V100 SXM2 GPU Cards (32 Nodes)
    480 GB SSD
    High Memory Compute Nodes
    Nodes 39
    CPU Cores 1872
    Compute Power of Rpeak 173.7 TFLOPS
    Each Node with 2 X Intel Xeon Cascadelake 8268, 24 cores, 2.9 GHz, processors
    768 GB Memory
    480 GB SSD
  • Architecture Diagram:
  • Software Stack:

Installed Applications/Libraries

HPC Applications
  • Bio-informatics: MUMmer, HMMER, MEME, PHYLIP, mpiBLAST, ClustalW
  • Molecular Dynamics: NAMD (for CPU and GPU), LAMMPS, GROMACS
  • CFD: OpenFOAM, SU2
  • Material Modeling, Quantum Chemistry: Quantum-Espresso, Abinit, CP2K, NWChem
  • Weather, Ocean, Climate: WRF-ARW, WPS (WRF), ARWPost (WRF), RegCM, MOM, ROMS
In-house Developed, Open-source Materials and Computational Chemistry (MCC) HPC Applications/Softwares
  • AMDKIIT : Linear scaling hybrid-DFT code for ab initio molecular dynamics
  • ANN-CI : Computational chemistry, code augmented by machine learning for studying complex biological systems
  • LITESOPH: Layer Integrated Toolkit and Engine for Simulations of Photo-induced phenomena is a toolkit for simulations of photo-induced phenomena
  • Mµ2Mech : It is a multiscale modeling approach combining atomistic and phase-field simulations for microstructure modeling during solid-state phase transformations
  • MTA* : Quantum chemistry code based on the fragmentation-based molecular tailoring approach
    • ( * MTA will be facilitated based on the Gaussian Institutional license. Kindly contact mscc-support@cdac.in for more details.)
Deep Learning Libraries
  • cuDNN, TensorFlow, Theano
Dependency Libraries
  • NetCDF, PNETCDF, Jasper, HDF5, Tcl, Boost, FFTW

Support

For any support, contact: himalayasupport@iitmandi.ac.in

PARAM Himalaya Usage Report

PARAM Porul

About PARAM Porul

PARAM Porul, a state-of-the-art supercomputing facility established under Phase-2 of National Supercomputing Mission. The supercomputer PARAM Porul is based on heterogeneous and hybrid configuration of Intel Xeon Cascade Lake processors, and NVIDIA Tesla V100 GPU cards. The system was designed and implemented by HPC Technologies team, Centre for Development of Advanced Computing (C-DAC).

PARAM Porul Details

System Specifications
Theoretical Peak Floating-point Performance Total (Rpeak) 838 TFLOPS
Base Specifications (Compute Nodes) 2 X Intel Xeon Cascadelake 8268, 24 Cores, 2.9 GHz, Processors per node, 192 GB Memory, 480 GB SSD
Master/Service/Login Nodes 10 nos.
CPU only Compute Nodes (Memory) 107 nos. (192GB)
GPU Nodes (Memory) 10 nos. (192GB)
High Memory Compute Nodes 39 nos. (768GB)
Total Memory 52.416 TB
Interconnect Primary: 100Gbps Mellanox Infiniband Interconnect network 100% non-blocking, fat tree topology
Secondary: 10G/1G Ethernet Network
Management network: 1G Ethernet
Storage 1PiB PFS based storage
CPU Only Compute Nodes
Nodes 107
Cores 5136
Compute Power of Rpeak 476.6 TFLOPS
Each Node with 2 X Intel Xeon Cascadelake 8268, 24 cores, 2.9 GHz, processors
192 GB memory
480 GB SSD
GPU Only Compute Nodes
Nodes 10
CPU Cores 400
CUDA Cores 102400
Rpeak CPU 32 TFLOPS + GPU 156 TF
Each Node with 2 X Intel Xeon Skylake 6248, 20 cores, 2.5 GHz, processors
192 GB Memory
2 x NVIDIA V100 SXM2 GPU Cards
480 GB SSD
High Memory Compute Nodes
Nodes 39
CPU Cores 1872
Compute Power of Rpeak 173.7 TFLOPS
Each Node with 2 X Intel Xeon Cascadelake 8268, 24 cores, 2.9 GHz, processors
768 GB Memory
480 GB SSD

PARAM Porul Architecture Diagram:
Software Stack:

Installed Applications/Libraries

HPC Applications
  • Bio-informatics: MUMmer, HMMER, MEME, PHYLIP, mpiBLAST, ClustalW
  • Molecular Dynamics: NAMD (for CPU and GPU), LAMMPS, GROMACS
  • CFD: OpenFOAM, SU2
  • Material Modeling, Quantum Chemistry: Quantum-Espresso, Abinit, CP2K, NWChem
  • Weather, Ocean, Climate: WRF-ARW, WPS (WRF), ARWPost (WRF), RegCM, MOM, ROMS
In-house Developed, Open-source Materials and Computational Chemistry (MCC) HPC Applications/Softwares
  • AMDKIIT : Linear scaling hybrid-DFT code for ab initio molecular dynamics
  • ANN-CI : Computational chemistry, code augmented by machine learning for studying complex biological systems
  • LITESOPH: Layer Integrated Toolkit and Engine for Simulations of Photo-induced phenomena is a toolkit for simulations of photo-induced phenomena
  • Mµ2Mech : It is a multiscale modeling approach combining atomistic and phase-field simulations for microstructure modeling during solid-state phase transformations
  • MTA* : Quantum chemistry code based on the fragmentation-based molecular tailoring approach
    • ( * MTA will be facilitated based on the Gaussian Institutional license. Kindly contact mscc-support@cdac.in for more details.)
Deep Learning Libraries
  • cuDNN, TensorFlow, Theano
Dependency Libraries
  • NetCDF, PNETCDF, Jasper, HDF5, Tcl, Boost, FFTW

Support

For any support, contact: porulsupport@nitt.edu

PARAM Porul Usage Report

Link To Be Added

*Note: The above data is coming from C-Chakshu (Multi Cluster Monitoring Platform)

Publication

There are a total of 38 publications that have been published using PARAM Porul till 2023.

PARAM Kamrupa

About PARAM Kamrupa

PARAM Kamrupa is based on heterogeneous and hybrid configuration of Intel Xeon Cascade Lake processors, and NVIDIA Tesla V100 GPU cards. The system was designed and implemented by HPC Technologies team, Centre for Development of Advanced Computing(C-DAC). It consists of 2 Master nodes, 4 Login nodes, 4 Service nodes and 156 (CPU+GPU) compute nodes with total peak computing capacity of 838 (CPU+GPU) TFLOPS performance.

PARAM Kamrupa Details

System Specifications
Theoretical Peak Floating-point Performance Total (Rpeak) 838 TFLOPS
Base Specifications (Compute Nodes) 2 X Intel Xeon Cascadelake 8268, 24 Cores, 2.9 GHz, Processors per node, 192 GB Memory, 480 GB SSD
Master/Service/Login Nodes 10 nos.
CPU only Compute Nodes (Memory) 107 nos. (192GB) )
GPU Nodes (Memory) 10 nos. (192GB)
High Memory Compute Nodes 39 nos. (768GB)
Total Memory 52.416 TB
Interconnect Primary: 100Gbps Mellanox Infiniband Interconnect network 100% non-blocking, fat tree topology
Secondary: 10G/1G Ethernet Network
Management network: 1G Ethernet
Storage 1PiB PFS based storage
CPU Only Compute Nodes
Nodes 107
Cores 5136
Compute Power of Rpeak 476.06 TFLOPS
Each Node with 2 X Intel Xeon Cascadelake 8268, 24 cores, 2.9 GHz, processors
192 GB memory
480 GB SSD
GPU Only Compute Nodes
Nodes 10
CPU Cores 400
CUDA Cores 102400
Rpeak CPU 32 TFLOPS + GPU 156 TF
Each Node with 2 X Intel Xeon Skylake 6248, 20 cores, 2.5 GHz, processors
192 GB Memory
2 x NVIDIA V100 SXM2 GPU Cards (32 Nodes)
480 GB SSD
High Memory Compute Nodes
Nodes 39
CPU Cores 1872
Compute Power of Rpeak 173.7 TFLOPS
Each Node with 2 X Intel Xeon Cascadelake 8268, 24 cores, 2.9 GHz, processors
768 GB Memory
480 GB SSD

Architecture Diagram
Software Stack

Installed Applications/Libraries

HPC Applications
  • Bio-informatics: MUMmer, HMMER, MEME, PHYLIP, mpiBLAST, ClustalW
  • Molecular Dynamics: NAMD (for CPU and GPU), LAMMPS, GROMACS
  • CFD: OpenFOAM, SU2
  • Material Modeling, Quantum Chemistry: Quantum-Espresso, Abinit, CP2K, NWChem
  • Weather, Ocean, Climate: WRF-ARW, WPS (WRF), ARWPost (WRF), RegCM, MOM, ROMS
In-house Developed, Open-source Materials and Computational Chemistry (MCC) HPC Applications/Softwares
  • AMDKIIT : Linear scaling hybrid-DFT code for ab initio molecular dynamics
  • ANN-CI : Computational chemistry, code augmented by machine learning for studying complex biological systems
  • LITESOPH: Layer Integrated Toolkit and Engine for Simulations of Photo-induced phenomena is a toolkit for simulations of photo-induced phenomena
  • Mµ2Mech : It is a multiscale modeling approach combining atomistic and phase-field simulations for microstructure modeling during solid-state phase transformations
  • MTA* : Quantum chemistry code based on the fragmentation-based molecular tailoring approach
    • ( * MTA will be facilitated based on the Gaussian Institutional license. Kindly contact mscc-support@cdac.in for more details.)
Deep Learning Libraries
  • cuDNN, TensorFlow, Theano
Dependency Libraries
  • NetCDF, PNETCDF, Jasper, HDF5, Tcl, Boost, FFTW

Support

For any support, contact: kamrupasupport@iitg.ac.in

PARAM Kamrupa Usage Report

Link To Be Added

*Note: The above data is coming from C-Chakshu (Multi Cluster Monitoring Platform)

Publication

There are a total of 2 publications that have been published using PARAM Kamrupa till 2023.

PARAM Ananta

About PARAM Ananta

IIT Gandhinagar's PARAM ANANTA is a cutting-edge supercomputer dedicated to the nation under the National Supercomputing Mission (NSM), with a peak computing power of 838 TeraFlops. It was commissioned on May 30, 2022, by Smt. Sunita Verma, Group Coordinator & Scientist 'G', MeitY. The system boasts a mix of CPU nodes, GPU nodes, High Memory nodes, High throughput storage, and high-performance InfiniBand interconnect, making it suitable for various scientific and engineering applications.

PARAM Ananta Details

System Specifications
Theoretical Peak Floating-point Performance Total (Rpeak) 838 TFLOPS
Base Specifications (Compute Nodes) 2 X Intel Xeon Cascadelake 8268, 24 Cores, 2.9 GHz, Processors per node, 192 GB Memory, 480 GB SSD
Master/Service/Login Nodes 10 nos.
CPU only Compute Nodes (Memory) 107 nos. (192GB)
GPU Nodes (Memory) 10 nos. (192GB)
High Memory Compute Nodes 39 nos. (768GB)
Total Memory 52.416 TB
Interconnect Primary: 100Gbps Mellanox Infiniband Interconnect network 100% non-blocking, fat tree topology
Secondary: 10G/1G Ethernet Network
Management network: 1G Ethernet
Storage 1PiB PFS based storage
CPU Only Compute Nodes
Nodes 107
Cores 5136
Compute Power of Rpeak 476.6 TFLOPS
Each Node with 2 X Intel Xeon Cascadelake 8268, 24 cores, 2.9 GHz, processors
192 GB memory
480 GB SSD
GPU Only Compute Nodes
Nodes 10
CPU Cores 400
CUDA Cores 102400
Rpeak CPU 32 TFLOPS + GPU 156 TF
Each Node with 2 X Intel Xeon Skylake 6248, 20 cores, 2.5 GHz, processors
192 GB Memory
2 x NVIDIA V100 SXM2 GPU Cards
480 GB SSD
High Memory Compute Nodes
Nodes 39
CPU Cores 1872
Compute Power of Rpeak 173.7 TFLOPS
Each Node with 2 X Intel Xeon Cascadelake 8268, 24 cores, 2.9 GHz, processors
768 GB Memory
480 GB SSD

PARAM Ananta Architecture Diagram:
Software Stack:

Installed Applications/Libraries

HPC Applications
  • Bio-informatics: MUMmer, HMMER, MEME, PHYLIP, mpiBLAST, ClustalW
  • Molecular Dynamics: NAMD (for CPU and GPU), LAMMPS, GROMACS
  • CFD: OpenFOAM, SU2
  • Material Modeling, Quantum Chemistry: Quantum-Espresso, Abinit, CP2K, NWChem
  • Weather, Ocean, Climate: WRF-ARW, WPS (WRF), ARWPost (WRF), RegCM, MOM, ROMS
In-house Developed, Open-source Materials and Computational Chemistry (MCC) HPC Applications/Softwares
  • AMDKIIT : Linear scaling hybrid-DFT code for ab initio molecular dynamics
  • ANN-CI : Computational chemistry, code augmented by machine learning for studying complex biological systems
  • LITESOPH: Layer Integrated Toolkit and Engine for Simulations of Photo-induced phenomena is a toolkit for simulations of photo-induced phenomena
  • Mµ2Mech : It is a multiscale modeling approach combining atomistic and phase-field simulations for microstructure modeling during solid-state phase transformations
  • MTA* : Quantum chemistry code based on the fragmentation-based molecular tailoring approach
    • ( * MTA will be facilitated based on the Gaussian Institutional license. Kindly contact mscc-support@cdac.in for more details.)
Deep Learning Libraries
  • cuDNN, TensorFlow, Theano
Dependency Libraries
  • NetCDF, PNETCDF, Jasper, HDF5, Tcl, Boost, FFTW

Support

For any support, contact: anantasupport@iitgn.ac.in

PARAM Ananta Usage Report

Link To Be Added

*Note: The above data is coming from C-Chakshu (Multi Cluster Monitoring Platform)

Publication

There are a total of 14 publications that have been published using PARAM Ananta till 2023.