PARAM Himalaya

About PARAM Himalaya

The supercomputing facility established under the build approach of National Supercomputing Mission with a peak computing power of 838 TeraFlops. Param Himalaya is designed and commissioned by C-DAC to cater to the computational needs of IIT, Mandi and various Research and Engineering institutes of the region. It is based on Intel Xeon Cascade lake processors, and NVIDIA Tesla V100 and HDR100. The system is built with the latest cutting edge hardware and software technologies. Substantial components utilized to build this system are manufactured and assembled within India, which is a step towards the Make in India initiative of the Government.

  • PARAM Himalaya Details

    System Specifications
    Theoretical Peak Floating-point Performance Total (Rpeak) 838 TFLOPS
    Base Specifications (Compute Nodes) 2 X Intel Xeon Cascadelake 8268, 24 Cores, 2.9 GHz, Processors per node, 192 GB Memory, 480 GB SSD
    Master/Service/Login Nodes 10 nos.
    CPU only Compute Nodes (Memory) 107 nos. (192GB) )
    GPU Nodes (Memory) 10 nos. (192GB)
    High Memory Compute Nodes 39 nos. (768GB)
    Total Memory 52.416 TB
    Interconnect Primary: 100Gbps Mellanox Infiniband Interconnect network 100% non-blocking, fat tree topology
    Secondary: 10G/1G Ethernet Network
    Management network: 1G Ethernet
    Storage 1PiB PFS based storage
    CPU Only Compute Nodes
    Nodes 107
    Cores 5136
    Compute Power of Rpeak 476.06 TFLOPS
    Each Node with 2 X Intel Xeon Cascadelake 8268, 24 cores, 2.9 GHz, processors
    192 GB memory
    480 GB SSD
    GPU Only Compute Nodes
    Nodes 10
    CPU Cores 400
    CUDA Cores 102400
    Rpeak CPU 32 TFLOPS + GPU 156 TF
    Each Node with 2 X Intel Xeon Skylake 6248, 20 cores, 2.5 GHz, processors
    192 GB Memory
    2 x NVIDIA V100 SXM2 GPU Cards (32 Nodes)
    480 GB SSD
    High Memory Compute Nodes
    Nodes 39
    CPU Cores 1872
    Compute Power of Rpeak 173.7 TFLOPS
    Each Node with 2 X Intel Xeon Cascadelake 8268, 24 cores, 2.9 GHz, processors
    768 GB Memory
    480 GB SSD
  • Architecture Diagram:
  • Software Stack:

Installed Applications/Libraries

HPC Applications
  • Bio-informatics: MUMmer, HMMER, MEME, PHYLIP, mpiBLAST, ClustalW
  • Molecular Dynamics: NAMD (for CPU and GPU), LAMMPS, GROMACS
  • CFD: OpenFOAM, SU2
  • Material Modeling, Quantum Chemistry: Quantum-Espresso, Abinit, CP2K, NWChem
  • Weather, Ocean, Climate: WRF-ARW, WPS (WRF), ARWPost (WRF), RegCM, MOM, ROMS
In-house Developed, Open-source Materials and Computational Chemistry (MCC) HPC Applications/Softwares
  • AMDKIIT : Linear scaling hybrid-DFT code for ab initio molecular dynamics
  • ANN-CI : Computational chemistry, code augmented by machine learning for studying complex biological systems
  • LITESOPH: Layer Integrated Toolkit and Engine for Simulations of Photo-induced phenomena is a toolkit for simulations of photo-induced phenomena
  • Mµ2Mech : It is a multiscale modeling approach combining atomistic and phase-field simulations for microstructure modeling during solid-state phase transformations
  • MTA* : Quantum chemistry code based on the fragmentation-based molecular tailoring approach
  • ( * MTA will be facilitated based on the Gaussian Institutional license. Kindly contact mscc-support@cdac.in for more details.)
Deep Learning Libraries
  • cuDNN, TensorFlow, Theano
Dependency Libraries
  • NetCDF, PNETCDF, Jasper, HDF5, Tcl, Boost, FFTW

Support

For any support, contact: himalayasupport@iitmandi.ac.in

PARAM Himalaya Usage Report