Difference between revisions of "Hardware Benchmarking (2018-03-AA)"

From Tuflow
Jump to navigation Jump to search
 
(96 intermediate revisions by 6 users not shown)
Line 1: Line 1:
 
=Introduction=
 
=Introduction=
We frequently get asked, "What is the minimum or recommended hardware to use for TUFLOW modelling".  This is always a tricky question, as the answer depends on the type and size of the models you are going to be run. For a small model, TUFLOW should run on any modern PC or laptop that is capable of running Windows XP or later.  However, for large models there may be requirements for a hefty computer running a 64 bit version of Windows.<br>
+
We frequently get asked, "What is the minimum or recommended hardware to use for TUFLOW modelling".  This is always a tricky question, as the answer depends on the type and size of the models you are going to run. For a small model, TUFLOW should run on any modern PC or laptop that is capable of running Windows XP or later.  However, for large models there may be requirements for a hefty computer.<br>
 +
 
 
The tables below showing computer specifications and model run-time should help you compare systems. <br>
 
The tables below showing computer specifications and model run-time should help you compare systems. <br>
In this page we outline a hardware benchmark model which is available to download from the <u>[http://www.tuflow.com/Tuflow%20Tutorial%20Models.aspx TUFLOW website]</u> the model can be simulated without a TUFLOW dongle (license).  This makes it easy to benchmark on a range of computers and the results are complied below.<br>
+
 
We have typically found that for TUFLOW Classic, the CPU speed is the largest influence on TUFLOW runtimes, with the RAM speed also having an influence for large models. When using GPU hardware (available for TUFLOW HPC), the Graphics Card has the largest influence, specifically number of CUDA cores. In order to quantify this we are compiling the computational times required for a range of different machines.
+
In this page we outline a hardware benchmark model which is available to download from <u>[https://downloads.tuflow.com/_archive/TUFLOW/Benchmark_Models/FMA2_GPU_CPU_Benchmark.zip FMA2_GPU_CPU_Benchmark.zip]</u> the model can be simulated without a TUFLOW dongle (license).  This makes it easy to benchmark on a range of computers and the results are compiled below.<br>
 +
 
 +
We have typically found that for TUFLOW Classic, the CPU speed is the largest influence on TUFLOW runtimes, with the RAM speed also having an influence for large models. When using GPU hardware (available for TUFLOW HPC), the Graphics Card has the largest influence, specifically the number and speed of the CUDA cores. In order to quantify this we are compiling the computational times required for a range of different machines.
  
 
=Benchmark Model=
 
=Benchmark Model=
 
==Background==
 
==Background==
 
The benchmark model is based on a “challenge” issued prior to the 2012 Flood Managers Association (FMA) Conference in Sacramento, USA.  There is more information on the model setup and purpose  in the <u>[[FMA_Challenge_Models_Introduction | FMA challenge model introduction]]</u>.<br>
 
The benchmark model is based on a “challenge” issued prior to the 2012 Flood Managers Association (FMA) Conference in Sacramento, USA.  There is more information on the model setup and purpose  in the <u>[[FMA_Challenge_Models_Introduction | FMA challenge model introduction]]</u>.<br>
This hardware benchmark is based on the second challenge which involves a coastal river in flood with two ocean outlets.  The model has been modified slightly (mainly in terms of the outputs).  It is setup to run use both the TUFLOW Classic (CPU) and TUFLOW HPC (on both CPU and GPU hardware) for a range of cell sizes.
+
This hardware benchmark is based on the second challenge which involves a coastal river in flood with two ocean outlets.  The model has been modified slightly (mainly in terms of the outputs).  It is setup to use both the TUFLOW Classic (CPU) and TUFLOW HPC (on both CPU and GPU hardware) for a range of cell sizes.
 
<br>
 
<br>
'''Cell sizes'''
+
 
 
{| align="center" class="wikitable"
 
{| align="center" class="wikitable"
  
Line 16: Line 19:
 
! style="background-color:#005581; font-weight:bold; color:white;" width=50% | Number of cells
 
! style="background-color:#005581; font-weight:bold; color:white;" width=50% | Number of cells
 
|-
 
|-
|30 || 80,887
+
|20.0|| 181,981
 
|-
 
|-
|15 || 323,536
+
|10.0|| 727,865
 
|-
 
|-
|10 (GPU hardware only) || 727,865
+
|5.0 || 2,911,472
 +
|-
 +
|2.5 || 11,645,341
 
|}
 
|}
The model runs for three days of simulation time (72 hours).  The approximate run time for the 30m model on the CPU is likely to be ~20min and for the 15m version approximately 4 hours.  Given the runtime for the CPU model at 10m resolution is likely to be > 12 hours, this is skipped in the benchmark (this can also be run with a licence).
+
 
 +
The model runs for three days of simulation time (72 hours).  The approximate run time for the 30m model on the CPU is likely to be ~20min and for the 15m version approximately 4 hours.  Given the runtime for the CPU model at 10m resolution is likely to be > 12 hours, this is skipped in the benchmark (this can also be run without a licence).
 
<br>
 
<br>
 +
 
==Models==
 
==Models==
The user will have the option of running a 'short' version or 'long' version of the benchmarking models. Depending on the specifications of the computer in use, the long version can take upward of 12 - 24 hrs to complete. It also involves maximising the use of all cores on the CPU. It is preferred and recommended, that this be done overnight or on a dedicated modelling machine so that other processing tasks are kept to a minimum.<br><br>
+
<br>
 
The simulated models are:
 
The simulated models are:
*30m model - TUFLOW Classic
+
*20m model - TUFLOW Classic
*15m model - TUFLOW Classic
+
*20m model - TUFLOW HPC CPU - 2 Cores (default)
*30m model - TUFLOW HPC - GPU Hardware
+
*20m model - TUFLOW HPC - GPU Hardware
*15m model - TUFLOW HPC - GPU Hardware
 
 
*10m model - TUFLOW HPC - GPU Hardware
 
*10m model - TUFLOW HPC - GPU Hardware
*30m model - TUFLOW HPC - CPU Hardware - 2 Cores
+
 
*30m model - TUFLOW HPC - CPU Hardware - Max Cores (''long version only<sup>#</sup>'')
+
The user also has an option to run a couple of bigger models on GPU hardware as part of the High End GPU Benchmarking. To run these models, please follow the steps outlined in the below section.<br>
*15m model - TUFLOW HPC - CPU Hardware - Max Cores (''long version only<sup>#</sup>'')
+
HIGH END GPU BENCHMARKING MODELS
*5m model - TUFLOW HPC - GPU Hardware - ''Available upon request for anyone with 1 or multiple high performance graphics cards - please contact [mailto:support@tuflow.com support@tuflow.com]''<br><br>
+
*5m model - TUFLOW HPC - GPU Hardware
<font size=1>''<sup>#</sup> Utilises all CPU cores and it is preferred and recommended to run overnight or on a dedicated modelling machine so that other processing tasks are kept to a minimum''</font>
+
*2.5m model - TUFLOW HPC - GPU Hardware
  
 
==To Participate==
 
==To Participate==
 
To participate in the benchmark, please follow the steps below:
 
To participate in the benchmark, please follow the steps below:
* Download the model from http://www.tuflow.com/Download/TUFLOW/Benchmark_Models/FMA2_GPU_CPU_Benchmark.zip
+
<ol>
* Extract the model on a local drive of the computer you would like to benchmark.
+
<li> Download the model from <u>[https://downloads.tuflow.com/_archive/TUFLOW/Benchmark_Models/FMA2_GPU_CPU_Benchmark.zip FMA2_GPU_CPU_Benchmark.zip]</u>.
* Navigate to the '''TUFLOW\runs\''' folder and run the '''Run_Benchmark_Short.bat''' ''or'' '''Run_Benchmark_Long.bat''' file.  This checks if you are running a 32 or 64 bit system and then runs the benchmark.  This also generates some output files that contain more information on the processor, memory and GPU that you are using.
+
<li> Extract the model on a local drive of the computer you would like to benchmark.
* Email the _ TUFLOW Simulations.log, cpu.txt, ram.txt and GPU.txt files to support@tuflow.com and we will includes these in the results tables below.<br>
+
<li> Navigate to the '''TUFLOW\runs\''' folder and run the '''Run_Benchmark.bat''' file.  This checks if you are running a 32 or 64 bit system and then runs the benchmark.  This also generates some output files that contain more information on the processor, memory and GPU card that you are using.
A nVidia graphics card that is CUDA compatible is required to run the GPU model .  For more information on this please see the [http://www.tuflow.com/Download/TUFLOW/Releases/2013-12/Doc/TUFLOW%20Release%20Notes.2013-12.pdf release notes].<br>
+
<li> If you have a high performance GPU Card you can also run the '''Run_Benchmark_HighPerformance_GPU.bat'''.
The computer information is determined in the batch file using the '''wmic''' and '''dxdiag''' commands.
+
<li> Email the _ TUFLOW Simulations.log, cpu.txt, ram.txt and GPU.txt files to support@tuflow.com and we will includes these in the results tables below.<br>
 +
</ol>
 +
The computer information is determined in the batch file using the '''wmic''' and '''dxdiag''' commands.<br><br>
 +
'''Note''' An NVIDIA graphics card that is CUDA compatible is required to run the GPU model. <br>
 +
<br>
 +
 
 +
=List of Benchmarking Runtimes and Discussions=
 +
==Benchmarking Runtimes (2018-03-AA Release)==
 +
*[[Hardware_Benchmarking_-_Results#CPU_Results | CPU results]]
 +
*[[Hardware_Benchmarking_-_Results#GPU_Results | GPU results]]
  
=List of Benchmarking Results and Discussions=
+
==Discussion Topics==
 +
*[[Hardware_Benchmarking_Topic_HPC_on_CPU_vs_GPU | HPC (CPU) vs. HPC (GPU)]]
 +
*[[Hardware_Benchmarking_Topic_Single_Precision_VS_Double_Precision | Single Precision Vs Double Precision]]
 +
*[[ Hardware Selection Advice]]
  
*[[Hardware_Benchmarking_-_CPU_RESULTS | CPU results]]
+
==Previous Benchmarking Runtimes (2013-12-AD)==
*[[Hardware_Benchmarking_-_GPU_RESULTS | GPU results]]
+
* [[Hardware_Benchmarking | Previous Computer Hardware Speed Benchmarks Archive]]
*[[Hardware_Benchmarking_-_PREVIOUS_GPU_RESULTS | Previous GPU solver results]]
+
*[[Hardware_Benchmarking#CPU_Results | Previous CPU Results]]
*Discussion HPC CPU vs. HPC GPU
+
*[[Hardware_Benchmarking#GPU_Results | Previous GPU solver results]]
*Discussion Classic vs. HPC (CPU Hardware) - includes discussion on hyperthreading
+
 
*Discussion HPC vs. previous GPU solver (GPU Hardware)
+
==Hardware Selection Advice==
*Discussion HPC vs. QPC (GPU Hardware) (future page - hidden)
+
* [[Hardware_Selection_Advice | Hardware Selection Advice]]
 +
<br>
 +
{{Tips Navigation
 +
|uplink=[[Main_Page| TUFLOW Main Page]]
 +
}}

Latest revision as of 16:21, 29 July 2024

Introduction

We frequently get asked, "What is the minimum or recommended hardware to use for TUFLOW modelling". This is always a tricky question, as the answer depends on the type and size of the models you are going to run. For a small model, TUFLOW should run on any modern PC or laptop that is capable of running Windows XP or later. However, for large models there may be requirements for a hefty computer.

The tables below showing computer specifications and model run-time should help you compare systems.

In this page we outline a hardware benchmark model which is available to download from FMA2_GPU_CPU_Benchmark.zip the model can be simulated without a TUFLOW dongle (license). This makes it easy to benchmark on a range of computers and the results are compiled below.

We have typically found that for TUFLOW Classic, the CPU speed is the largest influence on TUFLOW runtimes, with the RAM speed also having an influence for large models. When using GPU hardware (available for TUFLOW HPC), the Graphics Card has the largest influence, specifically the number and speed of the CUDA cores. In order to quantify this we are compiling the computational times required for a range of different machines.

Benchmark Model

Background

The benchmark model is based on a “challenge” issued prior to the 2012 Flood Managers Association (FMA) Conference in Sacramento, USA. There is more information on the model setup and purpose in the FMA challenge model introduction.
This hardware benchmark is based on the second challenge which involves a coastal river in flood with two ocean outlets. The model has been modified slightly (mainly in terms of the outputs). It is setup to use both the TUFLOW Classic (CPU) and TUFLOW HPC (on both CPU and GPU hardware) for a range of cell sizes.

Cell Size (m) Number of cells
20.0 181,981
10.0 727,865
5.0 2,911,472
2.5 11,645,341

The model runs for three days of simulation time (72 hours). The approximate run time for the 30m model on the CPU is likely to be ~20min and for the 15m version approximately 4 hours. Given the runtime for the CPU model at 10m resolution is likely to be > 12 hours, this is skipped in the benchmark (this can also be run without a licence).

Models


The simulated models are:

  • 20m model - TUFLOW Classic
  • 20m model - TUFLOW HPC CPU - 2 Cores (default)
  • 20m model - TUFLOW HPC - GPU Hardware
  • 10m model - TUFLOW HPC - GPU Hardware

The user also has an option to run a couple of bigger models on GPU hardware as part of the High End GPU Benchmarking. To run these models, please follow the steps outlined in the below section.
HIGH END GPU BENCHMARKING MODELS

  • 5m model - TUFLOW HPC - GPU Hardware
  • 2.5m model - TUFLOW HPC - GPU Hardware

To Participate

To participate in the benchmark, please follow the steps below:

  1. Download the model from FMA2_GPU_CPU_Benchmark.zip.
  2. Extract the model on a local drive of the computer you would like to benchmark.
  3. Navigate to the TUFLOW\runs\ folder and run the Run_Benchmark.bat file. This checks if you are running a 32 or 64 bit system and then runs the benchmark. This also generates some output files that contain more information on the processor, memory and GPU card that you are using.
  4. If you have a high performance GPU Card you can also run the Run_Benchmark_HighPerformance_GPU.bat.
  5. Email the _ TUFLOW Simulations.log, cpu.txt, ram.txt and GPU.txt files to support@tuflow.com and we will includes these in the results tables below.

The computer information is determined in the batch file using the wmic and dxdiag commands.

Note An NVIDIA graphics card that is CUDA compatible is required to run the GPU model.

List of Benchmarking Runtimes and Discussions

Benchmarking Runtimes (2018-03-AA Release)

Discussion Topics

Previous Benchmarking Runtimes (2013-12-AD)

Hardware Selection Advice


Up
Go-up.png TUFLOW Main Page