Hardware Selection Advice: Difference between revisions
Content deleted Content added
Line 40:
===Multiple GPUs===
TUFLOW can use multiple GPU cards on a machine to run a single model (TUFLOW FV can currently use a single GPU only). This is useful for models that are too large for a single GPU, or for running a model as quickly as possible. In general terms the run time benefit of using multiple cards increases with model size.
* TUFLOW HPC-GPU does not support SLI for inter-GPU communications.
*
** PCI bus - this method requires cards that supports TCC driver mode and all cards must be in TCC driver mode.
** NVLink - high-end compute cards can have up to 8 cards talking to each other through a high-spec NVLink, but many of the less expensive cards are limited to only having two connected together over a dual socket NVLink.
* Models may still be run across multiple GPUs even if an NVLink is not present and the GPU’s do not support peer-to-peer access. In this case HPC will revert to exchanging the domain boundary data between the GPUs via the CPU.
* When using multiple GPUs it is best to use cards of similar memory and performance. While it is possible (as of build 2020-01-AA) to re-balance a model over multiple GPUs, we do not recommend using cards with vastly disparate performance.
* Sufficient cooling and power supply should be considered if multiple cards are used. When installed in adjacent PCI slots, the preference is to use rear vented cards rather than side vented to avoid blowing hot air onto the neighbouring cards (which could lead to overheating).
| |||