Hardware Benchmarking - Results
Revision as of 16:37, 17 January 2018 by Ellis Symons (talk | contribs)
Classic Results
The following table summarises the runtimes for a range of computers. More will be added when additional results are obtained. The table is ordered based on the combined 30m and 15m runtimes, with the fastest computers at the top of the table.
Runtimes for CPU benchmarks
| Processor Name | Processor Frequency (GHz)** | RAM size (GB) | RAM frequency (MHz) | Runtime 30m (mins) | Runtime 15m (mins) | Runtime 10m (mins) | Runtime Combined (mins) | System Name |
|---|---|---|---|---|---|---|---|---|
| Intel(R) Core(TM) i7-6700K CPU @ 4.80GHz | 4.8 | 64 | 3200 | 14.7 | 133.7 | N/A | 148.4 | MRU |
| Intel(R) Core(TM) i7-7700K CPU @ 4.70GHz | 4.7 | 64 | 3200 | 14.7 | 134.8 | N/A | 149.5 | RLO4 |
| Intel(R) Core(TM) i7-6700K CPU @ 4.80GHz | 4.8 | 64 | 2500 | 14.8 | 136.0 | N/A | 150.8 | RLO3 |
| Intel(R) Core(TM) i7-6700K CPU @ 4.80GHz | 4.8 | 64 | 2667 | 14.9 | 136.1 | N/A | 151.0 | RLO2 |
| Intel(R) Core(TM) i7-6700K CPU @ 4.71GHz | 4.71 | 32 | 2133 | 15.0 | 137.4 | N/A | 152.4 | DST2 |
| Intel(R) Core(TM) i7-6700K CPU @ 4.70GHz | 4.7 | 64 | 2500 | 14.9 | 138.7 | N/A | 153.6 | ZDO |
| Intel(R) Core(TM) i7-6700K CPU @ 4.70GHz | 4.7 | 64 | 2500 | 15.2 | 138.9 | N/A | 154.1 | RLO |
| Intel(R) Core(TM) i7-6700K CPU @ 4.50GHz | 4.5 | 64 | 2800 | 15.4 | 142.3 | N/A | 157.7 | CRY1 |
| Intel(R) Core(TM) i7-7700K CPU @ 4.20GHz | 4.2 | 64 | 2133 | 15.9 | 144.9 | N/A | 160.8 | CCO |
| Intel(R) Core(TM) i7-6700K CPU @ 4.00GHz | 4.0 | 64 | 2133 | 16.7 | 153.52 | N/A | 170.2 | NCO |
| Intel(R) Core(TM) i7-6700K CPU @ 4.0GHz | 4.0 | 32 | 2133 | 17.7 | 160.0 | N/A | 177.7 | DST1 |
| Intel(R) Core(TM) i7-7820HQ CPU @ 2.90GHz | 2.9 | 16 | 2400 | 19.5 | 167.1 | N/A | 186.6 | AWR |
| Intel(R) Xeon(R) CPU E5-1660 v4 @ 3.20GHz | 3.2 | 32 | 2400 | 19.3 | 183.72 | N/A | 203.0 | AGR |
| Intel(R) Core(TM) i7-6820HQ CPU @ 2.70GHz | 2.7 | 32 | 2133 | 20.7 | 190.6 | N/A | 211.3 | DDU |
| Intel(R) Core(TM) i7-6820HQ CPU @ 2.70GHz | 2.7 | 32 | 2133 | 21.2 | 193.2 | N/A | 214.4 | MG1 |
| Intel(R) Core(TM) i7-6560U CPU @ 2.20GHz | 2.2 | 8 | 1867 | 24.1 | 203.5 | N/A | 227.6 | RCO |
| Intel(R) Core(TM) i7-6500U CPU @ 2.50GHz | 2.5 | 16 | 1600 | 23.4 | 212.0 | N/A | 235.4 | GHA |
| Intel(R) Core(TM) i7-4790K CPU @ 4.00GHz | 4.0 | 32 | 1333 | 20.5 | 220.4 | N/A | 240.9 | BRA |
| Intel(R) Core(TM) i7-5500U CPU @ 2.40GHz | 2.4 | 16 | 1600 | 25.5 | 221.9 | N/A | 247.4 | NBO |
| Intel(R) Core(TM) i7-5820K CPU @ 3.30GHz | 3.3 | 64 | 2133 | 21.1 | 239.7 | N/A | 260.8 | DAN |
| Intel(R) Core(TM) i7-4790K CPU @ 4.00GHz | 4.0 | 16 | 1600 | 22.7 | 244.3 | N/A | 266.9 | RH1 |
| Intel(R) Core(TM) i7-5960 XCPU @ 3.00GHz | 3.0 | 64 | 2133 | 21.2 | 247.6 | N/A | 268.8 | MON |
| Intel(R) Core(TM) i7-5820K CPU @ 4.30GHz | 4.3 | 64 | 2800 | 23.8 | 251.2 | N/A | 275.0 | CRY2 |
| AMD FX(tm)-6350 Six-Core Processor @ 4.50GHz | 4.5 | 32 | 1600 | 35.00 | 240.6 | N/A | 275.6 | FYU |
| Intel(R) Core(TM) i5-4670 CPU @ 3.40GHz | 3.4 | 8 | 1600 | 23.9 | 256.7 | N/A | 280.6 | PAR |
| AMD FX(tm)-9590 Eight-Core Processor @ 4.70GHz | 4.7 | 16 | 1866 | 32.4 | 249.1 | N/A | 281.5 | DDH3 |
| Intel(R) Xeon(R) CPU E5-2630 v4 @ 2.20GHz | 2.2 | 128 | 2400 | 27.0 | 259.8 | N/A | 286.8 | LM3 |
| AMD FX(tm)-9590 Eight-Core Processor @ 4.70GHz | 4.7 | 16 | 1333 | 33.6 | 258.9 | N/A | 292.5 | DDH1 |
| Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz | 3.5 | 32 | 2133 | 23.6 | 269.3 | N/A | 292.9 | RH2 |
| Intel(R) Xeon(R) CPU E5-1680 v3 @ 3.20GHz | 3.2 | 16 | 2133 | 24.2 | 276.1 | N/A | 300.3 | RFR2 |
| Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz | 3.5 | 128 | 2133 | 24.6 | 277.1 | N/A | 301.6 | PTR |
| Intel(R) Core(TM) i7-3840QM CPU @ 2.80GHz | 2.8 | 16 | 1867 | 28.2 | 276.7 | N/A | 304.9 | RFR3 |
| Intel(R) Core(TM) i7-4790 CPU @ 3.60GHz | 3.6 | 32 | 1600 | 25.8 | 268.3 | N/A | 294.1 | CCA |
| Intel(R) Xeon(R) CPU E5-1680 v3 @ 3.20GHz | 3.2 | 16 | 2133 | 24.2 | 276.1 | N/A | 300.3 | RFR2 |
| Intel(R) Core(TM) i7-4810MQ CPU @ 2.80GHz | 2.8 | 8 | 1600 | 26.9 | 284.1 | N/A | 311.1 | EUK |
| Intel(R) Core(TM) i5-4570S CPU @ 2.90GHz | 2.9 | 8 | 1600 | 27.7 | 283.7 | N/A | 311.4 | LM2 |
| Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz | 3.5 | 32 | 2133 | 26.1 | 285.3 | N/A | 311.4 | MG2 |
| Intel(R) Xeon(R) CPU E5-2687W v3 @ 3.10GHz | 3.1 | 16 | 2133 | 24.9 | 291.7 | N/A | 316.6 | MBA |
| Intel(R) Xeon(R) CPU E5-1650 v2 @ 3.50GHz | 3.5 | 32 | 1600 | 28.5 | 285.9 | N/A | 314.4 | RH3 |
| Intel(R) Core(TM) i5-3570K CPU @ 3.40GHz | 3.4 | 8 | 1333 | 29.1 | 290.0 | N/A | 319.0 | RFR4 |
| Intel(R) Core(TM) i7-3770 CPU v3 @ 3.40GHz | 3.4 | 16 | 1600 | 29.7 | 296.2 | N/A | 325.9 | DDH2 |
| Intel(R) Xeon(R) CPU E5-1650 0 @ 3.20GHz | 3.2 | 16 | 1600 | 31.1 | 297.4 | N/A | 328.5 | RH3 |
| Intel(R) Core(TM) i7-3740QM CPU @ 2.70GHz | 2.7 | 16 | 1600 | 31.7 | 301.5 | N/A | 333.2 | MJS |
| Intel(R) Core(TM) i7-4800MQ CPU @ 2.70GHz | 2.7 | 32 | 1600 | 29.1 | 308.1 | N/A | 337.2 | JT1 |
| Intel(R) Core(TM) i7-5820K CPU @ 3.30GHz | 3.3 | 64 | 2133 | 29.2 | 317.1 | N/A | 346.3 | EOG |
| Intel(R) Xeon(R) CPU E5-1620 v2 CPU @ 3.70GHz | 3.7 | 16 | 1866 | 31.2 | 319.7 | N/A | 350.9 | TBE |
| Intel(R) Core(TM) i7-5820K CPU @ 3.30GHz | 3.3 | 64 | 2133 | 33.1 | 317.9 | N/A | 350.9 | JAC |
| Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz | 3.4 | 16 | 3401 | 35.6 | 320.2 | N/A | 355.8 | UOV |
| Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz | 3.4 | 16 | 1333 | 35.9 | 320.2 | N/A | 356.1 | MMO |
| Intel(R) Xeon(R) CPU E5-1630 v3 @ 3.70GHz | 3.7 | 32 | 2133 | 29.2 | 327.3 | N/A | 356.5 | NCH |
| Intel(R) Xeon(R) CPU E5-2670 V3 @ 2.30GHz | 2.3 | 96 | 2133 | 28.4 | 333.4 | N/A | 361.8 | RK2 |
| Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz | 3.5 | 16 | 2133 | 30.2 | 338.4 | N/A | 368.6 | RFR1 |
| Intel(R) Xeon(R) CPU E3-1240 V2 @ 3.40GHz | 3.4 | 32 | 1600 | 39.0 | 334.4 | N/A | 373.4 | XEO |
| Intel(R) Xeon(R) CPU E5-1620 0 @ 3.60GHz | 3.6 | 32 | 1600 | 44.2 | 335.8 | N/A | 380.0 | DCO |
| Intel(R) Xeon(R) CPU E5-2690 v2 @ 3.00GHz | 3.0 | 24 | 1866 | 34.4 | 353.9 | N/A | 388.4 | RSU |
| Intel(R) Core(TM)2 Quad CPU Q9550 @ 2.80GHz | 2.8 | 8 | 800 | 47.4 | 343.2 | N/A | 390.7 | AJI |
| Intel(R) Core(TM) i5-4300U CPU @ 3.30GHz | 1.9 | 8 | 1600 | 35.6 | 365.8 | N/A | 394.0 | LP1 |
| Intel(R) Xeon(R) W3565 CPU @ 3.20GHz | 3.2 | 12 | 1333 | 37.9 | 356.1 | N/A | 401.4 | LP2 |
| 2 x Intel(R) Xeon(R) X5680 CPU @ 3.33GHz | 3.3 | 64 | 1333 | 40.5 | 368.9 | N/A | 409.4 | WMD |
| Intel(R) Core(TM) i7-2670QM CPU @ 2.20GHz | 2.2 | 16 | 1333 | 40.3 | 375.3 | N/A | 415.6 | FFN |
| 2 x Intel(R) Xeon(R) CPU E5-2643 V3 @ 3.40GHz | 3.4 | 128 | 2133 | 40.5 | 377.1 | N/A | 418.1 | XYG |
| Intel(R) Xeon(R) E5-2630 CPU @ 2.30GHz | 2.3 | 64 | 1333 | 40.1 | 393.92 | N/A | 434.0 | HUH |
| Intel(R) Xeon(R) E5-1603 0 CPU @ 2.80GHz | 2.8 | 16 | 1600 | 40.9 | 395.8 | N/A | 436.7 | LMD |
| 2 x Intel(R) Xeon(R) CPU E5-2630 0 @ 2.80GHz | 2.3 | 38 | 1333 | 41.3 | 401.1 | N/A | 444.4 | RH5 |
| Intel(R) Core(TM) i7-4800MQ CPU @ 2.70GHz | 2.7 | 8 | 1600 | 39.5 | 420.7 | N/A | 460.2 | HUK |
| Intel(R) Core(TM) i7-920 CPU @ 2.67GHz | 2.67 | 12 | 1066 | 45.1 | 420.7 | N/A | 465.8 | REJ |
| Intel(R) Xeon(R) CPU E5-2690 v3 @ 2.60GHz | 2.60 | 9.33 | 2597 | 34.0 | 453.9 | N/A | 487.9 | Microsoft Azure NC6 (Cloud) |
| Intel(R) Xeon(R) CPU W3505 @ 2.53GHz | 2.53 | 4 | 1333 | 49.1 | 453.5 | N/A | 502.6 | JT2 |
| Intel(R) Xeon(R) CPU E5-2676 v3 @ 2.40GHz | 2.4 | 8 | 37.6 | 492.9 | N/A | 530.5 | DAG | |
| Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz | 2.6 | 60 | NA | 49.5 | 543.3 | N/A | 592.7 | Amazon Web Services g2.8xlarge (Cloud) |
| Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz | 2.6 | 15 | NA | 51.4 | 563.8 | N/A | 615.2 | Amazon Web Services g2.2xlarge (Cloud) |
| Intel(R) Xeon(R) CPU E5-1620 0 @ 3.60GHz | 3.6 | 16 | 1600 | 31.9 | 669.2 | N/A | 701.1 | RFR5 |
| Intel(R) Xeon(R) CPU X5650 @ 2.67GHz | 2.67 | 4 | 64.3 | 669.2 | N/A | 733.5 | ADU |
HPC results
HPC long version results
Discussion
Preliminary CPU Results
The below comparison of the CPU results presents a few interesting points for discussion:
- The runtimes for both models display similar variance as a percentage of the total time across hardware capabilities (36% and 39% relative standard deviation for the 30m and 15m models respectively).
- The runtimes for both the 15m and 30m model show variance largely linked to CPU frequency but not totally. The results are dispersed, perhaps reflecting chip variability, chipset or other systems factors.
- The difference in runtime between the fastest and slowest hardware (~440-500%) is much less than the difference in average runtime for the 30m and 15m models (1,110%). Thus, nothing can improve your model runtime like efficient model design!
