Difference between revisions of "Hardware Benchmarking - Results"

From Tuflow
Jump to navigation Jump to search
(Created page with "=CPU Results= The following table summarises the runtimes for a range of computers. More will be added when additional results are obtained. The table is ordered based on th...")
 
Line 1: Line 1:
=CPU Results=
+
=Classic Results=
 
The following table summarises the runtimes for a range of computers.  More will be added when additional results are obtained.  The table is ordered based on the combined 30m and 15m runtimes, with the fastest computers at the top of the table.
 
The following table summarises the runtimes for a range of computers.  More will be added when additional results are obtained.  The table is ordered based on the combined 30m and 15m runtimes, with the fastest computers at the top of the table.
 
<br>
 
<br>
Line 162: Line 162:
 
|-
 
|-
 
|}
 
|}
 +
=HPC results=
 +
 +
=HPC long version results=
  
 
=Discussion=
 
=Discussion=

Revision as of 16:37, 17 January 2018

Classic Results

The following table summarises the runtimes for a range of computers. More will be added when additional results are obtained. The table is ordered based on the combined 30m and 15m runtimes, with the fastest computers at the top of the table.
Runtimes for CPU benchmarks

Processor Name Processor Frequency (GHz)** RAM size (GB) RAM frequency (MHz) Runtime 30m (mins) Runtime 15m (mins) Runtime 10m (mins) Runtime Combined (mins) System Name
Intel(R) Core(TM) i7-6700K CPU @ 4.80GHz 4.8 64 3200 14.7 133.7 N/A 148.4 MRU
Intel(R) Core(TM) i7-7700K CPU @ 4.70GHz 4.7 64 3200 14.7 134.8 N/A 149.5 RLO4
Intel(R) Core(TM) i7-6700K CPU @ 4.80GHz 4.8 64 2500 14.8 136.0 N/A 150.8 RLO3
Intel(R) Core(TM) i7-6700K CPU @ 4.80GHz 4.8 64 2667 14.9 136.1 N/A 151.0 RLO2
Intel(R) Core(TM) i7-6700K CPU @ 4.71GHz 4.71 32 2133 15.0 137.4 N/A 152.4 DST2
Intel(R) Core(TM) i7-6700K CPU @ 4.70GHz 4.7 64 2500 14.9 138.7 N/A 153.6 ZDO
Intel(R) Core(TM) i7-6700K CPU @ 4.70GHz 4.7 64 2500 15.2 138.9 N/A 154.1 RLO
Intel(R) Core(TM) i7-6700K CPU @ 4.50GHz 4.5 64 2800 15.4 142.3 N/A 157.7 CRY1
Intel(R) Core(TM) i7-7700K CPU @ 4.20GHz 4.2 64 2133 15.9 144.9 N/A 160.8 CCO
Intel(R) Core(TM) i7-6700K CPU @ 4.00GHz 4.0 64 2133 16.7 153.52 N/A 170.2 NCO
Intel(R) Core(TM) i7-6700K CPU @ 4.0GHz 4.0 32 2133 17.7 160.0 N/A 177.7 DST1
Intel(R) Core(TM) i7-7820HQ CPU @ 2.90GHz 2.9 16 2400 19.5 167.1 N/A 186.6 AWR
Intel(R) Xeon(R) CPU E5-1660 v4 @ 3.20GHz 3.2 32 2400 19.3 183.72 N/A 203.0 AGR
Intel(R) Core(TM) i7-6820HQ CPU @ 2.70GHz 2.7 32 2133 20.7 190.6 N/A 211.3 DDU
Intel(R) Core(TM) i7-6820HQ CPU @ 2.70GHz 2.7 32 2133 21.2 193.2 N/A 214.4 MG1
Intel(R) Core(TM) i7-6560U CPU @ 2.20GHz 2.2 8 1867 24.1 203.5 N/A 227.6 RCO
Intel(R) Core(TM) i7-6500U CPU @ 2.50GHz 2.5 16 1600 23.4 212.0 N/A 235.4 GHA
Intel(R) Core(TM) i7-4790K CPU @ 4.00GHz 4.0 32 1333 20.5 220.4 N/A 240.9 BRA
Intel(R) Core(TM) i7-5500U CPU @ 2.40GHz 2.4 16 1600 25.5 221.9 N/A 247.4 NBO
Intel(R) Core(TM) i7-5820K CPU @ 3.30GHz 3.3 64 2133 21.1 239.7 N/A 260.8 DAN
Intel(R) Core(TM) i7-4790K CPU @ 4.00GHz 4.0 16 1600 22.7 244.3 N/A 266.9 RH1
Intel(R) Core(TM) i7-5960 XCPU @ 3.00GHz 3.0 64 2133 21.2 247.6 N/A 268.8 MON
Intel(R) Core(TM) i7-5820K CPU @ 4.30GHz 4.3 64 2800 23.8 251.2 N/A 275.0 CRY2
AMD FX(tm)-6350 Six-Core Processor @ 4.50GHz 4.5 32 1600 35.00 240.6 N/A 275.6 FYU
Intel(R) Core(TM) i5-4670 CPU @ 3.40GHz 3.4 8 1600 23.9 256.7 N/A 280.6 PAR
AMD FX(tm)-9590 Eight-Core Processor @ 4.70GHz 4.7 16 1866 32.4 249.1 N/A 281.5 DDH3
Intel(R) Xeon(R) CPU E5-2630 v4 @ 2.20GHz 2.2 128 2400 27.0 259.8 N/A 286.8 LM3
AMD FX(tm)-9590 Eight-Core Processor @ 4.70GHz 4.7 16 1333 33.6 258.9 N/A 292.5 DDH1
Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz 3.5 32 2133 23.6 269.3 N/A 292.9 RH2
Intel(R) Xeon(R) CPU E5-1680 v3 @ 3.20GHz 3.2 16 2133 24.2 276.1 N/A 300.3 RFR2
Intel(R) Xeon(R) CPU E5-1650 v3 @ 3.50GHz 3.5 128 2133 24.6 277.1 N/A 301.6 PTR
Intel(R) Core(TM) i7-3840QM CPU @ 2.80GHz 2.8 16 1867 28.2 276.7 N/A 304.9 RFR3
Intel(R) Core(TM) i7-4790 CPU @ 3.60GHz 3.6 32 1600 25.8 268.3 N/A 294.1 CCA
Intel(R) Xeon(R) CPU E5-1680 v3 @ 3.20GHz 3.2 16 2133 24.2 276.1 N/A 300.3 RFR2
Intel(R) Core(TM) i7-4810MQ CPU @ 2.80GHz 2.8 8 1600 26.9 284.1 N/A 311.1 EUK
Intel(R) Core(TM) i5-4570S CPU @ 2.90GHz 2.9 8 1600 27.7 283.7 N/A 311.4 LM2
Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz 3.5 32 2133 26.1 285.3 N/A 311.4 MG2
Intel(R) Xeon(R) CPU E5-2687W v3 @ 3.10GHz 3.1 16 2133 24.9 291.7 N/A 316.6 MBA
Intel(R) Xeon(R) CPU E5-1650 v2 @ 3.50GHz 3.5 32 1600 28.5 285.9 N/A 314.4 RH3
Intel(R) Core(TM) i5-3570K CPU @ 3.40GHz 3.4 8 1333 29.1 290.0 N/A 319.0 RFR4
Intel(R) Core(TM) i7-3770 CPU v3 @ 3.40GHz 3.4 16 1600 29.7 296.2 N/A 325.9 DDH2
Intel(R) Xeon(R) CPU E5-1650 0 @ 3.20GHz 3.2 16 1600 31.1 297.4 N/A 328.5 RH3
Intel(R) Core(TM) i7-3740QM CPU @ 2.70GHz 2.7 16 1600 31.7 301.5 N/A 333.2 MJS
Intel(R) Core(TM) i7-4800MQ CPU @ 2.70GHz 2.7 32 1600 29.1 308.1 N/A 337.2 JT1
Intel(R) Core(TM) i7-5820K CPU @ 3.30GHz 3.3 64 2133 29.2 317.1 N/A 346.3 EOG
Intel(R) Xeon(R) CPU E5-1620 v2 CPU @ 3.70GHz 3.7 16 1866 31.2 319.7 N/A 350.9 TBE
Intel(R) Core(TM) i7-5820K CPU @ 3.30GHz 3.3 64 2133 33.1 317.9 N/A 350.9 JAC
Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz 3.4 16 3401 35.6 320.2 N/A 355.8 UOV
Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz 3.4 16 1333 35.9 320.2 N/A 356.1 MMO
Intel(R) Xeon(R) CPU E5-1630 v3 @ 3.70GHz 3.7 32 2133 29.2 327.3 N/A 356.5 NCH
Intel(R) Xeon(R) CPU E5-2670 V3 @ 2.30GHz 2.3 96 2133 28.4 333.4 N/A 361.8 RK2
Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz 3.5 16 2133 30.2 338.4 N/A 368.6 RFR1
Intel(R) Xeon(R) CPU E3-1240 V2 @ 3.40GHz 3.4 32 1600 39.0 334.4 N/A 373.4 XEO
Intel(R) Xeon(R) CPU E5-1620 0 @ 3.60GHz 3.6 32 1600 44.2 335.8 N/A 380.0 DCO
Intel(R) Xeon(R) CPU E5-2690 v2 @ 3.00GHz 3.0 24 1866 34.4 353.9 N/A 388.4 RSU
Intel(R) Core(TM)2 Quad CPU Q9550 @ 2.80GHz 2.8 8 800 47.4 343.2 N/A 390.7 AJI
Intel(R) Core(TM) i5-4300U CPU @ 3.30GHz 1.9 8 1600 35.6 365.8 N/A 394.0 LP1
Intel(R) Xeon(R) W3565 CPU @ 3.20GHz 3.2 12 1333 37.9 356.1 N/A 401.4 LP2
2 x Intel(R) Xeon(R) X5680 CPU @ 3.33GHz 3.3 64 1333 40.5 368.9 N/A 409.4 WMD
Intel(R) Core(TM) i7-2670QM CPU @ 2.20GHz 2.2 16 1333 40.3 375.3 N/A 415.6 FFN
2 x Intel(R) Xeon(R) CPU E5-2643 V3 @ 3.40GHz 3.4 128 2133 40.5 377.1 N/A 418.1 XYG
Intel(R) Xeon(R) E5-2630 CPU @ 2.30GHz 2.3 64 1333 40.1 393.92 N/A 434.0 HUH
Intel(R) Xeon(R) E5-1603 0 CPU @ 2.80GHz 2.8 16 1600 40.9 395.8 N/A 436.7 LMD
2 x Intel(R) Xeon(R) CPU E5-2630 0 @ 2.80GHz 2.3 38 1333 41.3 401.1 N/A 444.4 RH5
Intel(R) Core(TM) i7-4800MQ CPU @ 2.70GHz 2.7 8 1600 39.5 420.7 N/A 460.2 HUK
Intel(R) Core(TM) i7-920 CPU @ 2.67GHz 2.67 12 1066 45.1 420.7 N/A 465.8 REJ
Intel(R) Xeon(R) CPU E5-2690 v3 @ 2.60GHz 2.60 9.33 2597 34.0 453.9 N/A 487.9 Microsoft Azure NC6 (Cloud)
Intel(R) Xeon(R) CPU W3505 @ 2.53GHz 2.53 4 1333 49.1 453.5 N/A 502.6 JT2
Intel(R) Xeon(R) CPU E5-2676 v3 @ 2.40GHz 2.4 8 37.6 492.9 N/A 530.5 DAG
Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz 2.6 60 NA 49.5 543.3 N/A 592.7 Amazon Web Services g2.8xlarge (Cloud)
Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz 2.6 15 NA 51.4 563.8 N/A 615.2 Amazon Web Services g2.2xlarge (Cloud)
Intel(R) Xeon(R) CPU E5-1620 0 @ 3.60GHz 3.6 16 1600 31.9 669.2 N/A 701.1 RFR5
Intel(R) Xeon(R) CPU X5650 @ 2.67GHz 2.67 4 64.3 669.2 N/A 733.5 ADU

HPC results

HPC long version results

Discussion

Preliminary CPU Results

The below comparison of the CPU results presents a few interesting points for discussion:

  • The runtimes for both models display similar variance as a percentage of the total time across hardware capabilities (36% and 39% relative standard deviation for the 30m and 15m models respectively).
  • The runtimes for both the 15m and 30m model show variance largely linked to CPU frequency but not totally. The results are dispersed, perhaps reflecting chip variability, chipset or other systems factors.
  • The difference in runtime between the fastest and slowest hardware (~440-500%) is much less than the difference in average runtime for the 30m and 15m models (1,110%). Thus, nothing can improve your model runtime like efficient model design!

CPUfrq5.png