SPCC: Testrun of Komodo 10 finished

Testrun of Komodo 10 finished. You find the result in my little Top-Bullet ratinglist and in the Stockfish-gamebase. A big step forward. Komodo 10 is now a little bit stronger than Stockfish 7 with bullet-speed. But Stockfish 160520 (which has nearly the same release-date as Komodo 10) is +25 Elo stronger than Komodo 10. Next testrun: Stockfish 160528. Result not before tuesday. Stay tuned.
 
Endless RoundRobin tournament (now playing with 30'+5'' instead of 15'+3'') updated. Now, 166 games are played with Stockfish 160520 against Komodo 10. Stockfish is +23 Elo stronger in this head-to-head competition with long thinking time and using 4 CPU-cores.

---

Stockfish testing
 
Playing conditions:
 
Hardware: i7-2630QM 2.0GHz Notebook, Windows 7 Home Premium 64bit, 4GB RAM
Fritzmark: singlecore: 3.97 / 1905 (all engines running on one core, only), average meganodes/s displayed by LittleBlitzerGUI: Houdini: 2.0 mn/s, Stockfish: 1.7 mn/s
Hash: 128MB per engine
GUI: LittleBlitzerGUI (draw at 120 moves, resign at 450cp (for 4 moves))
Tablebases: None
Openings: 10moves_SALC_500.epd (download the file at the "Download & Links"-section)
Ponder, Large Memory Pages & learning: Off
Thinking time: 70''+700ms per game/engine (average game-duration: 3.5 minutes)(standardized to the hardware-speed and the thinking time of the excellent [You must be registered and logged in to see this link.]). One 7000 games-testrun takes about 6 days (running on only 3 of 4 cores). The version-numbers of the Stockfish-development engines are the release-date, written backwards (year,month,day))(example: 141028 = October, 28, 2014), downloaded at [You must be registered and logged in to see this link.] I always use the latest version of one day, if more than one version per day is released. And I use the version "for modern computers". (At the moment, the compiles for modern windows machines on abrok.eu are around 8% slower, so I dont use them anymore)
 
Each Stockfish-version plays 1000 games against Komodo 10, Houdini 4, Gull 3, Fire 4, Critter 1.6a, Mars 3.41 and Equinox 3.3.
 
Latest update: 2016/06/01:  Komodo 10
 
Download the individual statistics [You must be registered and logged in to see this link.]
 
     Program                   Elo    +    -   Games   Score   Av.Op.  Draws
   1 Stockfish 160520 x64    : 3339    7    7  7000    74.9 %   3140   35.2 %
   2 Stockfish 160513 x64    : 3333    7    7  7000    74.2 %   3140   35.6 %
   3 Stockfish 160424 x64    : 3331    6    6  7000    74.0 %   3140   35.5 %
   4 Stockfish 160418 x64    : 3328    7    7  7000    73.7 %   3140   35.3 %
   5 Stockfish 160409 x64    : 3325    7    7  7000    73.4 %   3140   36.5 %
   6 Stockfish 160314 x64    : 3320    6    6  7000    72.9 %   3139   37.0 %
   7 Stockfish 160328 x64    : 3317    6    6  7000    72.5 %   3140   36.1 %
   8 Stockfish 160113 x64    : 3316    6    6  7000    72.5 %   3139   35.9 %
   9 Komodo 10 x64           : 3314    6    6  7000    71.7 %   3145   31.6 % (new)
  10 Stockfish 160302 x64    : 3313    6    6  7000    72.2 %   3139   36.4 %
  11 Stockfish 160129 x64    : 3313    6    6  7000    72.2 %   3139   36.7 %
  12 Stockfish 7 160102      : 3309    6    6  9000    67.3 %   3173   38.4 %
  13 Stockfish 151214 x64    : 3307    6    6  7000    71.5 %   3139   36.9 %
  14 Stockfish 151205 x64    : 3306    6    6  7000    71.4 %   3139   37.4 %
  15 Stockfish 151222 x64    : 3305    6    6  7000    71.3 %   3139   37.2 %
  16 Komodo 9.42 x64         : 3273    4    4 13000    55.7 %   3230   39.1 %
  17 Komodo 9.3 x64          : 3267    4    4 15000    55.0 %   3230   40.2 %
  18 Stockfish 6 150128      : 3253    6    6  9000    65.2 %   3141   39.8 %
  19 Komodo 8 x64            : 3205    6    6  7000    59.0 %   3137   39.0 %
  20 Houdini 4 x64           : 3180    3    3 25000    40.1 %   3256   35.8 %
  21 Gull 3 x64              : 3121    3    3 25000    32.4 %   3258   38.5 %
  22 Fire 4 x64              : 3112    3    3 25000    31.3 %   3258   39.0 %
  23 Critter 1.6a x64        : 3108    3    3 25000    30.8 %   3258   35.8 %
  24 Mars 3.35 x64           : 3095    5    5  7000    41.5 %   3153   41.9 %
  25 Equinox 3.3 x64         : 3092    3    3 25000    28.9 %   3259   36.5 %
  26 Mars 3.41 x64           : 3091    3    3 23000    27.6 %   3269   34.7 %
Below you find a diagram of the progress of Stockfish in my tests since the beginning of 2015. 
And below that diagram, the old diagram (May, 2013 - December, 2014).
 
You can save the diagrams (as a JPG-picture (in originial size)) on your PC with mouseclick (right button) and then choose "save image"...
The Elo-ratings of older Stockfish dev-versions in the Ordo-calculation can be a little different to the Elo-"dots" in the diagram, because the results/games of new Stockfish dev-versions - when getting part of the Ordo-calculation - can change the Elo-ratings of the opponent engines and that can change the Elo-ratings of older Stockfish dev-versions (in the Ordo-calculation / ratinglist, but not in the diagram, where all Elo-"dots" are the rating of one Stockfish dev-version at the moment, when the testrun of that Stockfish dev-version was finished).




Stockfish