Testrun of Komodo 10.2 by Stefan Pohl ( ppssstt !!!!! it finished in 26th place )

Latest Website-News (2016/11/06): Testrun of Komodo 10.2 for my Stockfish-gamebase finished. Next testrun: Stockfish 8 (modern-compile from the official website ([You must be registered and logged in to see this link.] Result nor before Saturday.
 
Stay tuned.

---

Stockfish testing
 
Playing conditions:
 
Hardware: i7-2630QM 2.0GHz Notebook, Windows 10 64bit, 4GB RAM
Fritzmark: singlecore: 3.97 / 1905 (all engines running on one core, only), average meganodes/s displayed by LittleBlitzerGUI: Houdini: 2.0 mn/s, Stockfish: 1.7 mn/s
Hash: 128MB per engine
GUI: LittleBlitzerGUI (draw at 120 moves, resign at 450cp (for 4 moves))
Tablebases: None
Openings: 10moves_SALC_500.epd (download the file at the "Download & Links"-section)
Ponder, Large Memory Pages & learning: Off
Thinking time: 70''+700ms per game/engine (average game-duration: 3.5 minutes)(standardized to the hardware-speed and the thinking time of the excellent [You must be registered and logged in to see this link.]). One 7000 games-testrun takes about 6 days (running on only 3 of 4 cores). The version-numbers of the Stockfish-development engines are the release-date, written backwards (year,month,day))(example: 141028 = October, 28, 2014), downloaded at [You must be registered and logged in to see this link.] I always use the latest version of one day, if more than one version per day is released. And I use the version "for modern computers". (At the moment, the compiles for modern windows machines on abrok.eu are around 8% slower, so I dont use them anymore)
 
Each Stockfish-version plays 1000 games against Komodo 10.2, Houdini 4, Gull 3, Fire 4, Critter 1.6a, Mars 3.41 and Equinox 3.3.
 
Latest update: 2016/11/06: Komodo 10.2
 
Download the individual statistics [You must be registered and logged in to see this link.]
 
     Program                    Elo    +    -   Games   Score   Av.Op.  Draws
   1 BrainFish 161009 numa    : 3456    8    8  7000    85.0 %   3143   24.7 %
   2 BrainFish 160808 x64     : 3441    8    8  7000    83.9 %   3143   26.5 %
   3 BrainFish 160712 x64     : 3437    8    8  7000    83.6 %   3142   26.7 %
   4 BrainFish 160610 x64     : 3428    8    8  7000    82.9 %   3142   27.4 %
   5 asmFish 161004 x64       : 3410    8    8  7000    81.5 %   3143   29.2 %
   6 asmFish 160830 x64       : 3393    7    7  7000    80.0 %   3143   29.6 %
   7 Stockfish 161025 x64     : 3389    7    7  7000    79.6 %   3143   31.1 %
   8 asmFish 160726 x64       : 3381    7    7  7000    78.9 %   3143   31.6 %
   9 Stockfish 160929 x64     : 3380    7    7  7000    78.8 %   3143   32.0 %
  10 Stockfish 161009 x64     : 3379    7    7  7000    78.7 %   3143   31.7 %
  11 Stockfish 160909 x64     : 3378    7    7  7000    78.6 %   3143   30.7 %
  12 Stockfish 160830 x64     : 3376    7    7  7000    78.4 %   3143   32.0 %
  13 asmFish 160704 x64       : 3372    7    7  7000    78.1 %   3142   31.5 %
  14 Stockfish 160802 x64     : 3364    7    7  7000    77.2 %   3143   32.9 %
  15 Stockfish 160824 x64     : 3364    7    7  7000    77.2 %   3143   32.1 %
  16 Stockfish 160819 x64     : 3362    7    7  7000    77.1 %   3143   31.8 %
  17 asmFish 160616 x64       : 3359    7    7  7000    76.9 %   3142   33.1 %
  18 Stockfish 160724 x64     : 3358    7    7  7000    76.7 %   3143   32.9 %
  19 Stockfish 160708 x64     : 3358    7    7  7000    76.8 %   3142   32.9 %
  20 Stockfish 160626 x64     : 3350    7    7  7000    75.9 %   3142   33.3 %
  21 Stockfish 160610 x64     : 3344    7    7  7000    75.4 %   3142   34.5 %
  22 Stockfish 160603 x64     : 3341    6    6  7000    75.0 %   3142   34.9 %
  23 Stockfish 160528 x64     : 3337    7    7  7000    74.6 %   3142   34.5 %
  24 Stockfish 160520 x64     : 3336    7    7  7000    74.9 %   3139   35.2 %
  25 Stockfish 160513 x64     : 3329    7    7  7000    74.2 %   3139   35.6 %
  26 Komodo 10.2 x64          : 3327    7    7  7000    73.4 %   3144   31.9 % (new)
  27 Stockfish 7 160102       : 3306    5    5 11000    64.2 %   3197   39.8 %
  28 Komodo 10.1 x64          : 3299    4    4 21000    48.5 %   3307   40.0 %
  29 Komodo 10 x64            : 3296    4    4 16000    53.0 %   3271   39.1 %
  30 Komodo 9.42 x64          : 3275    6    6  9000    61.8 %   3186   36.5 %
  31 Komodo 9.3 x64           : 3274    7    7  7000    67.3 %   3144   34.5 %
  32 Houdini 4 x64            : 3170    3    3 36000    30.1 %   3326   32.0 %
  33 Gull 3 x64               : 3122    3    3 36000    24.9 %   3327   33.6 %
  34 Fire 4 x64               : 3112    3    3 36000    23.8 %   3327   33.1 %
  35 Critter 1.6a x64         : 3108    3    3 36000    23.5 %   3328   30.6 %
  36 Equinox 3.3 x64          : 3095    3    3 36000    22.1 %   3328   31.1 %
  37 Mars 3.41 x64            : 3092    3    3 36000    21.9 %   3328   29.9 %
Below you find a diagram of the progress of Stockfish in my tests since the end of 2016. 
And below that diagram, the older diagrams.
 
You can save the diagrams (as a JPG-picture (in originial size)) on your PC with mouseclick (right button) and then choose "save image"...
The Elo-ratings of older Stockfish dev-versions in the Ordo-calculation can be a little different to the Elo-"dots" in the diagram, because the results/games of new Stockfish dev-versions - when getting part of the Ordo-calculation - can change the Elo-ratings of the opponent engines and that can change the Elo-ratings of older Stockfish dev-versions (in the Ordo-calculation / ratinglist, but not in the diagram, where all Elo-"dots" are the rating of one Stockfish dev-version at the moment, when the testrun of that Stockfish dev-version was finished).

###############################################

26th      place,,,25  places    below  FREE engines   OY VEY  a bargin at  $59.97  

Thanks for the info!
And good luck for the sales Komodo.