Latest Website-News (2015/12/04): Testrun of Komodo 9.3 finished. +20 Elo to Komodo 9.2 in my Top-Bullet ratinglist. +24 Elo in the Stockfish-testrun gamebase.
Endless RoundRobin tournament updated. Stockfish 151102 played 232 games against Komodo 9.3 and is +13 Elo stronger in this head-to-head competition (15'+3'', running on 4 cores/threads).
Next Stockfish-testrun will start, when the second Threats-weights patch (by mc) is applied.
Stay tuned.
Stockfish testing
Playing conditions:
Hardware: i7-2630QM 2.0GHz Notebook, Windows 7 Home Premium 64bit, 4GB RAM
Fritzmark: singlecore: 3.97 / 1905 (all engines running on one core, only), average meganodes/s displayed by LittleBlitzerGUI: Houdini: 2.0 mn/s, Stockfish: 1.7 mn/s
Hash: 128MB per engine
GUI: LittleBlitzerGUI (draw at 120 moves, resign at 450cp (for 4 moves))
Tablebases: None
Openings: 10moves_SALC_500.epd (download the file at the "Download & Links"-section)
Ponder, Large Memory Pages & learning: Off
Thinking time: 70''+700ms per game/engine (average game-duration: 3.5 minutes)(standardized to the hardware-speed and the thinking time of the excellent FGRL Bullet-ratinglist). One 7000 games-testrun takes about 6 days (running on only 3 of 4 cores). The version-numbers of the Stockfish-development engines are the release-date, written backwards (year,month,day))(example: 141028 = October, 28, 2014), downloaded at
[You must be registered and logged in to see this link.] I always use the latest version of one day, if more than one version per day is released. And I use the version "for modern computers".
Each Stockfish-version plays 1000 games against Komodo 9.3, Houdini 4, Gull 3, Fire 4, Critter 1.6a, Mars 3.41 and Equinox 3.3.
Latest update: 2015/12/04: Komodo 9.3
Download the individual statistics here
Program Elo + - Games Score Av.Op. Draws
1 Stockfish 151103 x64 : 3299 6 6 7000 71.5 % 3136 36.9 %
2 Stockfish 151025 x64 : 3299 6 6 7000 71.5 % 3136 36.1 %
3 Stockfish 151115 x64 : 3297 6 6 7000 71.3 % 3136 37.8 %
4 Stockfish 151015 x64 : 3293 6 6 7000 70.8 % 3136 36.5 %
5 Stockfish 150910 x64 : 3282 6 6 7000 69.7 % 3137 37.5 %
6 Stockfish 151003 x64 : 3280 6 6 7000 69.4 % 3137 37.6 %
7 Stockfish 150730 x64 : 3279 6 6 7000 69.2 % 3137 38.2 %
8 Stockfish 150817 x64 : 3278 6 6 8000 67.3 % 3151 39.0 %
9 Stockfish 150810 x64 : 3275 6 6 7000 68.7 % 3137 38.8 %
10 Komodo 9.3 x64 : 3274 6 6 7000 68.4 % 3137 34.2 % (new)
11 Stockfish 150604 x64 : 3272 6 6 8000 66.6 % 3150 40.5 %
12 Stockfish 150510 x64 : 3270 6 6 7000 68.4 % 3136 38.1 %
13 Stockfish 150627 x64 : 3269 6 6 7000 68.0 % 3137 38.4 %
14 Stockfish 150716 x64 : 3268 6 6 7000 67.9 % 3137 39.2 %
15 Stockfish 150503 x64 : 3264 6 6 7000 67.6 % 3136 37.7 %
16 Stockfish 150521 x64 : 3262 6 6 7000 67.4 % 3136 40.1 %
17 Stockfish 150410 x64 : 3262 6 6 7000 68.4 % 3129 38.1 %
18 Komodo 9.1 x64 : 3254 5 5 12000 57.6 % 3195 42.7 %
19 Stockfish 150329 x64 : 3253 6 6 7000 67.3 % 3129 38.9 %
20 Stockfish 150314 x64 : 3251 6 6 7000 67.0 % 3129 39.1 %
21 Stockfish 6 150128 : 3250 5 5 9000 65.2 % 3141 39.8 %
22 Stockfish 150320 x64 : 3250 6 6 7000 67.0 % 3129 38.5 %
23 Komodo 9.2 x64 : 3250 4 4 14000 56.2 % 3202 38.4 %
24 Stockfish 150307 x64 : 3248 6 6 7000 66.7 % 3129 39.1 %
25 Stockfish 150203 x64 : 3247 6 6 7000 66.6 % 3129 38.6 %
26 Stockfish 150220 x64 : 3247 6 6 7000 66.6 % 3129 39.2 %
27 Stockfish 150208 x64 : 3246 6 6 7000 66.4 % 3129 39.1 %
28 Komodo 9 x64 : 3243 5 5 10000 58.7 % 3177 40.2 %
29 Stockfish 150105 x64 : 3241 6 6 7000 65.8 % 3129 39.3 %
30 Stockfish 141221 x64 : 3230 6 6 7000 64.4 % 3129 39.7 %
31 Komodo 8 x64 : 3198 4 4 17000 48.7 % 3202 40.5 %
32 Houdini 4 x64 : 3180 3 3 37000 42.4 % 3236 37.6 %
33 Gull 3 x64 : 3121 2 2 37000 33.8 % 3238 39.8 %
34 Fire 4 x64 : 3114 3 3 37000 32.9 % 3238 39.4 %
35 Critter 1.6a x64 : 3107 3 3 37000 32.1 % 3238 37.5 %
36 Equinox 3.3 x64 : 3094 3 3 37000 30.5 % 3239 38.3 %
37 Mars 3.35 x64 : 3090 3 3 31000 30.4 % 3235 37.0 %
38 Mars 3.41 x64 : 3090 4 4 12000 33.7 % 3215 37.9 %
Below you find a diagram of the progress of Stockfish in my tests since the beginning of 2015.
And below that diagram, the old diagram (May, 2013 - December, 2014).
You can save the diagrams (as a JPG-picture (in originial size)) on your PC with mouseclick (right button) and then choose "save image"...
The Elo-ratings of older Stockfish dev-versions in the Ordo-calculation can be a little different to the Elo-"dots" in the diagram, because the results/games of new Stockfish dev-versions - when getting part of the Ordo-calculation - can change the Elo-ratings of the opponent engines and that can change the Elo-ratings of older Stockfish dev-versions (in the Ordo-calculation / ratinglist, but not in the diagram, where all Elo-"dots" are the rating of one Stockfish dev-version at the moment, when the testrun of that Stockfish dev-version was finished).
Below you find a diagram of the progress of Stockfish in my tests since the beginning of 2015.
And below that diagram, the old diagram (May, 2013 - December, 2014).
You can save the diagrams (as a JPG-picture (in originial size)) on your PC with mouseclick (right button) and then choose "save image"...
The Elo-ratings of older Stockfish dev-versions in the Ordo-calculation can be a little different to the Elo-"dots" in the diagram, because the results/games of new Stockfish dev-versions - when getting part of the Ordo-calculation - can change the Elo-ratings of the opponent engines and that can change the Elo-ratings of older Stockfish dev-versions (in the Ordo-calculation / ratinglist, but not in the diagram, where all Elo-"dots" are the rating of one Stockfish dev-version at the moment, when the testrun of that Stockfish dev-version was finished).
Below you find a diagram of the progress of Stockfish in my tests since the beginning of 2015. And below that diagram, the old diagram (May, 2013 - December, 2014). [You must be registered and logged in to see this link.]
