Latest Website-News (2016/07/05): Testrun of Stockfish 160626 finished. Another step forward...Endless RoundRobin tournament is suspended - I need the PC for some private testing.Next testrun: asmFish 160704. Result not before Monday.Stay tuned...
Stockfish testing Playing conditions: Hardware: i7-2630QM 2.0GHz Notebook, Windows 10 64bit, 4GB RAM
Fritzmark: singlecore: 3.97 / 1905 (all engines running on one core, only), average meganodes/s displayed by LittleBlitzerGUI: Houdini: 2.0 mn/s, Stockfish: 1.7 mn/s
Hash: 128MB per engine
GUI: LittleBlitzerGUI (draw at 120 moves, resign at 450cp (for 4 moves))
Tablebases: None
Openings: 10moves_SALC_500.epd (download the file at the "Download & Links"-section)
Ponder, Large Memory Pages & learning: Off
Thinking time:
70''+700ms per game/engine (average game-duration: 3.5 minutes)(standardized to the hardware-speed and the thinking time of the excellent
[You must be registered and logged in to see this link.]). One 7000 games-testrun takes about 6 days (running on only 3 of 4 cores). The version-numbers of the Stockfish-development engines are the release-date, written backwards (year,month,day))(example: 141028 = October, 28, 2014), downloaded at
[You must be registered and logged in to see this link.] I a
lways use the latest version of one day, if more than one version per day is released. And I use the version "for modern computers". (At the moment, the compiles for modern windows machines on abrok.eu are around 8% slower, so I dont use them anymore) Each Stockfish-version plays 1000 games against Komodo 10, Houdini 4, Gull 3, Fire 4, Critter 1.6a, Mars 3.41 and Equinox 3.3. Latest update: 2016/07/05: Stockfish 160626 Download the individual statistics [You must be registered and logged in to see this link.] Program Elo + - Games Score Av.Op. Draws
1 asmFish 160616 x64
: 3364 7 7 7000 76.9 % 3144 33.1 %
2 Stockfish 160626 x64 : 3354 7 7 7000 75.9 % 3144 33.3 % (new)
3 Stockfish 160610 x64 : 3349 7 7 7000 75.4 % 3144 34.5 %
4 Stockfish 160603 x64 : 3345 7 7 7000 75.0 % 3144 34.9 %
5 Stockfish 160528 x64 : 3341 7 7 7000 74.6 % 3144 34.5 %
6 Stockfish 160520 x64 : 3339 6 6 7000 74.9 % 3140 35.2 %
7 Stockfish 160513 x64 : 3333 7 7 7000 74.2 % 3140 35.6 %
8 Stockfish 160424 x64 : 3331 7 7 7000 74.0 % 3140 35.5 %
9 Stockfish 160418 x64 : 3328 7 7 7000 73.7 % 3140 35.3 %
10 Stockfish 160409 x64 : 3325 7 7 7000 73.4 % 3140 36.5 %
11 Stockfish 160314 x64 : 3319 7 7 7000 72.9 % 3139 37.0 %
12 Stockfish 160328 x64 : 3317 6 6 7000 72.5 % 3140 36.1 %
13 Stockfish 160113 x64 : 3315 7 7 7000 72.5 % 3139 35.9 %
14 Stockfish 160302 x64 : 3313 7 7 7000 72.2 % 3139 36.4 %
15 Stockfish 160129 x64 : 3313 7 7 7000 72.2 % 3139 36.7 %
16 Stockfish 7 160102 : 3308 6 6 9000 67.3 % 3172 38.4 %
17 Stockfish 151214 x64 : 3306 6 6 7000 71.5 % 3139 36.9 %
18 Stockfish 151205 x64 : 3306 6 6 7000 71.4 % 3139 37.4 %
19 Stockfish 151222 x64 : 3305 6 6 7000 71.3 % 3139 37.2 %
20 Komodo 10 x64 : 3303 5 5 12000 59.3 % 3230 38.0 %
21 Komodo 9.42 x64 : 3273 5 5 13000 55.7 % 3229 39.1 %
22 Komodo 9.3 x64 : 3267 4 4 15000 55.0 % 3230 40.2 %
23 Stockfish 6 150128 : 3253 5 5 9000 65.2 % 3141 39.8 %
24 Komodo 8 x64 : 3204 6 6 7000 59.0 % 3137 39.0 %
25 Houdini 4 x64 : 3176 3 3 30000 37.6 % 3271 35.2 %
26 Gull 3 x64 : 3122 3 3 30000 30.8 % 3273 37.8 %
27 Fire 4 x64 : 3112 3 3 30000 29.6 % 3273 38.0 %
28 Critter 1.6a x64 : 3109 3 3 30000 29.2 % 3273 35.0 %
29 Mars 3.35 x64 : 3094 6 6 7000 41.5 % 3153 41.9 %
30 Equinox 3.3 x64 : 3093 3 3 30000 27.4 % 3274 35.6 %
31 Mars 3.41 x64 : 3092 3 3 28000 26.2 % 3283 33.9 %
Below you find a diagram of the progress of Stockfish in my tests since the beginning of 2015. And below that diagram, the old diagram (May, 2013 - December, 2014). You can save the diagrams (as a JPG-picture (in originial size)) on your PC with mouseclick (right button) and then choose "save image"...The Elo-ratings of older Stockfish dev-versions in the Ordo-calculation can be a little different to the Elo-"dots" in the diagram, because the results/games of new Stockfish dev-versions - when getting part of the Ordo-calculation - can change the Elo-ratings of the opponent engines and that can change the Elo-ratings of older Stockfish dev-versions (in the Ordo-calculation / ratinglist, but not in the diagram, where all Elo-"dots" are the rating of one Stockfish dev-version at the moment, when the testrun of that Stockfish dev-version was finished).