Stockfish testing[You must be registered and logged in to see this link.]
Playing conditions: Hardware: i7-2630QM 2.0GHz Notebook, Windows 10 64bit, 4GB RAM
Fritzmark: singlecore: 3.97 / 1905 (all engines running on one core, only), average meganodes/s displayed by LittleBlitzerGUI: Houdini: 2.0 mn/s, Stockfish: 1.7 mn/s
Hash: 128MB per engine
GUI: LittleBlitzerGUI (draw at 120 moves, resign at 450cp (for 4 moves))
Tablebases: None
Openings: 10moves_SALC_500.epd (download the file at the "Download & Links"-section)
Ponder, Large Memory Pages & learning: Off
Thinking time:
70''+700ms per game/engine (average game-duration: 3.5 minutes)(standardized to the hardware-speed and the thinking time of the excellent
[You must be registered and logged in to see this link.]). One 7000 games-testrun takes about 6 days (running on only 3 of 4 cores). The version-numbers of the Stockfish-development engines are the release-date, written backwards (year,month,day))(example: 141028 = October, 28, 2014), downloaded at
[You must be registered and logged in to see this link.] I a
lways use the latest version of one day, if more than one version per day is released. And I use the version "for modern computers". (At the moment, the compiles for modern windows machines on abrok.eu are around 8% slower, so I dont use them anymore) Each Stockfish-version plays 1000 games against Komodo 10.1, Houdini 4, Gull 3, Fire 4, Critter 1.6a, Mars 3.41 and Equinox 3.3. Latest update: 2016/10/31: Stockfish 161025 Download the individual statistics [You must be registered and logged in to see this link.] Program Elo + - Games Score Av.Op. Draws
1 BrainFish 161009 numa : 3458 8 8 7000 85.0 % 3145 24.7 %
2 BrainFish 160808 x64 : 3443 8 8 7000 83.9 % 3145 26.5 %
3 BrainFish 160712 x64 : 3439 8 8 7000 83.6 % 3144 26.7 %
4 BrainFish 160610 x64 : 3430 8 8 7000 82.9 % 3144 27.4 %
5 asmFish 161004 x64 : 3412 7 7 7000 81.5 % 3145 29.2 %
6 asmFish 160830 x64 : 3395 7 7 7000 80.0 % 3145 29.6 %
7 Stockfish 161025 x64 : 3392 7 7 7000 79.6 % 3145 31.1 % (new)
8 asmFish 160726 x64 : 3383 7 7 7000 78.9 % 3145 31.6 %
9 Stockfish 160929 x64 : 3382 7 7 7000 78.8 % 3145 32.0 %
10 Stockfish 161009 x64 : 3382 7 7 7000 78.7 % 3145 31.7 %
11 Stockfish 160909 x64 : 3380 7 7 7000 78.6 % 3145 30.7 %
12 Stockfish 160830 x64 : 3378 7 7 7000 78.4 % 3145 32.0 %
13 asmFish 160704 x64 : 3375 7 7 7000 78.1 % 3144 31.5 %
14 Stockfish 160824 x64 : 3366 7 7 7000 77.2 % 3145 32.1 %
15 Stockfish 160802 x64 : 3366 7 7 7000 77.2 % 3145 32.9 %
16 Stockfish 160819 x64 : 3364 7 7 7000 77.1 % 3145 31.8 %
17 asmFish 160616 x64 : 3361 7 7 7000 76.9 % 3144 33.1 %
18 Stockfish 160724 x64 : 3361 7 7 7000 76.7 % 3145 32.9 %
19 Stockfish 160708 x64 : 3360 7 7 7000 76.8 % 3144 32.9 %
20 Stockfish 160626 x64 : 3352 7 7 7000 75.9 % 3144 33.3 %
21 Stockfish 160610 x64 : 3347 7 7 7000 75.4 % 3144 34.5 %
22 Stockfish 160603 x64 : 3343 7 7 7000 75.0 % 3144 34.9 %
23 Stockfish 160528 x64 : 3339 7 7 7000 74.6 % 3144 34.5 %
24 Stockfish 160520 x64 : 3338 7 7 7000 74.9 % 3141 35.2 %
25 Stockfish 160513 x64 : 3332 7 7 7000 74.2 % 3141 35.6 %
26 Stockfish 7 160102 : 3306 5 5 10000 65.6 % 3186 39.1 %
27 Komodo 10.1 x64 : 3301 4 4 21000 48.5 % 3309 40.0 %
28 Komodo 10 x64 : 3298 4 4 16000 53.0 % 3273 39.1 %
29 Komodo 9.42 x64 : 3277 6 6 9000 61.8 % 3188 36.5 %
30 Komodo 9.3 x64 : 3276 6 6 7000 67.3 % 3146 34.5 %
31 Houdini 4 x64 : 3172 3 3 35000 30.2 % 3328 32.0 %
32 Gull 3 x64 : 3124 3 3 35000 24.9 % 3329 33.7 %
33 Fire 4 x64 : 3114 3 3 35000 23.9 % 3330 33.2 %
34 Critter 1.6a x64 : 3110 3 3 35000 23.5 % 3330 30.7 %
35 Equinox 3.3 x64 : 3097 3 3 35000 22.2 % 3330 31.1 %
36 Mars 3.41 x64 : 3095 3 3 35000 22.0 % 3330 29.9 %
Below you find a diagram of the progress of Stockfish in my tests since the beginning of 2015. And below that diagram, the old diagram (May, 2013 - December, 2014). You can save the diagrams (as a JPG-picture (in originial size)) on your PC with mouseclick (right button) and then choose "save image"...The Elo-ratings of older Stockfish dev-versions in the Ordo-calculation can be a little different to the Elo-"dots" in the diagram, because the results/games of new Stockfish dev-versions - when getting part of the Ordo-calculation - can change the Elo-ratings of the opponent engines and that can change the Elo-ratings of older Stockfish dev-versions (in the Ordo-calculation / ratinglist, but not in the diagram, where all Elo-"dots" are the rating of one Stockfish dev-version at the moment, when the testrun of that Stockfish dev-version was finished).