Testrun of Stockfish 150105 finished. A real big step forward (+14 Elo to Stockfish 141221). It seems, that the last nullmove-tunig-patch is very good against other engines - much better than in Framework-Selftests.
Stockfish testing Playing conditions: Hardware: i7-2630QM 2.0GHz Notebook, Windows 7 Home Premium 64bit, 4GB RAM
Fritzmark: singlecore: 3.97 / 1905 (all engines running on one core, only), average meganodes/s displayed by LittleBlitzerGUI: Houdini: 2.0 mn/s, Stockfish: 1.7 mn/s
Hash: 128MB per engine
GUI: LittleBlitzerGUI (draw at 120 moves, resign at 450cp (for 4 moves))
Tablebases: None
Openings: 10moves_SALC_500.epd (download the file at the "Download & Links"-section)
Ponder, Large Memory Pages & learning: Off
Thinking time:
70''+700ms per game/engine (average game-duration: 3.5 minutes)(standardized to the hardware-speed and the thinking time of the excellent
[You must be registered and logged in to see this link.]). One 5000 games-testrun takes 96 hours (=4 days) (running on only 3 of 4 cores). The version-numbers of the Stockfish-development engines are the release-date, written backwards (year,month,day))(example: 141028 = October, 28, 2014), downloaded at
[You must be registered and logged in to see this link.]. I always use the latest version of one day, if more than one version per day is released. And I use the version "for modern computers". Each Stockfish-version plays 1000 games against Komodo 8, Houdini 4, Gull 3, Fire 4, Equinox 3.3. Latest update: 2015/01/10 (Stockfish 150105)Current testrun: Mars 3.35 for my Top-Bullet-ratinglist Download the individual statistics [You must be registered and logged in to see this link.] Program Elo + - Games Score Av.Op. Draws
1 Stockfish 150105 x64 : 3234 7 7 5000 64.2 % 3129 39.6 %
2 Stockfish 141221 x64 : 3220 6 6 5000 62.5 % 3129 40.1 %
3 Stockfish 141112 x64 : 3219 6 6 5000 62.3 % 3129 40.2 %
4 Komodo 8 x64 : 3187 5 5 7000 53.2 % 3162 39.9 %
5 Houdini 4 x64 : 3177 6 6 7000 51.9 % 3163 38.0 %
6 Gull 3 x64 : 3107 5 5 7000 41.1 % 3173 44.1 %
7 Fire 4 x64 : 3097 5 5 7000 39.6 % 3174 44.1 %
8 Equinox 3.3 x64 : 3076 5 5 7000 36.3 % 3177 40.4 %
Below you find the old ORDO-calculation from Stockfish 140928 to Stockfish 141221 (with the opponents: Komodo 8, Houdini 4, Gull 3, Fire 3 and Rybka 4.1) Program Elo + - Games Score Av.Op. Draws
1 Stockfish 141221 x64 : 3220 7 7 5000 64.7 % 3111 38.3 %
2 Stockfish 141214 x64 : 3219 7 7 5000 64.5 % 3111 38.4 %
3 Stockfish 141117 x64 : 3218 7 7 5000 64.3 % 3111 38.3 %
4 Stockfish 141109 x64 : 3217 7 7 5000 64.3 % 3111 37.4 %
5 Stockfish 141130 x64 : 3215 7 7 5000 64.0 % 3111 38.1 %
6 Stockfish 141102 x64 : 3208 7 7 5000 63.0 % 3111 39.4 %
7 Stockfish 141012 x64 : 3205 7 7 5000 62.7 % 3111 37.7 %
8 Stockfish 141024 x64 : 3205 7 7 5000 62.6 % 3111 38.1 %
9 Stockfish 140928 x64 : 3194 7 7 5000 61.5 % 3111 39.3 %
Stockfish
5 Elo-result: 3173 (official version on stockfishchess.com (2014/05/31))
Below you find a diagram of the progress of Stockfish in my tests. Red dots: Elo of Stockfish in the (no longer existing) LS-ratinglist based on at least 10000 games (with 45''+500ms thinking time and 64 MB Hash). Blue dots: Elo of Stockfish in my current Stockfish-testruns (adjusted to the LS-Elo-ratings (with the Stockfish DD-rating)), based on 5000 games (with 70''+700ms thinking time and 128 MB Hash). You can save the diagram (as a JPG-picture (in originial size)) on your PC with mouseclick (right button) and then choose "save image"... 
