The release of Stockfish 5 well deserved that I double test it: 960 games instead of my usual 480 games test.
i7 980 3.33 Ghz.
6 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014c Sedat –Limit 5 moves-
No tablebases. No RTB used.
Large Pages allowed.
Hash 512
Relative Speed: 30.42
Knodes per second: 14602
Time control= 4+0
Stockfish 5 64 SSE4.2x6 - Houdini 4 x64_st_X6_CT0 22.0 - 18.0 +10/=24/-6 55.00%
Stockfish 5 64 SSE4.2x6 - Komodo 7 64-bitx6_NOB 22.5 - 17.5 +13/=19/-8 56.25%
Stockfish 5 64 SSE4.2x6 - Gull 3 x64 XP 25.5 - 14.5 +15/=21/-4 63.75%
Stockfish 5 64 SSE4.2x6 - Critter 1.6a 64-bitX6_NOB_ok 27.5 - 12.5 +15/=25/-0 68.75%
Stockfish 5 64 SSE4.2x6 - SF 270414IPx 64 SSE4.2x6 20.0 - 20.0 +4/=32/-4 50.00%
Stockfish 5 64 SSE4.2x6 - StockfishRW 190514 SSE4.2_ 21.0 - 19.0 +4/=34/-2 52.50%
Time Control= 2+2
Stockfish 5 64 SSE4.2x6 - Houdini 4 x64_st_X6_CT0 21.0 - 19.0 +10/=22/-8 52.50%
Stockfish 5 64 SSE4.2x6 - Komodo 7 64-bitx6_NOB 24.0 - 16.0 +12/=24/-4 60.00%
Stockfish 5 64 SSE4.2x6 - Gull 3 x64 XP 24.5 - 15.5 +15/=19/-6 61.25%
Stockfish 5 64 SSE4.2x6 - Critter 1.6a 64-bitX6_NOB_ok 27.0 - 13.0 +18/=18/-4 67.50%
Stockfish 5 64 SSE4.2x6 - SF 270414IPx 64 SSE4.2x6 21.0 - 19.0 +7/=28/-5 52.50%
Stockfish 5 64 SSE4.2x6 - StockfishRW 190514 SSE4.2_ 20.0 - 20.0 +3/=34/-3 50.00%
Score using 6 Cores= 276.0 – 204.0 = 57.50%
480 Games =
http://www.mediafire.com/view/7fzrej419lyqe54/201406_Stockfish5_X6_480Games.pgn i7 975 3.33 Ghz.
4 real cores
Ponder: Off.
GUI: Fritz 12
Book: Perfect 2014c Sedat – Limit 5 moves -
No tablebases. No RTB used.
Large Pages allowed
Hash 256
Relative Speed: 20.62
Knodes per second: 9.899
Time Control = 4+0
Stockfish 5 64 SSE4.2x4 - Houdini 4 Pro x64_Ct0_OK 20.0 - 20.0 +9/=22/-9 50.00%
Stockfish 5 64 SSE4.2x4 - Komodo 7 64-bitx4_NOB_OK 25.0 - 15.0 +15/=20/-5 62.50%
Stockfish 5 64 SSE4.2x4 - Gull 3 x64 XP 24.0 - 16.0 +11/=26/-3 60.00%
Stockfish 5 64 SSE4.2x4 - Critter 1.6a 64-bit_NOB 25.5 - 14.5 +15/=21/-4 63.75%
Stockfish 5 64 SSE4.2x4 - SF 270414IPx 64 SSE4.2_ 20.5 - 19.5 +3/=35/-2 51.25%
Stockfish 5 64 SSE4.2x4 - StockfishRW 190514 SSE4.2_ 20.0 - 20.0 +5/=30/-5 50.00%
Time Control= 2+2
Stockfish 5 64 SSE4.2x4 - Houdini 4 Pro x64_Ct0_OK 22.0 - 18.0 +11/=22/-7 55.00%
Stockfish 5 64 SSE4.2x4 - Komodo 7 64-bitx4_NOB_OK 23.5 - 16.5 +10/=27/-3 58.75%
Stockfish 5 64 SSE4.2x4 - Gull 3 x64 XP 25.0 - 15.0 +14/=22/-4 62.50%
Stockfish 5 64 SSE4.2x4 - Critter 1.6a 64-bit_NOB 28.0 - 12.0 +18/=20/-2 70.00%
Stockfish 5 64 SSE4.2x4 - SF 270414IPx 64LP 23.5 - 16.5 +10/=27/-3 58.75%
Stockfish 5 64 SSE4.2x4 - StockfishRW 190514 SSE4.2_ 21.0 - 19.0 +6/=30/-4 52.50%
Score using 4 Cores= 278.0 – 202.0= 57.92%
480 games=
http://www.mediafire.com/view/bayw2wjf1bzf1yw/20140602_Stockfish_5_480games.pgn Segmenting by Time Control:
Fixed TC = 273.5 – 206.5 = 56.98%
Incremental TC= 280.5 – 199.5 = 58.44%
Global Score= 554.0 – 406.0 = 57.71%
Against : Houdini 4.0 St. Ct0 (3227)= 53.12% Komodo 7 (3206)= 59.37% Gull 3.0 XP (3199)= 61.87% Critter 1.6a (3104) = 67.50% SF 270414IPx 64 SSE4.2 (3281)= 53.12% StockfishRW 190514 SSE4.2 (3289)= 51.25%
Average Estimated Elo Opponents = 3218
Estimated Elo Performance = 3272 Error bars: +/- 16
Stockfish 5 has performed in this test 17 Elo below the Top Scorer Stockfish RW 190514, although it has won their one to one match.
In relation to other engines, Stockfish 5 has performed:
- 45 Elo points better than Houdini 4
- 66 Elo points better than Komodo 7
- 73 Elo points better than Gull 3.0 XP and
- 168 Elo points better than Critter
This is an extremely strong engine. Well done, Stockfish Team!.
Regards from Barcelona.
Tom Casanovas
