st peter V.I.P.MEMBER
Posts : 733 Reputation : 1286 Join date : 2011-06-06 Location : Earth
| Subject: Stockfish Testing By Stefan Pohl Wed Jun 01, 2016 6:03 pm | |
| Endless RoundRobin-Tournament By Stefan Pohl
Playing conditions: Hardware: i7-2630QM 2.0GHz Notebook, Windows 7 Home Premium 64bit, 4GB RAM Fritzmark: 4 cores: 16.25 / 7798 (all engines running on all 4 cores, when thinking) Hash: 1 GB per engine GUI: Shredder Classic GUI (no draw, no resign) Tablebases: None Openings: 12moves_SALC_10k.pgn (all positions 12 moves deep and all are replayed with reversed colors)(download at Download & Links) Ponder, Large Memory Pages & learning: Off Thinking time: 30'+5'' per game/engine (average game-duration: 80', so around 18 games per day are played). Average thinking time in the middlegame is around 50''-60'' per move. That means, that (for example) Komodo calculates around 350-400 meganodes (60 seconds, on 4 cores) for each move in the middlegame. So the played games are high-quality-chess. This is an endless RoundRobin-tournament with the strongest 2-6 chessengines (number of participants can change in the future (depends on the development of the top-chessengines)). A new engine-version will replace the old one. Number of Games Played (Overall): 772 (Running Since 18/04/16) - (Updated: 01/06/16)Download all played games here [You must be registered and logged in to see this link.] Because Houdini and Gull are no longer in development and the gap between Stockfish/Komodo and Fire/Equinox is very huge, I decided to play the Endless RoundRobin from now only with Stockfish and Komodo, as a head-to-head competition. Current participants: Stockfish 160520 and Komodo 10, Stockfish Contempt is set to +10 (reduce early 3fold-draws of Stockfish) (and Komodo has a default-Contempt of +10...). Stockfish - Komodo (head-to-head) (Ordo-calculation fixed to Stockfish 160520 = 3340 Elo) Program Elo + - Games Score Av.Op. Draws 1 Stockfish 160520 x64 : 3340 18 18 166 53.3 % 3317 68.1 % 2 Komodo 10 x64 : 3317 18 18 166 46.7 % 3340 68.1 % Games : 166 (finished) White Wins : 35 (21.1 %) Black Wins : 18 (10.8 %) Draws : 113 (68.1 %) Unfinished : 0 White Score : 55.1 % Black Score : 44.9 % Individual statistics: 1 Stockfish 160520 x64 : 3340 166 (+ 32,=113,- 21), 53.3 % Komodo 10 x64 : 166 (+ 32,=113,- 21), 53.3 % 2 Komodo 10 x64 : 3317 166 (+ 21,=113,- 32), 46.7 % Stockfish 160520 x64 : 166 (+ 21,=113,- 32), 46.7 % | |
|