LondonFrau Admin
Posts : 1294 Reputation : 3534 Join date : 2010-02-27 Location : ???
| Subject: Testrun of asmBrainFish 180510 (Release-date: 180713) by Stephan Pohl Fri Jul 20, 2018 11:08 am | |
| Each Stockfish-version plays 1000 games versus Komodo 12, Houdini 6, Fire 7.1, Shredder 13, Fizbo 2. All engines are running with default-settings, except: Move Overhead is set to 300ms, if an engine allows to do so.To avoid distortions in the Ordo Elo-calculation, from now, only 2x Stockfish (latest official release + the latest version) and 1x asmFish and 1x Brainfish are stored in the gamebase (all older engine-versions games will be deleted, every time, when a new version was tested). Stockfish, asmFish and BrainFish older Elo-results can still be seen in the Elo-diagrams below. BrainFish plays always with the latest Cerebellum-Library of course, because otherwise BrainFish = Stockfish. Latest update: 2018/07/13: asmBrainFish 180510 (Release-date: 180713) (Ordo-calculation fixed to Stockfish 9 = 3450 Elo) See the individual statistics of engine-results [You must be registered and logged in to see this link.]Download the current gamebase [You must be registered and logged in to see this link.]Download the archive (all played games with HERT (220000 games)) [You must be registered and logged in to see this link.]See a ORDO-rating of the complete HERT-archive-base [You must be registered and logged in to see this link.] Program Elo + - Games Score Av.Op. Draws 1 asmBrainFish 180510 : 3530 8 8 5000 77.9 % 3295 39.3 % (new) 2 BrainFish 180613 bmi2 : 3522 8 8 5000 77.1 % 3295 40.6 % 3 asmFish 180503 bmi2 : 3481 7 7 5000 73.0 % 3295 44.1 % 4 Stockfish 180622 bmi2 : 3477 7 7 5000 72.5 % 3295 45.9 % 5 Stockfish 9 180201 : 3450 7 7 5000 69.5 % 3295 47.6 % 6 Houdini 6 pext : 3421 5 5 9000 53.5 % 3391 55.0 % 7 Komodo 12 bmi2 : 3392 5 5 9000 49.4 % 3394 54.4 % 8 Fire 7.1 popc : 3277 5 5 9000 33.6 % 3407 46.3 % 9 Fizbo 2 bmi2 : 3199 6 6 9000 24.1 % 3415 33.4 % 10 Shredder 13 x64 : 3186 6 6 9000 22.8 % 3417 35.3 % The 4 different Fishes in this Elo-list: - Stockfish- asmFish = Stockfish manually rewritten in assembler (look [You must be registered and logged in to see this link.])- BrainFish = Stockfish playing with Cerebellum-Library by Thomas Zipproth (look [You must be registered and logged in to see this link.])- asmBrainFish = asmFish playing with Cerebellum-Library The version-numbers (180622 for example) of the engines are the date of the latest patch, which was included in the Stockfish sourcecode, not the release-date of the engine-file. Especially the asmFish-engines are often released much later!!Below you find a diagram of the progress of Stockfish in my tests since the end of 2016. And below that diagram, the older diagrams. You can save the diagrams (as a JPG-picture (in originial size)) on your PC with mouseclick (right button) and then choose "save image"...The Elo-ratings of older Stockfish dev-versions in the Ordo-calculation can be a little different to the Elo-"dots" in the diagram, because the results/games of new Stockfish dev-versions - when getting part of the Ordo-calculation - can change the Elo-ratings of the opponent engines and that can change the Elo-ratings of older Stockfish dev-versions (in the Ordo-calculation / ratinglist, but not in the diagram, where all Elo-"dots" are the rating of one Stockfish dev-version at the moment, when the testrun of that Stockfish dev-version was finished). _________________ Bettina...............The greatest happiness of life is the conviction that we are loved.
Victor Hugo
| |
|