chess games simulator , good idea or not ?

Tired of having to run engine v engine games to get useful statistics?
Don't care about the games and only want to know the draw
percentages/black wins percentages and other statistics like the elo of
the engines? Sad because you don't have some commercial engines and
would like to know how would they score against the opposition? You just
don't have the time to play lots of games?

The solution: YOU DON'T NEED TO PLAY CHESS GAMES AT ALL!

Franklin
Titus (kingliveson) presents a new paradigm in chess rating lists that
don't provide the games that produced their statistics, a script that
generates game results just as if you built computers, invested
money, chose openings, bought engines, installed them, fought with
crashing engines, checked if they ran correctly, if they could ponder,
used tbs and what kind of tbs, and spent hours and hours for all this.

Save
all that and simulate the results of rating lists in record time!
Instant results for the equivalent of games that would otherwise take 16
minutes to run each!

As a demonstration, see these results:

1 Houdini 2.0 STD : 2525 2100 (+1371,=594,-135), 79.4 %

Zappa Mexico II : 100 (+ 73,= 25,- 2), 85.5 %
Naum 4.2 : 100 (+ 56,= 36,- 8), 74.0 %
Loop 13.6/2007 : 100 (+ 79,= 19,- 2), 88.5 %
Deep Onno 1-2-70 : 100 (+ 67,= 30,- 3), 82.0 %
Deep Shredder 12 : 100 (+ 59,= 32,- 9), 75.0 %
Crafty 23.3 JA : 100 (+ 87,= 13,- 0), 93.5 %
Jonny 4.00 32b : 100 (+ 89,= 11,- 0), 94.5 %
Deep Sjeng c't 2010 32b : 100 (+ 70,= 26,- 4), 83.0 %
spark-1.0 SSE42 : 100 (+ 74,= 22,- 4), 85.0 %
HIARCS 13.2 MP 32b : 100 (+ 66,= 27,- 7), 79.5 %
Protector 1.4.0 x64 : 100 (+ 73,= 25,- 2), 85.5 %
Strelka 2.0 B : 100 (+ 85,= 15,- 0), 92.5 %
Spike 1.4 32b : 100 (+ 73,= 18,- 9), 82.0 %
Gull 1.2 : 100 (+ 71,= 27,- 2), 84.5 %
Deep Rybka 4.1 SSE42 : 100 (+ 26,= 56,- 18), 54.0 %
Deep Junior 12.5 : 100 (+ 71,= 22,- 7), 82.0 %
Stockfish 2.1.1 JA : 100 (+ 25,= 56,- 19), 53.0 %
Hannibal 1.1 : 100 (+ 73,= 25,- 2), 85.5 %
Umko 1.2 SSE42 : 100 (+ 92,= 7,- 1), 95.5 %
Critter 1.2 : 100 (+ 34,= 49,- 17), 58.5 %
Komodo64 3 SSE42 : 100 (+ 28,= 53,- 19), 54.5 %

Now, look at these:

1 Houdini 2.0 STD : 2533 2100 (+1455,=479,-166), 80.7 %

Zappa Mexico II : 100 (+ 82,= 14,- 4), 89.0 %
Naum 4.2 : 100 (+ 60,= 31,- 9), 75.5 %
Loop 13.6/2007 : 100 (+ 85,= 10,- 5), 90.0 %
Deep Onno 1-2-70 : 100 (+ 81,= 15,- 4), 88.5 %
Deep Shredder 12 : 100 (+ 61,= 27,- 12), 74.5 %
Crafty 23.3 JA : 100 (+ 89,= 11,- 0), 94.5 %
Jonny 4.00 32b : 100 (+ 93,= 7,- 0), 96.5 %
Deep Sjeng c't 2010 32b : 100 (+ 67,= 25,- 8), 79.5 %
spark-1.0 SSE42 : 100 (+ 77,= 19,- 4), 86.5 %
HIARCS 13.2 MP 32b : 100 (+ 72,= 25,- 3), 84.5 %
Protector 1.4.0 x64 : 100 (+ 77,= 18,- 5), 86.0 %
Strelka 2.0 B : 100 (+ 87,= 12,- 1), 93.0 %
Spike 1.4 32b : 100 (+ 67,= 24,- 9), 79.0 %
Gull 1.2 : 100 (+ 74,= 19,- 7), 83.5 %
Deep Rybka 4.1 SSE42 : 100 (+ 36,= 43,- 21), 57.5 %
Deep Junior 12.5 : 100 (+ 71,= 21,- 8), 81.5 %
Stockfish 2.1.1 JA : 100 (+ 44,= 39,- 17), 63.5 %
Hannibal 1.1 : 100 (+ 73,= 25,- 2), 85.5 %
Umko 1.2 SSE42 : 100 (+ 91,= 7,- 2), 94.5 %
Critter 1.2 : 100 (+ 32,= 45,- 23), 54.5 %
Komodo64 3 SSE42 : 100 (+ 36,= 42,- 22), 57.0 %

One
list was produced by playing games and all the hassle. The other with
kingliveson's script. Can you tell which one is which without leaving
this page? For statistics both are equally useful! What's more, run the
script twice, and you get closer to the true elo of the engines,
instantly!

The only difference would be the games themselves, but for rating lists that don't provide them, that's not an issue!

You
can even run 100 real games in your machine, use them to calculate the
weights, put them in the script, run the scrip 9 times, and presto! You
have 1000 game results indistinguishable from what you would have gotten
if you played 1000 games, with only 1/10 of the effort. Very effective
if you're going to keep your games private, because, the numbers are
everything, you can get chess out of the way!

And, now, what you've been waiting for, download the [You must be registered and logged in to see this link.] of the Chess Rating List Simulator:

[You must be registered and logged in to see this link.]

Source:

[You must be registered and logged in to see this link.]




[You must be registered and logged in to see this image.]

NOTE

kLO posts


By the way, the weight used for Stockfish is incorrect. It should have been 36 instead of 46, 40 seems more appropriate.

Code: [You must be registered and logged in to see this link.]engine_weight[18]=40

Important correction to getting draws -- new source attached.

Removed:
Code: [You must be registered and logged in to see this link.]# difference weight table scale
{
black_difference_table[1]=45 # 0-8
black_difference_table[2]=35 # 9-16
black_difference_table[3]=25 # 17-24
black_difference_table[4]=15 # 25-32
black_difference_table[5]=4 # > 32

white_difference_table[1]=10 # > 32
white_difference_table[2]=8 # 25-32
white_difference_table[3]=6 # 17-24
white_difference_table[4]=4 # 9-16
white_difference_table[5]=2 # 0-8
}

# difference weight table scale
{
black_difference_table[1]=45 # 0-8
black_difference_table[2]=35 # 9-16
black_difference_table[3]=25 # 17-24
black_difference_table[4]=15 # 25-32
black_difference_table[5]=4 # > 32

white_difference_table[1]=10 # > 32
white_difference_table[2]=8 # 25-32
white_difference_table[3]=6 # 17-24
white_difference_table[4]=4 # 9-16
white_difference_table[5]=2 # 0-8
}

# Weight look-up table scale
Weight_Lookup_Scale()
{
if [ $lookup_table_bit -eq 0 ]; then
if (( $engine_weight_difference <= 8 )); then
black_table_weight=${black_difference_table[1]}
elif (( $engine_weight_difference >= 9 && $engine_weight_difference <= 16 )); then
black_table_weight=${black_difference_table[2]}
elif (( $engine_weight_difference >= 17 && $engine_weight_difference <= 24 )); then
black_table_weight=${black_difference_table[3]}
elif (( $engine_weight_difference >= 25 && $engine_weight_difference <= 32 )); then
black_table_weight=${black_difference_table[4]}
elif (( $engine_weight_difference > 32 )); then
black_table_weight=${black_difference_table[5]}
fi
white_table_weight=0
else
if (( $engine_weight_difference <= 8 )); then
white_table_weight=${white_difference_table[5]}
elif (( $engine_weight_difference >= 9 && $engine_weight_difference <= 16 )); then
white_table_weight=${white_difference_table[4]}
elif (( $engine_weight_difference >= 17 && $engine_weight_difference <= 24 )); then
white_table_weight=${white_difference_table[3]}
elif (( $engine_weight_difference >= 25 && $engine_weight_difference <= 32 )); then
white_table_weight=${white_difference_table[2]}
elif (( $engine_weight_difference > 32 )); then
white_table_weight=${white_difference_table[1]}
fi
black_table_weight=0
fi
}

Replaced with:
Code: [You must be registered and logged in to see this link.]# Draw formula -- decrease to increase win
Draw_Weight_Scale()
{
if [ $scale_side_switch -eq 0 ]; then
black_scale_weight=`expr $weaker_engine_weight*.425 | bc`
else
white_scale_weight=`expr $weaker_engine_weight*.185 | bc`
fi
}

The
new approach is more efficient; rather than hard-coding constants on
how often draws occur, the formula uses the engines' defined weights.
The current ratio is tuned to IPON's list previously posted.



Attachments
[You must be registered and logged in to see this image.] [You must be registered and logged in to see this link.]Chess Rating List Simulator




[You must be registered and logged in to see this link.]by [You must be registered and logged in to see this link.] » Fri Sep 09, 2011 4:57 pm




So what was added this time? User interaction,
Gauntlet and Round-Robin tournaments. It is pretty easy to use. Execute
it and just follow the prompt -- source and database attached.

-Run
a Gauntlet tournament after selecting an engine, then number of rounds.
Round Robin tournament will allow all engines to play against each
another. A game database will be generated

-Add/remove engine requires 3 changes:
MAXENGINECOUNT=23
chess_engine[23]="Engine Name"
engine_weight[23]=100

-To increase/decrease wins, edit values in Draw_Weight_Scale()

Code: [You must be registered and logged in to see this link.]Chess Engine Rating List Simulator

Enter 1 for Gauntlet or 2 for Round-Robin: 1
List Engines? Enter y or n: n
Enter engine number: 1
Enter number of rounds: 100
Generating game database.......................Complete!

Code: [You must be registered and logged in to see this link.]Chess Engine Rating List Simulator

Enter 1 for Gauntlet or 2 for Round-Robin: 2
List Engines? Enter y or n: n
Enter number of rounds: 300
Generating game database......................Complete!



Simulated Tournament:
Program Elo + - Games Score Av.Op. Draws

1 Houdini 2.0 STD : 2649 9 9 6300 81.7 % 2390 19.8 %
2 Critter 1.2 : 2604 8 8 6300 77.2 % 2392 22.8 %
3 Komodo64 3 SSE42 : 2595 8 8 6300 76.2 % 2392 23.6 %
4 Deep Rybka 4.1 SSE42 : 2589 8 8 6300 75.5 % 2393 23.8 %
5 Stockfish 2.1.1 JA : 2584 8 8 6300 75.0 % 2393 24.8 %
6 Naum 4.2 : 2484 7 7 6300 62.2 % 2398 29.4 %
7 Deep Shredder 12 : 2484 7 7 6300 62.1 % 2398 29.4 %
8 Spike 1.4 32b : 2448 7 7 6300 57.0 % 2399 31.3 %
9 Deep Sjeng c't 2010 32b : 2443 7 7 6300 56.1 % 2400 31.3 %
10 Deep Junior 12.5 : 2426 7 7 6300 53.6 % 2401 31.4 %
11 Gull 1.2 : 2394 7 7 6300 48.8 % 2402 31.2 %
12 HIARCS 13.2 MP 32b : 2387 7 7 6300 47.8 % 2402 32.1 %
13 Hannibal 1.1 : 2374 7 7 6300 45.9 % 2403 32.1 %
14 Protector 1.4.0 x64 : 2366 7 7 6300 44.6 % 2403 31.0 %
15 spark-1.0 SSE42 : 2362 7 7 6300 44.1 % 2404 30.3 %
16 Deep Onno 1-2-70 : 2328 7 7 6300 39.1 % 2405 30.2 %
17 Zappa Mexico II : 2316 7 7 6300 37.3 % 2406 28.6 %
18 Loop 13.6/2007 : 2303 8 8 6300 35.5 % 2406 27.1 %
19 Strelka 2.0 B : 2236 8 8 6300 27.0 % 2410 22.6 %
20 Crafty 23.3 JA : 2177 9 9 6300 20.5 % 2412 19.0 %
21 Umko 1.2 SSE42 : 2177 9 9 6300 20.5 % 2412 19.7 %
22 Jonny 4.00 32b : 2075 11 11 6300 12.2 % 2417 12.0 %

At
last, your own chess engine rating's list! Just pick weights from lists
such as CEGT, CCRL, SWCR, SSDF. When people ask for games, you can
always provide database with results useful for generating a stats table
such as above.



Attachments
[You must be registered and logged in to see this image.] [You must be registered and logged in to see this link.]Chess Rating List Simulator(64.9 KiB)

[You must be registered and logged in to see this link.]


[You must be registered and logged in to see this link.]by [You must be registered and logged in to see this link.] » Sun Sep 11, 2011 12:37 am




A new feature has been added; it now supports
choosing which engines participate in a tournament (Gauntlet or
Round-Robin) -- Just like regular GUIs. Source and game database are
attached.

Usage/Description:
Code: [You must be registered and logged in to see this link.]This program (bash script) is used for simulating and predicting outcome for chess engine matches and tournaments.
It generates a game (CRLS.pgn) database at the conclusion of each run.
The results should be compared to rating lists such CEGT, CCRL, SWCR, SSDF, etc.

How to run:
sh CRLS or ./CRLS
# Windows users need to research openSUSE (Linux) LiveCD, or cygwin and notepad++
# There is also [You must be registered and logged in to see this link.]

Prompt/Usage:
"Enter 1 for Gauntlet or 2 for Round-Robin: "
# Gauntlet allows an engine to compete against a group of engines
# Round-Robin allows all engines in a tournament to play each other
"List Engines? Enter y or n: "
# List all available chess programs

"Enter engine number (1-25), l (list engines), f (finish), or q (quit): "
# Choose up to 16 programs. Enter each, one at a time
# Enter l to see available programs
# Enter f after selecting the program(s)
# Enter p to see already selected programs
# Enter q to quit the program

"Enter number of round(s) (1-999999): "
# Enter the number of round(s)/game(s) to play

Gauntlet:
"Enter engine number (1-25): "
# Enter engine number from available engines' list
"Play against all engines? Enter y or n: "
# If yes, selected engine plays all available programs
"Enter engine number (1-25), l (list engines), f (finish), or q (quit): "
# Choose program(s) to play against selected engine.

Round-Robin
"List Engines? Enter y or n: "
# List all available chess programs
"Play against all engines? Enter y or n: "
# If yes, all available programs play round-robin style tournament
"Enter engine number (1-25), l (list engines), f (finish), or q (quit): "
# Select the programs to compete in the tournament

Source Editing

Change Engine Weight
# For example, Critter 1.2:
engine_weight[21]=445 # 40

Add/Remove engine requires 3 changes:
# For example: adding a new program
MAXENGINECOUNT=26
chess_engine[26]="Engine Name"
engine_weight[26]=100

To increase/decrease wins, edit values in Draw_Weight_Scale()


Here are some stats from a simulated tournament of all "installed" engines playing each other:
Code: [You must be registered and logged in to see this link.]Games : 150000 (finished)

White Wins : 58442 (39.0 %)
Black Wins : 44737 (29.8 %)
Draws : 46821 (31.2 %)
Unfinished : 0

White Perf. : 54.6 %
Black Perf. : 45.4 %

9/10/2011 7:00:20 PM :

Program Elo + - Games Score Av.Op. Draws

1 Houdini 2.0 STD : 3023 6 6 12000 79.0 % 2793 25.4 %
2 Houdini 1.5a : 3012 6 6 12000 77.9 % 2793 26.3 %
3 Critter 1.2 : 2972 6 6 12000 73.5 % 2795 29.3 %
4 Komodo64 3 SSE42 : 2972 6 6 12000 73.5 % 2795 29.9 %
5 Deep Rybka 4.1 SSE42 : 2969 6 5 12000 73.1 % 2795 30.3 %
6 Stockfish 2.1.1 JA : 2960 5 5 12000 72.1 % 2795 30.8 %
7 IvanHoe 9.47b : 2957 5 5 12000 71.7 % 2795 31.2 %
8 Deep Shredder 12 : 2869 5 5 12000 60.0 % 2799 35.3 %
9 Naum 4.2 : 2860 5 5 12000 58.6 % 2799 35.1 %
10 Spike 1.4 32b : 2828 5 5 12000 53.9 % 2801 36.4 %
11 Deep Sjeng c't 2010 32b : 2826 5 5 12000 53.6 % 2801 36.9 %
12 Deep Fritz 12 32b : 2810 5 5 12000 51.3 % 2802 36.8 %
13 Deep Junior 12.5 : 2806 5 5 12000 50.6 % 2802 36.3 %
14 Gull 1.2 : 2785 5 5 12000 47.5 % 2803 36.8 %
15 HIARCS 13.2 MP 32b : 2770 5 5 12000 45.3 % 2803 37.3 %
16 Hannibal 1.1 : 2757 5 5 12000 43.4 % 2804 35.6 %
17 Protector 1.4.0 x64 : 2748 5 5 12000 42.0 % 2804 35.7 %
18 spark-1.0 SSE42 : 2747 5 5 12000 41.8 % 2804 36.0 %
19 Deep Onno 1-2-70 : 2711 5 5 12000 36.7 % 2806 33.6 %
20 Zappa Mexico II : 2701 5 5 12000 35.3 % 2806 31.8 %
21 Loop 13.6/2007 : 2683 5 5 12000 32.8 % 2807 30.9 %
22 Strelka 2.0 B : 2611 6 6 12000 24.1 % 2810 24.9 %
23 Umko 1.2 SSE42 : 2566 6 6 12000 19.5 % 2812 21.1 %
24 Crafty 23.3 JA : 2559 6 6 12000 18.9 % 2812 21.0 %
25 Jonny 4.00 32b : 2499 7 7 12000 14.0 % 2815 15.7 %

IWB wrote:

kingliveson wrote:And
by the way, what you published as results (which snippets I pasted),
can easily be generated without ever playing a single game. I can
produce you a script that does exactly that.

Franklin

Attachments
[You must be registered and logged in to see this image.] [You must be registered and logged in to see this link.]Chess Engine Rating List Simulator

Post a reply
21 posts • Page 3 of 3 • 123
Re: IPON Rating's List Bash Script

Postby kingliveson » Mon Sep 12, 2011 9:20 pm
This program started out as a challenge to make a point, but developed into a very nifty tool.
It was written in Bash using descriptive variables, functions, and commented for easier modification by others.
Attached archive includes source, help file, sample game database, and stats. To re-iterate some of the features:

it has 100 chess engines common to most ratings' lists
head-to-head matches are supported
supports gauntlet and round-robin style tournaments
gauntlet can be any engine versus all, selected, or random group
round-robin can be all 100 engines going at it, selected, or random group
simulates and generates a game (pgn) database
database preserving option -- newly simulated results can be appended

displays progress and time elapsed



Chess Engine Rating List Simulated
:

9/12/2011 4:08:30 PM :

Program Elo + - Games Score Av.Op. Draws

1 Houdini 2.0 STD : 3050 7 7 9900 81.1 % 2796 23.2 %
2 Houdini 1.5a : 3039 7 7 9900 80.2 % 2796 23.7 %
3 Komodo64 3 SSE42 : 2999 6 6 9900 76.2 % 2797 28.0 %
4 Critter 1.2 : 2995 6 6 9900 75.8 % 2797 29.4 %
5 Deep Rybka 4.1 SSE42 : 2992 6 6 9900 75.5 % 2797 28.5 %
6 Deep Rybka 4 : 2986 6 6 9900 74.9 % 2797 29.3 %
7 Komodo 2.03 DC SSE42 : 2985 6 6 9900 74.7 % 2797 29.7 %
8 Houdini 1.03a : 2983 6 6 9900 74.5 % 2797 30.6 %
9 Stockfish 2.1.1 JA : 2978 6 6 9900 73.9 % 2797 30.4 %
10 IvanHoe 9.47b : 2977 6 6 9900 73.8 % 2797 30.3 %
11 Critter 1.01 SSE42 : 2969 6 6 9900 73.0 % 2797 31.6 %
12 Stockfish 2.01 JA : 2963 6 6 9900 72.2 % 2797 31.8 %
13 Houdini 1.0 : 2962 6 6 9900 72.1 % 2797 31.6 %
14 Igorrit_0086v9_x64 : 2959 6 6 9900 71.8 % 2797 32.8 %
15 RobboLito 009 : 2958 6 6 9900 71.6 % 2797 32.7 %
16 IPPOLIT : 2957 6 6 9900 71.5 % 2797 32.3 %
17 Rybka 3 mp : 2948 6 6 9900 70.4 % 2797 32.8 %
18 Stockfish 1.9.1 JA : 2946 6 6 9900 70.2 % 2797 32.8 %
19 Critter 0.90 SSE42 : 2946 6 6 9900 70.2 % 2797 33.0 %
20 Stockfish 1.7.1 JA : 2936 6 6 9900 69.0 % 2797 34.6 %
21 Rybka 3 32b : 2909 6 6 9900 65.5 % 2798 35.6 %
22 Naum 4 : 2895 5 5 9900 63.6 % 2798 37.6 %
23 Stockfish 1.6.x JA : 2892 6 6 9900 63.2 % 2798 37.1 %
24 Komodo64 1.3 JA : 2891 6 5 9900 63.1 % 2798 37.1 %
25 Naum 4.2 : 2885 5 5 9900 62.2 % 2798 37.5 %
26 Critter 0.80 : 2880 5 5 9900 61.6 % 2798 38.5 %
27 Rybka 2.3.2a mp : 2863 5 5 9900 59.2 % 2798 39.6 %
28 Komodo 1.2 JA : 2862 5 5 9900 59.1 % 2798 40.1 %
29 Deep Shredder 12 : 2855 5 5 9900 58.2 % 2798 40.0 %
30 Gull 1.2 : 2854 5 5 9900 58.0 % 2798 39.4 %
31 Critter 0.70 : 2850 5 5 9900 57.4 % 2798 39.6 %
32 Gull 1.1 : 2849 5 5 9900 57.3 % 2798 39.9 %
33 Deep Sjeng c't 2010 32b : 2846 5 5 9900 56.8 % 2798 39.5 %
34 Spike 1.4 32b : 2844 5 5 9900 56.5 % 2798 41.0 %
35 Komodo 1.0 JA : 2840 5 5 9900 56.0 % 2798 40.4 %
36 Deep Fritz 12 32b : 2837 5 5 9900 55.6 % 2798 41.0 %
37 Rybka 2.2n2 mp : 2833 5 5 9900 54.9 % 2798 41.1 %
38 Naum 4.1 : 2832 5 5 9900 54.8 % 2798 40.4 %
39 Gull 1.0a : 2826 5 5 9900 54.0 % 2798 42.2 %
40 Rybka 1.2f : 2826 5 5 9900 53.9 % 2798 41.3 %
41 Stockfish 1.5.1 JA : 2820 5 5 9900 53.1 % 2799 41.5 %
42 Protector 1.4.0 x64 : 2818 5 5 9900 52.9 % 2799 41.3 %
43 spark-1.0 SSE42 : 2815 5 5 9900 52.4 % 2799 41.5 %
44 Hannibal 1.1 : 2814 5 5 9900 52.2 % 2799 41.1 %
45 HIARCS 13.2 MP 32b : 2810 5 5 9900 51.6 % 2799 42.2 %
46 Fritz 12 32b : 2804 5 5 9900 50.7 % 2799 42.8 %
47 HIARCS 13.1 MP 32b : 2798 5 5 9900 49.9 % 2799 42.4 %
48 Deep Fritz 11 32b : 2786 5 5 9900 48.2 % 2799 41.5 %
49 Deep Junior 12.5 : 2784 5 5 9900 47.9 % 2799 43.3 %
50 Thinker 5.4d Inert x64 : 2782 5 5 9900 47.6 % 2799 42.2 %
51 Doch64 1.2 JA : 2776 5 5 9900 46.7 % 2799 42.2 %
52 Stockfish 1.4 JA : 2771 5 5 9900 46.0 % 2799 42.2 %
53 spark-0.4 : 2771 5 5 9900 46.0 % 2799 42.8 %
54 Zappa Mexico II : 2770 5 5 9900 45.9 % 2799 42.0 %
55 Shredder Bonn 32b : 2768 5 5 9900 45.6 % 2799 42.8 %
56 Protector 1.3.2 JA : 2762 5 5 9900 44.7 % 2799 41.9 %
57 Critter 0.60 : 2759 5 5 9900 44.2 % 2799 42.8 %
58 Fruit 09_07_05 x64 : 2758 5 5 9900 44.2 % 2799 41.9 %
59 Booot 5.1.0 : 2754 5 5 9900 43.5 % 2799 41.8 %
60 Deep Shredder 11 : 2750 5 5 9900 42.9 % 2799 41.5 %
61 Doch64 09.980 JA : 2745 5 5 9900 42.3 % 2799 42.2 %
62 Hannibal 1.0a : 2740 5 5 9900 41.6 % 2799 42.2 %
63 Deep Junior 12 : 2736 5 5 9900 41.0 % 2799 41.6 %
64 Onno-1-1-1 : 2736 5 5 9900 41.0 % 2799 41.7 %
65 Deep Onno 1-2-70 : 2735 5 5 9900 40.8 % 2799 42.0 %
66 Naum 3.1 : 2734 5 5 9900 40.8 % 2799 41.5 %
67 Zappa Mexico I : 2733 5 5 9900 40.5 % 2799 41.3 %
68 Rybka 1.0 Beta : 2732 5 5 9900 40.5 % 2799 40.7 %
69 Spark-0.3 VC(a) : 2732 5 5 9900 40.4 % 2799 41.2 %
70 Onno-1-0-0 : 2731 5 5 9900 40.3 % 2799 40.8 %
71 Toga II 1.4 beta5c BB : 2727 5 5 9900 39.7 % 2799 40.4 %
72 Deep Sjeng WC2008 : 2722 5 5 9900 39.1 % 2799 40.9 %
73 Strelka 2.0 B : 2722 5 5 9900 39.0 % 2799 41.3 %
74 Deep Junior 11.2 : 2720 5 5 9900 38.7 % 2800 40.6 %
75 Umko 1.2 SSE42 : 2713 5 5 9900 37.8 % 2800 40.2 %
76 Hiarcs 12.1 MP 32b : 2712 5 5 9900 37.6 % 2800 40.1 %
77 Deep Sjeng 3.0 : 2709 5 5 9900 37.2 % 2800 39.8 %
78 Critter 0.52b : 2703 5 5 9900 36.5 % 2800 39.5 %
79 Bright 0.4a : 2702 5 5 9900 36.3 % 2800 38.9 %
80 Shredder Classic 4 32b : 2700 5 5 9900 36.0 % 2800 39.5 %
81 Naum 2.2 32b : 2693 5 5 9900 35.1 % 2800 39.2 %
82 Deep Junior 11.1a : 2687 5 5 9900 34.3 % 2800 38.0 %
83 Umko 1.1 SSE42 : 2686 5 5 9900 34.1 % 2800 38.2 %
84 Rybka 1.0 Beta 32b : 2685 5 5 9900 34.0 % 2800 38.2 %
85 Deep Junior 2010 : 2684 5 5 9900 33.9 % 2800 38.3 %
86 Glaurung 2.2 JA : 2681 5 5 9900 33.5 % 2800 38.1 %
87 HIARCS 11.2 32b : 2674 6 6 9900 32.7 % 2800 36.2 %
88 Fruit 05/11/03 32b : 2671 6 6 9900 32.2 % 2800 37.4 %
89 Crafty 23.4 JA x64 : 2666 6 6 9900 31.6 % 2800 36.7 %
90 Loop 13.6/2007 : 2665 6 6 9900 31.5 % 2800 35.5 %
91 Toga II 1.2.1a : 2661 6 6 9900 31.0 % 2800 35.0 %
92 ListMP 11 : 2658 6 6 9900 30.7 % 2800 36.3 %
93 LoopMP 12 32b : 2655 6 6 9900 30.3 % 2800 35.1 %
94 Jonny 4.00 32b : 2655 6 6 9900 30.3 % 2800 35.1 %
95 Deep Shredder 10 : 2652 6 6 9900 29.8 % 2800 34.4 %
96 Twisted Logic 20100131x : 2642 6 6 9900 28.7 % 2800 33.6 %
97 Crafty 23.3 JA : 2638 6 6 9900 28.2 % 2800 32.3 %
98 Spike 1.2 Turin 32b : 2624 6 6 9900 26.5 % 2800 30.7 %
99 Deep Sjeng 2.7 32b : 2591 6 6 9900 23.0 % 2801 28.0 %
100 Crafty 23.1 JA : 2580 7 7 9900 21.9 % 2801 25.5 %



If an engine is out of place, it is an easy fix -- simply change its weight relative to other programs.
Final release? I think so...


Attachments
[You must be registered and logged in to see this image.] [You must be registered and logged in to see this link.]Chess Rating List Simulator(585.15 KiB)




[You must be registered and logged in to see this image.]

[You must be registered and logged in to see this link.]


[You must be registered and logged in to see this link.]by [You must be registered and logged in to see this link.] » Fri Sep 16, 2011 3:11 pm




Well well, it seems as if there will be at least
one more release. Supposedly, there's roughly 35 Elo advantage to
moving first, and to reflect existing databases' win/draw/loss ratio, a
subtle change was made in reference to previous post:

black factor: log[10](-1+1/.262) = 0.44975507050329610828941338578068
white factor: log[10](-1+1/.360) = 0.24987747321659990626489977238775

Code: [You must be registered and logged in to see this link.]Games : 495000 (finished)

White Wins : 181800 (36.7 %)
Black Wins : 134155 (27.1 %)
Draws : 179045 (36.2 %)
Unfinished : 0

White Perf. : 54.8 %
Black Perf. : 45.2 %

There were other cosmetic changes and minor corrects to facilitate input bugs. I can't believe am actually doing this. [You must be registered and logged in to see this image.] It looks good though and reliable. Some screen shots:

[You must be registered and logged in to see this image.]
This simulates/generates database for Rybka 1.0's gauntlet performance against 99 other programs.

[You must be registered and logged in to see this image.]
Simulating
all 100 programs in a round-robin tournament can take a while,
dependind on the system. On one computer, the time (minutes) it takes to
simulate all 100 programs is estimated with:
(.1940997046)(R^1.4303970905) where R is number of rounds

[You must be registered and logged in to see this image.]
Tournament help.

In order to not abuse upload privileges, the file was uploaded [You must be registered and logged in to see this link.] instead, and subsequent, if any other updates, will be stored there.



~~~~~~~






[You must be registered and logged in to see this image.]