Houdini Tests

This was a great dissapointment as it is by far the fastest compile yet and seemed bug free
However what it has gained in speed it has "miss placed " in strength . we stopped test as it was begiening to emulate T63c sucsess (joke )

[img][You must be registered and logged in to see this link.][/img]

I had really better results. It's strange... I will do more tests later with more games, but in my computer it won +8 =18 -4 vs its last version who was the best in my tests.

Aitor

Yes, I know that's 1 min and it's not a good time control but I have not much time...

HOU1.02!, Blitz 1m 0

Houdini 1.02 x64 POPCNT 4_CPU - Houdini DEVEL-V2 x64 8_CPU 4C 17.0 - 13.0 +8/=18/-4 56.67%
Houdini 1.02 x64 POPCNT 4_CPU - IvanHoe-B 63Mod12c MOD12 14.5 - 15.5 +5/=19/-6 48.33%

Aiorla wrote:

Yes, I know that's 1 min and it's not a good time control but I have not much time...

HOU1.02!, Blitz 1m 0

Houdini 1.02 x64 POPCNT 4_CPU - Houdini DEVEL-V2 x64 8_CPU 4C 17.0 - 13.0 +8/=18/-4 56.67%
Houdini 1.02 x64 POPCNT 4_CPU - IvanHoe-B 63Mod12c MOD12 14.5 - 15.5 +5/=19/-6 48.33%

Fact is R4 crushed it so please test vrs R4 not itself and compare results of olser version vrs R4


R Houdart writes

Note on AMD multi-core processors
Houdini has been developed and tuned on Intel processors, and apparently some of the design choices aren't very well adapted to AMD multi-core processors like the AMD Phenom II. Hopefully we'll soon be able to track down this problem.

We say A poor workman blames his tools and a poor compiler issues no warnig such as ....This engines rubbish if you use AMD pc's

Yes me4u Rybka crushed Houdini here too... It's strange the diversity of results and the difficulty of getting a conclusion

[quote="Aiorla"]Yes me4u Rybka crushed Houdini

please post test r4 vrs new houdini

What GUI is this you're using for the tests here?

kicker04 wrote:

What GUI is this you're using for the tests here?

Fritz ,windows 64, AMD 965 phenom black 3.4ghz

BAD LUCK (1), Blitz 13m 0


1 Houdini 1.02 x64 POPCNT 4_CPU +15/=33/-12 52.50% 31.5/60
2 Deep Rybka 4 SSE42 x64 +12/=33/-15 47.50% 28.5/60


i5 750 (SSE4.2) . Ponder OFF. 13/0. Noomen Suite (changing colors). Large pages NOT enabled. 3-4-5 man Nalinov.

BAD LUCK (2), Blitz 13m 0


1 IvanHoe-B 63Mod12c Best +3/=28/-3 51.43% 17.0/34
2 Houdini 1.02 x64 POPCNT 4_CPU +3/=28/-3 48.57% 17.0/34


Ivanhoe crashed and I could not finish the test. He was winning its last game but I don't count it as valid :S

Aiorla wrote:

BAD LUCK (2), Blitz 13m 0


1 IvanHoe-B 63Mod12c Best +3/=28/-3 51.43% 17.0/34
2 Houdini 1.02 x64 POPCNT 4_CPU +3/=28/-3 48.57% 17.0/34


Ivanhoe crashed and I could not finish the test. He was winning its last game but I don't count it as valid :S

when mod12c causes an exception (rarely ) just cancel the messages and it continues playing that game 99 times out of a 100

me4u wrote:

Aiorla wrote:

BAD LUCK (2), Blitz 13m 0


1 IvanHoe-B 63Mod12c Best +3/=28/-3 51.43% 17.0/34
2 Houdini 1.02 x64 POPCNT 4_CPU +3/=28/-3 48.57% 17.0/34


Ivanhoe crashed and I could not finish the test. He was winning its last game but I don't count it as valid :S

when mod12c causes an exception (rarely ) just cancel the messages and it continues playing that game 99 times out of a 100

Oh yes, it could continue but I didn't want to test it more because I need the computer and the exception stopped the match two hours

PS: The percentage is wrong because I eliminated the last game.

thanks for testing.

[img][You must be registered and logged in to see this link.][/img]


[img][You must be registered and logged in to see this link.][/img]

Two short tests to see if engines were stable No books Ponder OFF ,512 engine hash
!st test vrs 9.53 b ( one of the very strongest IvanHoes ) Ivan had NO triplebases , 2nd test it DID have them

This Houdini is a real contender for top engine now

Hello,

i don't know for you but under Rubka4 gui Houdini last version have some problems.
In fact, the clock substract five seconds each time, use or not use this five seconds.

under Arena all is fine.

Nonetheless, under Arena gui Stockfish is equal or superior than Houdini one cpu.

theropodes wrote:

Hello,

i don't know for you but under Rubka4 gui Houdini last version have some problems.
In fact, the clock substract five seconds each time, use or not use this five seconds.

under Arena all is fine.

Nonetheless, under Arena gui Stockfish is equal or superior than Houdini one cpu.

Vas is such a ***** genius !!!

TESTING HOUDINI 1.03a
240 games



Quad 2.33
Gui: Fritz 12
Ponder: Off
No Triple or Robbo Bases
Book: HS Masterbook 2
Time Control: 5 min+ 0 sec.
4 cores
120 games
2010-07Houdini1.03a2 2010

1 2 3 4
1 Houdini 1.03a w32 4_CPU 10.5 - 9.5 11.0 - 9.0 13.0 - 7.0 34.5/60
2 Ivanhoe-B57d_whm08_w32(x4) 9.5 - 10.5 11.0 - 9.0 9.0 - 11.0 29.5/60
3 IvanHoe T53(x4) 9.0 - 11.0 9.0 - 11.0 10.5 - 9.5 28.5/60
4 Deep Rybka 4 w32 7.0 - 13.0 11.0 - 9.0 9.5 - 10.5 27.5/60

]TEST2

I7 975
Gui: Fritz 12
Ponder: Off
No Triple or Robbo Bases
Book: HS Masterbook 2
Time Control: 5 min+ 0 sec.
4 cores and 8 threads
120 games
201007Houdini1.03ax8-2 2010

1 2 3 4
1 Ivanhoe-B57d_whm08_w64(x8) 11.0 - 9.0 9.0 - 11.0 12.5 - 7.5 32.5/60
2 Deep Rybka 4 x64 9.0 - 11.0 11.5 - 8.5 10.5 - 9.5 31.0/60
3 Houdini 1.03a x64 8_CPU 11.0 - 9.0 8.5 - 11.5 10.5 - 9.5 30.0/60
4 IvanHoe T53(x8) 7.5 - 12.5 9.5 - 10.5 9.5 - 10.5 26.5/60


GLOBAL

1 2 3 4
1 Houdini 1.03a w32 4_CPU 21,5-18,5 21,5-18.5 21,5-18,5 64,5/120
2 Ivanhoe-B57d_whm08_w32(x4) 18.5-21.5 20.0-20.0 23,5-16,5 62,0/120
3 Deep Rybka 4 w32 18,5-21,5 20.0-20.0 20,0-20.0 58,5/120
4 IvanHoe T53(x4) 18,5-21,5 16,5-23,5 20,0-20,0 55,0/120

FINAL GLOBAL CUMULATIVE TESTS
480 GAMES
1 2 3
Houdini 1.03a 81,0-79,0 86,5-73,5 167,5/320 52,34%
Ivanhoe-B 57d_whm 79,0-81,0 79,5-80,5 158,5/320 49,53%
Deep Rybka4 73,5-86,5 80,5-79,5 154,0/320 48,13%


COMMENTS

After 600 games at 5 min/0 control, and about 100 hours almost non stop I finished this series of tests. The final global accumulated includes only games played between Houdini, Ivanhoe-B57d_whm and Deep Rybka 4. That is 480 games. Ivanhoe T53 performance is not bad, but clearly below them.
At this time control it is quite clear for me that Houdini 1.03a is the number one.

My next test will double the time control: 10min/0. I will include Vlad0’s Ivanhoe 55mU together with the three mentioned engines. At 10 minutes/game I expect Deep Rybka to increase its percentage up to 50%.

Regards,

Tom.

AMD Athlon X2 6400+ 3,2GHz 8GB DDR2 Windows 7 x64


Igorrit 0.086v9 x64 - Houdini 1.03 x64


+2 =11 -1


10´/40 Moves
Pondern off
no Book
1024 MB Hash
without Bases

Lupus
####

[img][You must be registered and logged in to see this link.][/img]

vast improvement over T54A, with this amount of draws there certainly no difference between them at this tc

NO Bases No Books Ponder OFF

a short tournament 7 games interl core2duo 2CPU

Blitz 2m


1 Houdini 1.03a x64 2_CPU 1½½0½1½ 4.0/7
2 IvanHoe T0.4 beta3 0½½1½0½ 3.0/7

[img][You must be registered and logged in to see this link.][/img]

Houdini 1.5 Large pages by default , No books no bases

T07 Large pages enabled No book , RobboTriplesBases loaded

Houdini 1.5 x64 - Deep Rybka 4 SSE42 28.0 : 16.0 (+17 =22 -5)
+97 ELO, 95% -> [-72...+75]


(1'+1", 3cpu AMD Phenon II x3 mobile N830 2.1GHz,no bases)


~~~~~~~~~~~~~~

Houdini 1.5 x64 - IvanHoe B50kA 16.0 : 16.0 (+7 =18 -7)

(10'+1", 2cpu Intel Core 2 Duo T5800 2GHz, IH RB - yes, Houdini EGTB - no)

Great Engine, it's a pity that is not open source

BIG_TOURNAMENT 2010

1 2 3 4 5 6
1 Houdini 1.5 x64 10.5 - 5.511.5 - 4.513.0 - 3.09.5 - 6.511.0 - 5.0** 55.5/80
2 Ivanhoe B49jAx64p 5.5 - 10.58.0 - 8.07.0 - 9.09.0 - 7.09.5 - 6.5 ** 39.0/80
3 IvanHoe 9.49b x64 4.5 - 11.58.0 - 8.09.0 - 7.09.5 - 6.57.5 - 8.5 ** 38.5/80
4 IvanHoe T49j2 3.0 - 13.09.0 - 7.07.0 - 9.09.0 - 7.09.5 - 6.5 ** 37.5/80
5 Ivanhoe 52iUSTM0-x64 6.5 - 9.57.0 - 9.06.5 - 9.57.0 - 9.010.0 - 6.0 ** 37.0/80
6 Fire 1.31 x64 5.0 - 11.06.5 - 9.58.5 - 7.56.5 - 9.56.0 - 10.0 ** 32.5/80

EDIT: 1' + 1'' / TOP-18 Position with reversed color ON / Ponder OFF / i5-750 64-bits / No Endgame Bases /

Belated test from Peterpan
* 10 minute games


1 Ivanhoe B48iX64 +16 +2/=19/-1 52.27% 11.5/22
2 Houdini 1.5 x64 -16 +1/=19/-2 47.73% 10.5/22


[You must be registered and logged in to see this link.]