Home Up September tests October November December January September07 oct-Nov07 DEC07 March 08

CHESS ENGINES TESTS

DEC07

 

 

Fruit SMP 2.3.4e beta test

 
Logo

Homepage

Tournament Name Authors Tester Group Country

superchessengine.com

Fruit SMP Beta Daniel Charles E.Ly  Superleague

 Engine testing condition

Cpu

GUI Opening Book

Memory

total

Memory

hash

EGTB

(3-4-5??)

EGTB

cache

Time

Tournament

type

Round Total games
2 Xeon 5365 Fritz10 perfect1233.ctg 7 Gb 512Mo(SMP) 3-4-5 128mo 5mn+5s Gauntlet 10 100
more conditions : Gauntlet  Fruit  vs 5 commercial and 5 top free UCI engine
Chess Engines :  
date: Dec 15 2007
Pgn   Xeondec.pgn

Top6.pgn

Tester Homepage: superchessengine.com

Results:


						
FRUIT SMP 2.3.4e
 
 
Tester comments :  Daniel Charles :
This a Fruit SMP beta , and this is just beta testing to correct some bug. 
Fruit SMP has a kn.s from 5000kn/s to over 6000kn/s at least on my Xeon . 

Like I said to Ryan Last week. 
It fully support 8 CPU . This is very strong in the middle game
 however in the Endgame it could lost even with a big advantage ...
some bug: loss on time, Like It is in his beta Version ,
sometimes crash in the endgame or when It is Losing . 

I tested versus 5 top Commercial Engine and versus 5 top Free UCI engines 
This is only a modest and small test and need more games to confirm 
and don t forget that it has still some bugs that s why It lost on time ,
 if these bugs are solve Fruit SMP will be very strong. 
Propably in the top 3-5 Chess engine (commercial include)

 

 

 

Glaurung SMP 64 bits test

 
Logo

Homepage

Tournament Name Authors Tester Group Country

superchessengine.com

Glaurung SMP64 Daniel Charles E.Ly  Superleague

 Engine testing condition

Cpu

GUI Opening Book

Memory

total

Memory

hash

EGTB

(3-4-5??)

EGTB

cache

Time

Tournament

type

Round Total games
2 Xeon 5365 Fritz10 perfect1233.ctg 7 Gb 512Mo(SMP) 3-4-5 128mo 3mn+2s Gauntlet 20 200
more conditions : Gauntlet  Glaurung vs 5 commercial and 5 top free UCI engine
Chess Engines :  
date: Dec 7 2007
Pgn   Xeondec.pgn
Tester Homepage: superchessengine.com

Results:


						
Glaurung SMP
Tester comments :  Daniel Charles :

I tested the New Glaurung SMP 64 on my Xeon vs 5 commercial and vs 5 top Free UCI engines

Thanks to Tord for the new Glaurung 64 bits (up to 8 cpu and maybe more ??)
It was was very fast (over 8000 kn/s on some games)
Of course this is not a Rybka 2.3.2a smp Killer . it lost vs DS11, Zappa Mexico,Naum ( the top commercial engines behind Rybka ) and beat Fritz 10 ( a good commercial engine )

Now begin the interesting test vs Top Free UCI engines, Glaurung won over all top Free UCI in this test (Including Free Rybka, Fruit 2.3.3J, Toga, Belka and Spike

At least on my big hardware (8 CPU ) A new king for Free UCI engine is born Very Happy

 

 

 

Rybka vs Zappa

 
Logo

Homepage

Tournament Name Authors Tester Group Country

superchessengine.com

Rybka Vs Zappa Daniel Charles E.Ly  Superleague

 Engine testing condition

Cpu

GUI Opening Book

Memory

total

Memory

hash

EGTB

(3-4-5??)

EGTB

cache

Time

Tournament

type

Round Total games
2 Xeon 5365 Fritz10 perfect1233.ctg 7 Gb 512Mo(SMP) 3-4-5 128mo 40/40+40/40+40 Gauntlet 50 50
more conditions : Long games on similar or even superior hardware to the Mexico Match
Chess Engines : Rybka vs Zappa  on Xeon 5365
date: Dec 2 2007
Pgn   zappavsrybka.pgn
Tester Homepage: superchessengine.com

Results:


						
Tester comments :  Daniel Charles :

Zappa Scale better , however Rybka 2.3.2 a SMP 64 is still the best chess engine out there even on 8 cpu

around 50 elo after 50 games the difference is not so big on 8 cpu .
A good tournament book could overcome the 50 elo difference especially when it is tuned versus against this engine . Zappa Team probably tuned their white and black book versus Rybka . Their advantage was that almost the same Rybka they tested played against them ...
A.Cozzie did a very job improving his zappa & Erdo made a very good book tuned vs Rybka + a little bit luck and we had Zappa Mexico team victory at Mexico (congrats to them one more time )

Zappa Victory vs Rybka at Mexico was probably 50 % engine + Xeon + 25 % book + 25 % luck

 

 

 

Rybka vs Zappa Vs Naum

 
Logo

Homepage

Tournament Name Authors Tester Group Country

superchessengine.com

Zappa Mexico Daniel Charles E.Ly  Superleague

 Engine testing condition

Cpu

GUI Opening Book

Memory

total

Memory

hash

EGTB

(3-4-5??)

EGTB

cache

Time

Tournament

type

Round Total games
2 Xeon 5365 Fritz10 Fritz10.ctg 7 Gb 512Mo(SMP) 3-4-5 16 Mo 3mn+2s

>5 mn

RR 4 180
more conditions :  
Chess Engines : 10 Strong UCI Engines  , please note that Belka played with all settings on 0000 that s why it was so weak (will retest belka 12 soon)
date:  
Pgn    
Tester Homepage: superchessengine.com

Results:


						
 
 
Tester comments :  Daniel Charles :


I just finished the test for Glaurung & Belka in a 4 Round Robin vs some top Chess engines

For this one I decide to use Fritz 10 which is a very good real tournament book (not draw book)

1st - With no Surprise Rybka of course Finished 1st ... a little surprise is that Rybka didn t kick Fruit and Toga Ass ...

2nd - is DS11 who did very good except on this tournament, It even kill Naum smp (3.5/4) , bad think is of course vs Rybka 0.5/4 and Zappa

3rd - Zappa Mexico just 0.5 behind DS11

4th - New Glaurung was impressive on 8 cpu , Maybe the new Free UCI engine King at least on 8 cpu (Wait and See )

5 - Naum did well vs Zappa (50 % ) However it lost too much points vs Rybka and DS11 on this test

6 - This Fruit Beta is for sure stronger than Fruit 2.3.1 (vs others chess engines ) , It was the only to beat Rybka on 4 games match

7 - Spike Draws a lot of games

8 - Toga did so so ... not too bad not too good ..

9 - Fritz 10 ... This is a surprise to see it so low because the test was with his own book supposed to be tuned for him !!!

10 - Belka played too fast , I expected him to be in the middle of this test , Strangely it did very bad only 2/36 !!! Maybe something gone wrong ....
especially in the end of game where it was killed
 

 

 

 

Rybka vs Zappa Vs Naum

 
Logo

Homepage

Tournament Name Authors Tester Group Country

superchessengine.com

Zappa Mexico Daniel Charles E.Ly  Superleague

 Engine testing condition

Cpu

GUI Opening Book

Memory

total

Memory

hash

EGTB

(3-4-5??)

EGTB

cache

Time

Tournament

type

Round Total games
2 Xeon 5365 Fritz10 perfect1233.ctg 7 Gb 512Mo(SMP) 3-4-5 16 Mo 4mn+2s

>360s

Gauntlet 50 100
more conditions :  
Chess Engines : Rybka vs Zappa + Rybka vs Naum   on Xeon 5365
date: 16-nov-07
Pgn    
Tester Homepage: superchessengine.com

Results:


						
 
 
Tester comments :  Daniel Charles :

For Blitz

Zappa Scale better , however Rybka 2.3.2 a SMP 64 is still the best chess engine out there even on 8 cpu Very HappyVery Happy

Mama Milla,  Naum was too optimist versus Rybka , Naum show positive score when Rybka see the opposite, Naum is very strong (probably one of the top 3-5 chess engine ) but this time was punish by Rybka

 

 

 

Swiss tournament

 
Logo

Homepage

Tournament Name Authors Tester Group Country

superchessengine.com

Swiss tournament Daniel Charles E.Ly  Superleague

 Engine testing condition

Cpu

GUI Opening Book

Memory

total

Memory

hash

EGTB

(3-4-5??)

EGTB

cache

Time

Tournament

type

Round Total games
2 Xeon 5365 Fritz9 perfect9.ctg 7 Gb 512Mo(SMP) 3-4-5 16 Mo 4 mn +2s Swiss 15 195
more conditions :  
Chess Engines : 26 chess engines
date: 16-Nov-07
Pgn    
Tester Homepage: superchessengine.com

Results:


						
 
Tester comments :  Daniel Charles :

1- Glaurung SMP 64 bits and Zappa Mexico tied for 1st with 11.5/15 and both undefaited . Very good for Glaurung !!!

3- Fre Rybka 64 bits - still very strong

4-Fritz 10 did very good only 1 loss

5- Naum 2.2 SMP , something strange 4 losses in the row !!! maybe a bug... don t know ... when I retarted the computer 4 wins in the row !!!

Main Fact in this tournament :

DS 11 did so so (not bad , not good)
Fruit beta is very strong and finished in the top 10...
Tested Crafty smp 8 cpu compiled by Jim, did very good on my Xeon
Deep Pharaon Crashed ... 3-4 times Sad

 

 

 

 

Deep Shredder 11

 
Logo

Homepage

Tournament Name Authors Tester Group Country

superchessengine.com

Deep Sredder 11 Daniel Charles E.Ly  Superleague

 Engine testing condition

Cpu

GUI Opening Book

Memory

total

Memory

hash

EGTB

(3-4-5??)

EGTB

cache

Time

Tournament

type

Round Total games
2 Xeon 5365 Fritz9 perfect9.ctg 3 Gb 512Mo(SMP) 3-4-5 16 Mo 10mn +10 s Gauntlet 40 80
more conditions :  
Chess Engines : DS 11 vs Zappa Mexico and Naum 2.2 Smp
date: 11/07
Pgn   xeonpgn
Tester Homepage: superchessengine.com

Results:


						
 
Tester comments :  Daniel Charles :

Deep Shredder 11 did better this time . However on 8 cpu it is a little bit under Zappa Mexico level

It score 45 % vs Naum 2.2 SMP (Naum 2.2 SMP belongs definively to the top 3-5 chess engine )

Like I folows some testers test too

On 1 cpu

Shredder is a lot more stronger than Zappa Mexico
Shredder is a lot more stronger than Naum 2.2


On 4 CPU

Zappa Mexico Stronger than Deep Shredder
Deep Shredder and Naum approximatively same level


on 8 CPU

Zappa Mexico a lot more stronger than Deep Shredder
Naum 2.2 MP stronger than Deep shredder

 

 

 

 

Deep Shredder 11 vs 5 UCI engines

 
Logo

Homepage

Tournament Name Authors Tester Group Country

superchessengine.com

Deep Sredder 11 Daniel Charles E.Ly  Superleague

 Engine testing condition

Cpu

GUI Opening Book

Memory

total

Memory

hash

EGTB

(3-4-5??)

EGTB

cache

Time

Tournament

type

Round Total games
2 Xeon 5365 Fritz9 perfect9.ctg 3 Gb 512Mo(SMP) 3-4-5 16 Mo 10mn +10 s Gauntlet 40 80
more conditions :  
Chess Engines : DS 11 vs Zappa Mexico and Naum 2.2 Smp
date: 11/07
Pgn   xeonpgn
Tester Homepage: superchessengine.com

Results:


						
 
Tester comments :  Daniel Charles :

DS 11 is  in big trouble vs Zappa And Naum (all play with 8 cpu)

score only 22.5 % vs Zappa Mexico and 35% vs Naum 2.2 SMP

 DS is a lot more comfortable vs Top free UCI  around 65 % vs Glaurung and Fruit 2.3.3J Beta
after a bad begining DS 11 fought back and has a positive record vs Free Rybka 1.0 64 bits


 

 

 

Fruit 2.3.3J Beta

 
Logo

Homepage

Tournament Name Authors Tester Group Country

superchessengine.com

Fruit 2.3.3J beta Daniel Charles E.Ly  Superleague

 Engine testing condition

Cpu

GUI Opening Book

Memory

total

Memory

hash

EGTB

(3-4-5??)

EGTB

cache

Time

Tournament

type

Round Total games
2 Xeon 5365 Fritz9 perfect9.ctg 3 Gb 128Mo

512Mo(SMP)

3-4-5 16 Mo 2mn+2s

>240s

Gauntlet 20 200
more conditions :  
Chess Engines : a beta Fruit vs some strong Free UCI engine + Zappa Mexico
date: 28-09-07
Pgn    
Tester Homepage: superchessengine.com

Results:


						
 
 
Tester comments :  Daniel Charles :

 

This version 2.3.3 J is well tuned vs Free Rybka and Toga ... The 2 top free UCI engine the last 2 years

It  managed to beat all free Top UCI engine (  Rybka, Toga, Pharaon ,Naum, Spike ,Glaurung...) in a 20 games match except Strelka.

It draw vs Fruit 2.3.1 .

It has a lot of difficulties vs Strelka 1.8 (a lot of controversy around Strelka ,illegal  Clone or not?I don't know & I m not the one to decide)

It was not a surprise to see Fruit lost againstcommercial Zappa Mexico 8 CPU

I m running some  test for  Fruit beta... More version will be test ...

This one did well versus strong Free UCI engine

 

 

 

Zappa Mexico

 
Logo

Homepage

Tournament Name Authors Tester Group Country

superchessengine.com

Zappa Mexico Daniel Charles E.Ly  Superleague

 Engine testing condition

Cpu

GUI Opening Book

Memory

total

Memory

hash

EGTB

(3-4-5??)

EGTB

cache

Time

Tournament

type

Round Total games
2 Xeon 5365 Fritz9 perfect9.ctg 3 Gb 128Mo

512Mo(SMP)

3-4-5 16 Mo 4mn+2s

>360s

Gauntlet 10 100
more conditions :  
Chess Engines : New Zappa Mexico 8 cpu vs 10 top free UCI engines
date: 26-09-07
Pgn    
Tester Homepage: superchessengine.com

Results:


						
 
Tester comments :  Daniel Charles :

Zappa Mexico is Very impressive on 8 CPU (just look at the match RybkaSMP vs Zappa Mexico!!)

That s why I decide to test it on my 2Xeon 5365 (8CPU 3ghz) 

Zappa was able to score 74.5 % vs 10 top Free uci Engine!!! (and this is just The 32 bits version)

It managed to score positive record vs all opponent (only Strelka draw it, I was alittle bit surprise )

Toga,Strelka and Glaurung SMP (it was on 4 CPU) did very well vs Zappa Mexico (A top 2 commercial engine )

This is the first Time I saw a Top Commercial engine other than Rybka that could beat easily the top 10 free UCI engine ...

It was a big surprise to see Zappa Mexico score 80 % vs Free Rybka 1.0 (A top 3 free engine , maybe the best free engine). It gave a chess lesson to others free UCI engine (95 % vs Pharaon !!! 80 % vs Fruit 2.3.1, 80% vs Spike 1.2 ...)

 

 

 Last updated 12/19/07