Home Up September tests October November December January September07 oct-Nov07 DEC07 March 08

CHESS ENGINES TESTS

October

Exemple/Sample

(click on september tests for more Engines tests)

 

 

Golden+silver

 
Logo

Homepage

Tournament Name Authors Tester Group Country

superchessengine.com

Golden+silver Daniel Charles E.Ly  Superleague

 Engine testing condition

Cpu

GUI Opening Book

Memory

total

Memory

hash

EGTB

(3-4-5??)

EGTB

cache

Time

Tournament

type

Round Total games
Centrino 1.86 Ghz Fritz9 Perfect11.ctg 1 Gb 128Mo 3-4-5 16 Mo 4mn+2s

>360s

Swiss 19 190
more conditions :  
Chess Engines : 20 top UCI engines
date: 31-10-06
Pgn   superleaguepgn (update weekly) + replay all game on replay zone (update weekly)
Tester Homepage: superchessengine.com

Results:


						
   Top 20 UCI engines
 
Tester comments :  Daniel Charles :

Rybka 1.0 won one more time a tournament .

Just behind the winner, Fruit, GB Fruit, Spike and Toga ... not really surprising :D

Ktulu did a very good tournament with 12/19

Pharaon 3.51 didn't show that now it is a top engine .

Aristarch was a very strong top chess engine 1 or 2 years ago ...but opponents became stronger and stronger ... It needs a new youth .

Anmon 5.60 the chess engine French champion for the last 2 years did a catastrophic tournament with 4.5/19 .

Abrok 5.0 was invited in this tournament and opponents were too strong.

 

 

 

Beginer+reserve 2

 
Logo

Homepage

Tournament Name Authors Tester Group Country

superchessengine.com

Beginner+reserve 2 Daniel Charles E.Ly  Superleague

 Engine testing condition

Cpu

GUI Opening Book

Memory

total

Memory

hash

EGTB

(3-4-5??)

EGTB

cache

Time

Tournament

type

Round Total games
Centrino 1.86 Ghz Fritz9 Perfect11.ctg 1 Gb 64Mo 3-4-5 16 Mo 4mn+1s

>360s

Swiss 17 154
more conditions :  
Chess Engines : 18 UCI engines from beginner league+ some from the reserve league
date: 31-10-06
Pgn   superleaguepgn (update weekly) + replay all game on replay zone (update weekly)
Tester Homepage: superchessengine.com

Results:


						
   Beginner+reserve2
 
Tester comments :  Daniel Charles :

Anechka was undefeated in this tournament with 16/17 and 15 victories !!!!

Adam ,Freechess,Smash,Alex,Clueless and Lime did a good tournament .

New Firefly did a tournament under his standard .Roce was a little bit better than against strong opponent

In the bottom NVSChess didn't score points ??

 

 

 

 

 

 

New UCI engines tournament

 
Logo

Homepage

Tournament Name Authors Tester Group Country

superchessengine.com

New UCI engines Gajendra Singh  Superleague

 Engine testing condition

Cpu

GUI Opening Book

Memory

total

Memory

hash

EGTB

(3-4-5?)

EGTB

cache

Time

Tournament

type

Round Total games
P4 2.4 Arena nunn-selectABCD.pgn 1 Gb 64Mo 3-4-5 16 Mo 40/4'

repeating

Round robin 4 264
more conditions :  
Chess Engines : all new UCI engines
date: 26-10-06
Pgn   superleaguepgn (2 Mo) coming soon replay too... I update only weekly
Tester Homepage: superchessengine.com
Final Results:

						
   

New_uci_engine

Rank Engine Score He Ar De Bo Al Di Li Li Fi BB Sm Ro S-B
01 Hermann 1.9 34.5/44 · ·· · 010= 0110 0=11 1111 1001 1111 1=11 1111 1111 0111 1111  652.75 
02 Arasan 95 33.0/44 101= · ·· · 1=10 ==01 1010 11== =011 111= =111 11=1 1111 1111  627.50 
03 DeepPatzer 3.80 30.5/44 1001 0=01 · ·· · =110 11=0 0101 1==1 0=11 1111 =111 1110 1111  572.75 
04 Booot411 30.5/44 1=00 ==10 =001 · ·· · =01= 1110 0111 1=11 1111 1010 1111 1111  567.00 
05 Alfil 6.9.1 28.0/44 0000 0101 00=1 =10= · ·· · ==1= 11=1 1011 10=1 1110 1111 1111  501.00 
06 Diablo051 27.5/44 0110 00== 1010 0001 ==0= · ·· · 0111 101= 11=1 1101 1111 1111  488.00 
07 LittleThought-0.97 22.0/44 0000 =100 0==0 1000 00=0 1000 · ·· · 0100 1111 1111 1111 1111  330.00 
08 Lime_v62 18.0/44 0=00 000= 1=00 0=00 0100 010= 1011 · ·· · 0=0= 1=11 1001 1011  318.00 
09 FireFly213 13.0/44 0000 =000 0000 0000 01=0 00=0 0000 1=1= · ·· · =10= 0101 11=1  184.75 
10 BBChess0_99b 12.0/44 0000 00=0 =000 0101 0001 0010 0000 0=00 =01= · ·· · 1001 =011  214.75 
11 Smash 1.0.3 12.0/44 1000 0000 0001 0000 0000 0000 0000 0110 1010 0110 · ·· · 1111  163.00 
12 Roce350 3.0/44 0000 0000 0000 0000 0000 0000 0000 0100 00=0 =100 0000 · ·· ·  42.50 

  

 
Tester comments : Gajendra Singh:

A tight win for Hermann 1.9 . Arasan 9.5 led almost throughout the tournament but a littlle bit of slip-up
in the end ( coupled with a late surge by Hermann ) cost it the first place . Booot was hot on the heels of the leaders all through the tournament but hit a bad patch towards the end . Roce is obviously at an elementary stage ( it even once let a clearly won game be drawn by threefold repetition because this rule is not in its internal knowledgebase ) . It also has problems with hash .


Gajendra .

 

 

Top 3 free UCI engines championship

 
Logo

Homepage

Tournament Name Authors Tester Group Country

superchessengine.com

Top 3 free UCI engines Gajendra Singh  Superleague

 Engine testing condition

Cpu

GUI Opening Book

Memory

total

Memory

hash

EGTB

(3-4-5??)

EGTB

cache

Time

Tournament

type

Round Total games
P4 2.4 Arena nunn-selectABCD.pgn 1 Gb 64Mo 3-4-5 16 Mo 40/15'

repeating

Round robin   150
more conditions : tests about the top 3 free uci engines to know
Chess Engines : Toga 1.2.1 BH(# settings) , Rybka 1.0, Spike 1.2
date: 20-10-06
Pgn   superleaguepgn (2 Mo) coming soon replay too... I update only weekly
Tester Homepage: superchessengine.com
Final Results:

						
   
Top 3 free UCI Engine Championship
 
   Engine              Score                                                
1: TogaII 1.2.1BH      62.0/100 
2: Rybka v1.0 Beta.w32 50.0/100 
3: Spike1.2            38.0/100 
150 games played / Tournament finished
Name of the tournament: Free Engine Championship
-----------------Rybka v1.0 Beta.w32-----------------
Rybka v1.0 Beta.w32 - Spike1.2       : 29.5/50 23-14-13   59%   +63
Rybka v1.0 Beta.w32 - TogaII 1.2.1BH : 20.5/50 11-20-19   41%   -63
-----------------Spike1.2-----------------
Spike1.2 - Rybka v1.0 Beta.w32       : 20.5/50 14-23-13   41%   -63
Spike1.2 - TogaII 1.2.1BH            : 17.5/50  8-23-19   35%  -108
-----------------TogaII 1.2.1BH-----------------
TogaII 1.2.1BH - Rybka v1.0 Beta.w32 : 29.5/50 20-11-19   59%   +63
TogaII 1.2.1BH - Spike1.2            : 32.5/50 23-8-19    65%  +108 
 
Tester comments : Gajendra Singh:

It was a run away win for modified Toga II 1.2.1 ( History margin = 75, rest default) but while these settings are probably stronger than default settings , they are most probably nowhere as strong as these results indicate . Toga II 1.2.1 had a very consistent tournament . In only 3 out of 25 positions did it score less than 50% and even in each of those three positions it scored 1.5/4 . And it finished very strongly scoring 6.5/8 in last two positions .Rybka 1.0 beta 32 bit had a slightly disappointing tournament scoring "only" 50% . Spike 1.2 was thrashed both by Toga II and Rybka but it is somewhat weaker than its opponents anyway .

 

 

 

6  Chessmaster 10th settings (King 3.33)

 
Logo

Homepage

Tournament Name Authors Tester Group Country

superchessengine.com

Chessmaster Daniel Charles E.Ly  Superleague

 Engine testing condition

Cpu

GUI Opening Book

Memory

total

Memory

hash

EGTB

(3-4-5??)

EGTB

cache

Time

Tournament

type

Round Total games
Centrino 1.86 Ghz Fritz9 Perfect11.ctg 1 Gb 64Mo 3-4-5 16 Mo 4mn+2s

>360s

round robin 10 150
more conditions :  
Chess Engines : the King 3.33 with 6 # settings
date: 19-10-06
Pgn   superleaguepgn (update weekly) + replay all game on replay zone (update weekly)
Tester Homepage: superchessengine.com

Results:


						
   

						
    Program                          Elo    +   -   Games   Score   Av.Op.  Draws
  1 CM10k Spock                    : 2777   85  76    50    63.0 %   2684   38.0 %
  2 The King 3.33 Pestilence       : 2717   98  62    50    53.0 %   2696   46.0 %
  3 CM10k Schumacher               : 2706  101  61    50    51.0 %   2699   46.0 %
  4 CM10k King 3.33 Paralyse       : 2682   66  98    50    47.0 %   2703   42.0 %
  5 CM10k Milan 1.5                : 2682   55  98    50    47.0 %   2703   54.0 %
  6 CM10k King 3.33 Patatas 3      : 2635   75  88    50    39.0 %   2713   38.0 %
 
Stats with elostat 1.3 with Chessmaster(king 3.33) = 2700 elo
Individual statistics:
1 CM10k Spock               : 2777   50 (+ 22,= 19,-  9), 63.0 %
CM10k King 3.33 Paralyse      :  10 (+  5,=  4,-  1), 70.0 %
The King 3.33 Pestilence      :  10 (+  3,=  4,-  3), 50.0 %
CM10k King 3.33 Patatas 3     :  10 (+  7,=  3,-  0), 85.0 %
CM10k Milan 1.5               :  10 (+  4,=  5,-  1), 65.0 %
CM10k Schumacher              :  10 (+  3,=  3,-  4), 45.0 %
2 The King 3.33 Pestilence  : 2717   50 (+ 15,= 23,- 12), 53.0 %
CM10k King 3.33 Paralyse      :  10 (+  4,=  3,-  3), 55.0 %
CM10k King 3.33 Patatas 3     :  10 (+  5,=  3,-  2), 65.0 %
CM10k Spock                   :  10 (+  3,=  4,-  3), 50.0 %
CM10k Milan 1.5               :  10 (+  0,=  7,-  3), 35.0 %
CM10k Schumacher              :  10 (+  3,=  6,-  1), 60.0 %
3 CM10k Schumacher          : 2706   50 (+ 14,= 23,- 13), 51.0 %
CM10k King 3.33 Paralyse      :  10 (+  4,=  2,-  4), 50.0 %
The King 3.33 Pestilence      :  10 (+  1,=  6,-  3), 40.0 %
CM10k King 3.33 Patatas 3     :  10 (+  3,=  5,-  2), 55.0 %
CM10k Spock                   :  10 (+  4,=  3,-  3), 55.0 %
CM10k Milan 1.5               :  10 (+  2,=  7,-  1), 55.0 %
4 CM10k King 3.33 Paralyse  : 2682   50 (+ 13,= 21,- 16), 47.0 %
The King 3.33 Pestilence      :  10 (+  3,=  3,-  4), 45.0 %
CM10k King 3.33 Patatas 3     :  10 (+  2,=  6,-  2), 50.0 %
CM10k Spock                   :  10 (+  1,=  4,-  5), 30.0 %
CM10k Milan 1.5               :  10 (+  3,=  6,-  1), 60.0 %
CM10k Schumacher              :  10 (+  4,=  2,-  4), 50.0 %
5 CM10k Milan 1.5           : 2682   50 (+ 10,= 27,- 13), 47.0 %
CM10k King 3.33 Paralyse      :  10 (+  1,=  6,-  3), 40.0 %
The King 3.33 Pestilence      :  10 (+  3,=  7,-  0), 65.0 %
CM10k King 3.33 Patatas 3     :  10 (+  4,=  2,-  4), 50.0 %
CM10k Spock                   :  10 (+  1,=  5,-  4), 35.0 %
CM10k Schumacher              :  10 (+  1,=  7,-  2), 45.0 %
6 CM10k King 3.33 Patatas 3 : 2635   50 (+ 10,= 19,- 21), 39.0 %
CM10k King 3.33 Paralyse      :  10 (+  2,=  6,-  2), 50.0 %
The King 3.33 Pestilence      :  10 (+  2,=  3,-  5), 35.0 %
CM10k Spock                   :  10 (+  0,=  3,-  7), 15.0 %
CM10k Milan 1.5               :  10 (+  4,=  2,-  4), 50.0 %
CM10k Schumacher              :  10 (+  2,=  5,-  3), 45.0 %
 
 
 
Tester comments :  Daniel Charles :

I tried 6 different settings for Chessmaster 10 th (the king 3.33)

CM10k Spock settings from Wilhelm (CEGT) was the clear winner with 31.5 pts/50 & 63% & 77 elo points over the tournament average .

Settings Pestilence(G.Banks), Schumacher, Paralyse & Milan are very close in strengh around 2700 elo

Settings Patatas 3 didn t score well, only 39 %

 

 

 

 

 

 

Top free uci engine vs 2 famous commercial engine

 
Logo

Homepage

Tournament Name Authors Tester Group Country

superchessengine.com

GoldenKing Daniel Charles E.Ly  Superleague

 Engine testing condition

Cpu

GUI Opening Book

Memory

total

Memory

hash

EGTB

(3-4-5??)

EGTB

cache

Time

Tournament

type

Round Total games
Centrino 1.86 Ghz Fritz9 Perfect9.ctg 1 Gb 64Mo 3-4-5 16 Mo 4mn+2s

>360s

round robin 6 90
more conditions :  
Chess Engines : chessmater 10 th = the King 3.33 (pestilence), Rybka 1.0, Toga 1.2.1, GB Fruit, Spike 1.2,Fritz 9
date: 19-10-06
Pgn   superleaguepgn (update weekly) + replay all game on replay zone (update weekly)
Tester Homepage: superchessengine.com

Results:


						
   
Tester comments :  Daniel Charles :

Rybka .10 again won another tournament .spike was a serious opponent to win this tournament and finished second (with 3 wins vs rybka 1.0!!!). GB Fruit proved tournament after tournament that it is a very strong uci engine especially for Blitz . Toga (default settings) was below his high standart .

Fritz 9 and The King are very strong engine, however, free  UCI engine improved a lot last 2 years and the top 4 or 5 free UCI engine have at least their level and are even stronger !!!

 

 

 

 

2ND CCRL AMATEUR CHAMPIONSHIP (Division 1)

 

Partner

Homepage

Tournament Name

Authors

Partner Tester Group

Country

Amateur

Ray Banks

CCRL

 Engine testing condition

Cpu

GUI

Opening Book

Memory

total

Memory

hash

EGTB

(3-4-5??)

EGTB

cache

Time

Tournament

type

Round

Total games

3800+

Fritz 9

 ECOplus3.ctg

2.0 Gb

128Mo

3-4-5

32 Mo

40/50’

repeating

round robin

 2

462

more conditions :


ECOplus3.ctg with 12 move limit
40 moves in 50 minutes repeating (adapted to CCRL 40/40)
42 Rounds (2 Cycles)

Chess Engines :

 22 free uci or winboard chess engine

date:

18-10-06

Pgn  

http://kd.lab.nig.ac.jp/chess/discussion-board/download.php?id=2108

Tester Homepage:

http://www.computerchess.org.uk/ccrl/4040/

Final Standing:

1.       30.5 - Glaurung 1.2.1 is CCRL amateur champion
2.       28.0 - Naum 2.0
3.       26.0 - Spike 1.2 Turin
4.       25.5 - Jonny 2.83
5.       23.5 - Scorpio 1.8
6.       23.0 - WildCat 6
7.       23.0 - Pharaon 3.5.1
8.       23.0 - Slow Chess Blitz WV2.1
9.       22.5 - Colossus 2006f
10.   22.5 - Pro Deo 1.1
11.   22.0 - The Baron 1.7.0
12.   20.5 - Thinker 4.7a
13.   20.5 - Petir 3.99d
14.   20.0 - Delfi 5.0
15.   19.5 - Movei 0.08.358
16.   19.5 - Aristarch 4.50
17.   17.0 - SOS 5.1
18.   16.5 - Pseudo 0.7c
19.   16.5 - Little Goliath Evolution 3.12
20.   15.5 - Crafty 20.14
21.   13.5 - Quark 2.35
22.   13.5 - AnMon 5.60 
 
UCI chess engine
Winboard chess engine
17th to 22 -à 2nd division next year
The bottom six from this division will be relegated into next season's Division 2 tournament.

Due to our policy of including updates of engines during these tournaments, 
we will be restructuring into three divisions of 16 engines next season in order to keep things moving along more quickly

Tester comments :

Ray Banks :

I expected that Spike 1.2 Turin would take this one out, but nobody can argue with Glaurung 1.2.1’s convincing performance!

Jonny 2.83 and The Baron 1.7.0 also performed above expectations in this tournament.

I was personally disappointed that Pseudo 0.7c failed to make the cut.

It’s highly probable that Aristarch 4.50, Thinker 4.7a and Quark 2.35 will not be included in the 3rd Championships due to all being pre-2005 engines. If this occurs, a couple of the demoted engines might yet get a lifeline.

Daniel Charles :

Congratulation to Tord & Glaurung . This is he second tournament Glaurung won this week after Open war from Olivier Deville. Spike 1.2 was the clear favorite for the gold. It was A really strong performance from Glaurung.

Naum 2 and Spike 1.2 completed the top 3 podiums. Jonny, Scorpio and Wildcat did a Strong tournament too.

 

 

 

 

 

Germany free uci engine Tournament

 
Logo

Homepage

Tournament Name Authors Tester Group Country

superchessengine.com

Germany Daniel Charles E.Ly  Superleague

 Engine testing condition

Cpu

GUI Opening Book

Memory

total

Memory

hash

EGTB

(3-4-5??)

EGTB

cache

Time

Tournament

type

Round Total games
Centrino 1.86 Ghz Fritz9 Perfect9.ctg 1 Gb 64Mo 3-4-5 16 Mo 4mn+2s

>360s

Ko see below 89
more conditions : 4 rounds for 1/8 & 1/4 finals, 10 rounds for semi final , 20 rounds for the big final
Chess Engines : 16 uci engine from Germany
date: 15-10-06
Pgn   superleaguepgn (update weekly) + replay all game on replay zone (update weekly)
Tester Homepage: superchessengine.com

Results:


						
   
1/8 & 1/4 Finals
1/2 finals
Super Final for Germany free UCI Blitz Tournament
Winner
Toga 1.2.1
 
Tester comments :  First round (1/8): The only surprise was Abrok 5.0 victory over Aristarch 4.50 3-2.

1/4 finals: Spike, Patzer, List & Toga qualified for the demi finals

1/2 finals :

Spike 1.2 had no problem to beat Patzer 3.80  with 9-1 !!!! 

Toga qualified easily versus the free list 5.12  7-3

Final: Toga 1.2.1 won clearly versus Spike 1.2  with  12-8. Spike 1.2 is very closed to Toga strength it managed to draw 10 games/ 20 !!! however Toga won 7 games versus 3 for Spike .

Winner : Toga 1.2.1 , It was playing with history threshold set at 75 ( the default value is 70) like Gajendra did for the top 3 UCI engine tournament

 

 

 

 

 

 

The Naum 2.0 welcoming party

 

Partner

Homepage

Tournament Name

Authors

Partner Tester Group

Country

Naum 2.0

Graham Banks

CCRL

 Engine testing condition

Cpu

GUI

Opening Book

Memory

total

Memory

hash

EGTB

(3-4-5??)

EGTB

cache

Time

Tournament

type

Round

Total games

Dual amd MP2000

Zap!Chess

 HS-Megabook.ctg

1 Gb

128Mo

3-4-5

32 Mo

40/68’

(adapted for CCRL 40/40)

round robin

36 rounds (4 cycles) 

180

more conditions :

Ponder off and Learning off

Chess Engines :

 Rybka 2.1c, Toga II 1.2, Loop 10.32f, CM10th Paralyse, Naum 2.0, Junior 10, Hiarcs X50 Hypermodern, Fritz 8 Bilbao, Ktulu 8.0, CM9000 Enforcer

date:

15-10-06

Pgn  

http://kd.lab.nig.ac.jp/chess/discussion-board/download.php?id=2045

Tester Homepage:

http://www.computerchess.org.uk/ccrl/4040/

Results:

Final Standings (/36)

Rk Chess engine pts /36
1 Rybka 2.1c  23.0
2 Toga II 1.2 22.5
3 Loop 10.32f 19.5
4 CM10th Paralyse 19.0
5 Naum 2.0 18.5
6 Junior 10 17.0
7 Hiarcs X50 Hypermodern 16.0
8 Fritz 8 Bilbao 15.0
9  Ktulu 8.0 15.0
10 CM9000 Enforcer  14.5
 
 
 
 
 

Tester comments