*** Comparison Pro Deo 1.1 and Pro Deo 1.2 ***

Analysed Positions    : 122
Different Moves       : 17
Different Scores      : 22  	(Margin     : 0.10)
Different Times       : 88  	(Percentage : 10%)

Time Pro Deo 1.1      : 01:50:48
Time Pro Deo 1.2      : 01:20:06
Speed Gain (or Loss)  : +28.1%

Nodes Pro Deo 1.1     : 7.222.387.129
Nodes Pro Deo 1.2     : 5.778.990.601
Speed Gain (or Loss)  : +20.0%

Maximum Points        : 960
Points Pro Deo 1.1    : 700   (72.9%)
Points Pro Deo 1.2    : 722   (75.2%)

Positions to solve    : 122
Solved Pro Deo 1.1    :  84   (68.8%)
Solved Pro Deo 1.2    :  84   (68.8%)

Score Differences
Score 0.01 - 0.10     : 39
Score 0.10 - 0.25     : 12
Score 0.25 - 0.50     :  6
Score 0.50 - 0.75     :  3
Score 0.75 - 1.00     :  1
Score 1.00 - 2.00     :  0
Score higher 2.00     :  0

Margin for Scores     : 0.10
Margin for Times      : 10%
To change margins edit REBEL.INI

Results stored in COMPARE.PGN and COMPARE.HTM (this file.)

General

Compare Versions analyses the output of 2 YATS testset processed under Arena.

View generated example output PGN.

Hints and Comments

When processed at the same fixed depth level (as in this example) you can measure the exact speed gain (or loss) between 2 versions, in this case +28%.
Nodes (for instance) is handy in case you suspect that during time a bug has slipped in, just run your current version with the same settings of an earlier version and if Nodes produces equal node counters you can relax.
Every position that has produced a different move is stored into a new PGN file COMPARE.PGN for easily viewing the differences.
The very same applies for identical moves that fall outside the score margin and time margin.
To reduce the output of the latter option just increase these 2 margins in the REBEL.INI file.

Operation

Start ChessPartner and load Pro Deo 1.4
Click on the misc tab from the engine info window.
Press F4.
Click Arena logfile 1 and browse to the first logfile (*.log) and confirm with Apply.
Click Arena logfile 2 and browse to the second logfile (*.log) and confirm with Apply.
Double click on Compare Arena logfiles.

History

This utilty is a collection of some of the old DOS tools I used to develop, improve and test Rebel.

For questions, suggestions, bug reports etc. contact me at the CCC forum.