*** Comparison Pro Deo 1.1 and Pro Deo 1.2 ***

Analysed Positions    : 122
Different Moves       : 17
Different Scores      : 22  	(Margin     : 0.10)
Different Times       : 88  	(Percentage : 10%)

Time Pro Deo 1.1      : 01:50:48
Time Pro Deo 1.2      : 01:20:06
Speed Gain (or Loss)  : +28.1%

Nodes Pro Deo 1.1     : 7.222.387.129
Nodes Pro Deo 1.2     : 5.778.990.601
Speed Gain (or Loss)  : +20.0%

Maximum Points        : 960
Points Pro Deo 1.1    : 700   (72.9%)
Points Pro Deo 1.2    : 722   (75.2%)

Positions to solve    : 122
Solved Pro Deo 1.1    :  84   (68.8%)
Solved Pro Deo 1.2    :  84   (68.8%)

Score Differences
Score 0.01 - 0.10     : 39
Score 0.10 - 0.25     : 12
Score 0.25 - 0.50     :  6
Score 0.50 - 0.75     :  3
Score 0.75 - 1.00     :  1
Score 1.00 - 2.00     :  0
Score higher 2.00     :  0

Margin for Scores     : 0.10
Margin for Times      : 10%
To change margins edit REBEL.INI

Results stored in COMPARE.PGN and COMPARE.HTM (this file.)
General
Compare Versions analyses the output of 2 YATS testset processed under Arena.

View generated example output PGN.
Hints and Comments
  • When processed at the same fixed depth level (as in this example) you can measure the exact speed gain (or loss) between 2 versions, in this case +28%.
  • Nodes (for instance) is handy in case you suspect that during time a bug has slipped in, just run your current version with the same settings of an earlier version and if Nodes produces equal node counters you can relax.
  • Every position that has produced a different move is stored into a new PGN file COMPARE.PGN for easily viewing the differences.
  • The very same applies for identical moves that fall outside the score margin and time margin.
  • To reduce the output of the latter option just increase these 2 margins in the REBEL.INI file.
Operation
  • Start ChessPartner and load Pro Deo 1.4
  • Click on the misc tab from the engine info window.
  • Press F4.
  • Click Arena logfile 1 and browse to the first logfile (*.log) and confirm with Apply.
  • Click Arena logfile 2 and browse to the second logfile (*.log) and confirm with Apply.
  • Double click on Compare Arena logfiles.
History
This utilty is a collection of some of the old DOS tools I used to develop, improve and test Rebel.

For questions, suggestions, bug reports etc. contact me at the CCC forum.
Generated with Pro Deo 1.4
Copyright © 1984 - Ed Schröder