[Bug-gnubg] Big problems with external player

[Joachim Matussek]

Hello,

i am comparing several match equity tables by 2 GNUBG nogui instances playing 
each other.

First problem is... i tried several new versions of GNUBG nogui (1578 now). 
None of them works as external player on my new tower pc. Although they work 
fine with my notebook. Both computers use Windows 2000, SP 4, all updates. At 
last i found a version that works with my tower pc. It is a build created by 
Holger in november 2003. 

Second problem is... the match series is done by a python script provided by 
Martin Janke. It is the same script Achim Mueller used. Martin Janke told me 
the output at the python interface is permuted. This means if the output says 
"player 0 wins" in fact "player 1 wins" and vice versa. He didn´t correct this 
in his script what seems quite reasonable. 

Third problem is... i am doing sessions of 100.000 trials 0-ply, match length 
15. I used several match equity tables (Woolsey - Snowie, Snowie - Woolsey, 
Mec26 - Snowie, Snowie - Mec26 ...). I did at least 8 sessions. All the time 
player 1 (means player 0) was the winner by about 50,4 % against 49,6 %, no 
matter what match equity table was used or what permutation. I feel there must 
be some bias either introduced by my experiment or by some GNUBG bug.

###########

Here is what i do:

1. start Holger´s build of GNUBG nogui

2. load commands "config0"

set sound enable no
set matchequitytable "C:\Program Files\gnubg\met\snowie.xml"
set player ... gnu
set evaluation chequerplay evaluation plies 0    # these configurations are done
set evaluation cubedecision evaluation plies 0   # by some desperation because
set player 0 chequerplay evaluation plies 0        # i don´t know what player 
settings
set player 0 cubedecision evaluation plies 0       # are used
set player 1 chequerplay evaluation plies 0
set player 1 cubedecision evaluation plies 0

3. external player 127.0.0.1:10000                     # entered manually... 
cannot be scripted

4. start another instance of GNUBG nogui

5. load commands "config1"

set sound enable no
set matchequitytable "C:\Program Files\gnubg\met\woolsey.xml"
set player amand gnu
set evaluation chequerplay evaluation plies 0
set evaluation cubedecision evaluation plies 0
set player 0 chequerplay evaluation plies 0
set player 0 cubedecision evaluation plies 0
set player 1 chequerplay evaluation plies 0
set player 1 cubedecision evaluation plies 0
set player 0 external 127.0.0.1:10000

6. load python "python1"

from matchSeries import *
playMatchSeries (matchLength = 15, noOfMatches = 100000, statsFile = 
"statsPath", sgfBasePath = "sgfPath", matBasePath = "matPath")

##########

After about one day the rollout is finished and i get the usual result. It is 
not the same each time, but always player 1 (0) as winner.

Joachim Matussek

Python script attached
 
_______________________________________________________________________
... and the winner is... WEB.DE FreeMail! - Deutschlands beste E-Mail
ist zum 39. Mal Testsieger (PC Praxis 03/04) http://f.web.de/?mc=021191

matchSeries.py
Description: Text document