Re: wget2 | Building on Windows (#567)

[Michael Setzer II (@msetzerii)]

Michael Setzer II commented:


Just as a note. Had done some testing before using wget2.exe under wine and 
with window 10 machine and found issues.
Just did a more complete test under wine. Created a script that makes 13 
directories and downloads 13 pages from a site. It then compares the 13 files 
downloaded with multi-tasking set to 1 to the others.
1, 2, 4, 5 had all files match up, but all others had one or more files 
mismatch. 
During test 11, the wget2 stopped responding completely, and had to kill the 
wget2.exe process to get it to complete run. 12 13 did not lock up.

cmp: EOF on 
../3/bwpkedir.P_NameDirectory%3Fdir_indx=&next_row=026&prev_row=025&searchtype=N&ButtonSelected=
 after byte 24464, in line 544
cmp: EOF on 
../6/bwpkedir.P_NameDirectory%3Fdir_indx=&next_row=001&prev_row=000&searchtype=N&ButtonSelected=
 after byte 15816, in line 322
cmp: EOF on 
../7/bwpkedir.P_NameDirectory%3Fdir_indx=&next_row=026&prev_row=025&searchtype=N&ButtonSelected=
 after byte 15816, in line 319
cmp: EOF on 
../8/bwpkedir.P_NameDirectory%3Fdir_indx=&next_row=001&prev_row=000&searchtype=N&ButtonSelected=
 after byte 8080, in line 125
cmp: EOF on 
../8/bwpkedir.P_NameDirectory%3Fdir_indx=&next_row=126&prev_row=125&searchtype=N&ButtonSelected=
 after byte 8080, in line 121
cmp: EOF on 
../9/bwpkedir.P_NameDirectory%3Fdir_indx=&next_row=201&prev_row=200&searchtype=N&ButtonSelected=
 after byte 32656, in line 756
cmp: EOF on 
../10/bwpkedir.P_NameDirectory%3Fdir_indx=&next_row=076&prev_row=075&searchtype=N&ButtonSelected=
 after byte 8080, in line 125
cmp: EOF on 
../10/bwpkedir.P_NameDirectory%3Fdir_indx=&next_row=176&prev_row=175&searchtype=N&ButtonSelected=
 after byte 8080, in line 125
cmp: EOF on 
../11/bwpkedir.P_NameDirectory%3Fdir_indx=&next_row=126&prev_row=125&searchtype=N&ButtonSelected=
 after byte 8080, in line 121
cmp: 
../11/bwpkedir.P_NameDirectory%3Fdir_indx=&next_row=176&prev_row=175&searchtype=N&ButtonSelected=:
 No such file or directory
cmp: EOF on 
../12/bwpkedir.P_NameDirectory%3Fdir_indx=&next_row=126&prev_row=125&searchtype=N&ButtonSelected=
 after byte 8080, in line 121
cmp: EOF on 
../12/bwpkedir.P_NameDirectory%3Fdir_indx=&next_row=276&prev_row=275&searchtype=N&ButtonSelected=
 after byte 8080, in line 118
cmp: EOF on 
../13/bwpkedir.P_NameDirectory%3Fdir_indx=&next_row=026&prev_row=025&searchtype=N&ButtonSelected=
 after byte 15816, in line 319
cmp: EOF on 
../13/bwpkedir.P_NameDirectory%3Fdir_indx=&next_row=126&prev_row=125&searchtype=N&ButtonSelected=
 after byte 32656, in line 740
cmp: EOF on 
../13/bwpkedir.P_NameDirectory%3Fdir_indx=&next_row=201&prev_row=200&searchtype=N&ButtonSelected=
 after byte 16211, in line 335

Only ran script once, so don't know if multiple runs would give exact same 
results, similar results, or completely different results. Something is off. 
Did similar test on Linux and all files resulted in same results.

Under windows 10 native system, didn't see errors till higher levels. 

script is:
for a in 1 2 3 4 5 6 7 8 9 10 11 12 13; do
mkdir $a
cd $a
time wine wget2 --restrict-file-names=windows --max-threads=$a 
--secure-protocol=PFS -q --base="https://ssb-prod.ec.guamcc.edu/PROD/"; -i 
../testlist.sav
cd ..
done 
cd 1
for b in 2 3 4 5 6 7 8 9 10 11 12 13; do for a in *; do echo $a; cmp $a 
../$b/$a ; done; done>>../output 2>../output2

testlist.sav is
bwpkedir.P_NameDirectory?dir_indx=&next_row=001&prev_row=000&searchtype=N&ButtonSelected=
bwpkedir.P_NameDirectory?dir_indx=&next_row=026&prev_row=025&searchtype=N&ButtonSelected=
bwpkedir.P_NameDirectory?dir_indx=&next_row=051&prev_row=050&searchtype=N&ButtonSelected=
bwpkedir.P_NameDirectory?dir_indx=&next_row=076&prev_row=075&searchtype=N&ButtonSelected=
bwpkedir.P_NameDirectory?dir_indx=&next_row=101&prev_row=100&searchtype=N&ButtonSelected=
bwpkedir.P_NameDirectory?dir_indx=&next_row=126&prev_row=125&searchtype=N&ButtonSelected=
bwpkedir.P_NameDirectory?dir_indx=&next_row=151&prev_row=150&searchtype=N&ButtonSelected=
bwpkedir.P_NameDirectory?dir_indx=&next_row=176&prev_row=175&searchtype=N&ButtonSelected=
bwpkedir.P_NameDirectory?dir_indx=&next_row=201&prev_row=200&searchtype=N&ButtonSelected=
bwpkedir.P_NameDirectory?dir_indx=&next_row=226&prev_row=225&searchtype=N&ButtonSelected=
bwpkedir.P_NameDirectory?dir_indx=&next_row=251&prev_row=250&searchtype=N&ButtonSelected=
bwpkedir.P_NameDirectory?dir_indx=&next_row=276&prev_row=275&searchtype=N&ButtonSelected=
bwpkedir.P_NameDirectory?dir_indx=&next_row=301&prev_row=300&searchtype=N&ButtonSelected=

-- 
Reply to this email directly or view it on GitLab: 
https://gitlab.com/gnuwget/wget2/-/issues/567#note_1013916145
You're receiving this email because of your account on gitlab.com.