[Savannah-hackers-public] Mirmon can't reach some https and rsync mirrors

[Thérèse Godefroy]

Hello Bob, hello all,

At the beginning of June, you updated the CA certificates on the machine
that hosts Mirmon, and this resolved the issue for all https mirrors.
But around July 17, one of them became unreachable again:
      https://ftp.sotirov-bg.net/pub/mirrors/gnu/

There is also this old story of 2 rsync mirrors that Mirmon can only
reach 3 or 4 times a year:
      mirror2.evolution-host.com::gnu
      mirrors.syringanetworks.net::gnu

Here is what I get with rsync 3.1.3 (protocol version 31):

* The rsync connection with evolution-host.com is very slow. There is a
30-second lag before anything happens on the terminal, but the file is 
eventually downloaded:
--------------
$ rsync -vvv mirror2.evolution-host.com::gnu/mirror-updated-timestamp.txt .
opening tcp connection to mirror2.evolution-host.com port 873
Connected to mirror2.evolution-host.com (66.70.142.124)
rsync: failed to connect to mirror2.evolution-host.com 
(2607:5300:60:450d:c259:13f4:6df0:1): Connection timed out (110)
sending daemon args: --server --sender -vvve.LsfxC . 
gnu/mirror-updated-timestamp.txt  (5 args)
recv_file_name(mirror-updated-timestamp.txt)
received 1 names
recv_file_list done
get_local_name count=1 .
generator starting pid=6338
delta-transmission enabled
recv_generator(mirror-updated-timestamp.txt,0)
generating and sending sums for 0
recv_files(1) starting
count=1 rem=11 blength=700 s2length=2 flength=11
generate_files phase=1
recv_files(mirror-updated-timestamp.txt)
mirror-updated-timestamp.txt
recv mapped mirror-updated-timestamp.txt of size 11
got file_sum
renaming .mirror-updated-timestamp.txt.Jxv5jw to 
mirror-updated-timestamp.txt
recv_files phase=1
generate_files phase=2
recv_files phase=2
recv_files finished
generate_files phase=3
generate_files finished

sent 49 bytes  received 110 bytes  4.89 bytes/sec
total size is 11  speedup is 0.07
[generator] _exit_cleanup(code=0, file=main.c, line=1677): about to call 
exit(0)
--------------

* Compare with another very slow mirror that is reachable by Mirmon 
(same 30-second lag as evolution-host.com):
--------------
$ rsync -vvv mirror.keystealth.org::gnu/mirror-updated-timestamp.txt .
opening tcp connection to mirror.keystealth.org port 873
Connected to mirror.keystealth.org (184.105.240.111)
rsync: failed to connect to mirror.keystealth.org 
(2001:470:1:863::110:2): Connection timed out (110)
sending daemon args: --server --sender -vvve.LsfxC . 
gnu/mirror-updated-timestamp.txt  (5 args)
Setting --timeout=900 to match server
recv_file_name(mirror-updated-timestamp.txt)
received 1 names
recv_file_list done
get_local_name count=1 .
generator starting pid=5694
delta-transmission enabled
recv_generator(mirror-updated-timestamp.txt,0)
recv_files(1) starting
generate_files phase=1
recv_files(mirror-updated-timestamp.txt)
mirror-updated-timestamp.txt
got file_sum
renaming .mirror-updated-timestamp.txt.p2MPQK to 
mirror-updated-timestamp.txt
recv_files phase=1
generate_files phase=2
recv_files phase=2
recv_files finished
generate_files phase=3
generate_files finished

sent 43 bytes  received 129 bytes  5.13 bytes/sec
total size is 11  speedup is 0.06
[generator] _exit_cleanup(code=0, file=main.c, line=1677): about to call 
exit(0)
--------------

Note the "Setting --timeout=" line, which is not in the output of
evolution-host.com.


* The problem seems to be different with syringanetworks. There is no 
lag and the overall speed is fine:
--------------
$ rsync -vvv mirrors.syringanetworks.net::gnu/mirror-updated-timestamp.txt .
opening tcp connection to mirrors.syringanetworks.net port 873
Connected to mirrors.syringanetworks.net (2605:5800:1:1::7)
sending daemon args: --server --sender -vvve.LsfxC . 
gnu/mirror-updated-timestamp.txt  (5 args)
recv_file_name(mirror-updated-timestamp.txt)
received 1 names
recv_file_list done
get_local_name count=1 .
generator starting pid=4588
delta-transmission enabled
recv_generator(mirror-updated-timestamp.txt,0)
recv_files(1) starting
generating and sending sums for 0
count=1 rem=11 blength=700 s2length=2 flength=11
generate_files phase=1
recv_files(mirror-updated-timestamp.txt)
mirror-updated-timestamp.txt
recv mapped mirror-updated-timestamp.txt of size 11
got file_sum
renaming .mirror-updated-timestamp.txt.P5tjTJ to 
mirror-updated-timestamp.txt
recv_files phase=1
generate_files phase=2
recv_files phase=2
recv_files finished
generate_files phase=3
generate_files finished

sent 49 bytes  received 120 bytes  67.60 bytes/sec
total size is 11  speedup is 0.07
[generator] _exit_cleanup(code=0, file=main.c, line=1677): about to call 
exit(0)
--------------

We can live with incomplete Mirmon reports, but if the https issue was 
fixed, ftpmirror.gnu.org would have another mirror to choose from.

Thanks in advance!

Best,
Thérèse