[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[Wp-mirror-list] Fwd: Issue getting the default configuration of wp-mirr
|
From: |
wp mirror |
|
Subject: |
[Wp-mirror-list] Fwd: Issue getting the default configuration of wp-mirror 0.6 to work |
|
Date: |
Sat, 16 Nov 2013 14:41:38 -0500 |
---------- Forwarded message ----------
From: Guy Castagnoli <address@hidden>
Date: Sat, 16 Nov 2013 13:17:31 +0100
Subject: RE: Issue getting the default configuration of wp-mirror 0.6 to work
To: wp mirror <address@hidden>
Kent,
have done the tests. The results are contained in the attachment. Also
compared the outcomes with curl on my SuSE installation which I'm much
more familiar with, which uses curl 7.25 (instead of debian wheezy's
7.26), and the outputs were - eventually - essentially the same.
In the attached Debian curl log, there is a strange line "* additional
stuff not fine transfer.c:1037: 0 0" but according to a google query,
it is a harmless debugging left-over that has not been removed from
all distributions..
The case " curl http://ftpmirror.your.org/pub/wikimedia/dumps/ "
produces, on additon of the redirection option "-L", the page I
initially encountered and mentioned to you and that seemed to me to be
no longer the desired page.
However on " curl
http://ftpmirror.your.org/pub/wikimedia/dumps/rsync-dirlist-last-1-good.txt
" the redirection option produced a 404 Page not found error..
Hope this will help us understand the source of this curious error..
Regards,
Guy
p.s.: at first, I had trouble getting Debian's curl 7.26.0 to behave
the same way as my opensuse's curl 7.25.0. But after an "aptitude
update" run on the Debian system which did hardly anything and then a
run of "aptitude full-upgrade" which apparently updated no packages,
they started to behave the same way. Before that, Debian's curl seemed
to have a problem with the scheme part "http://"; of the URLs. Now it
gives the same results with and without the "http://";, as the curl on
opensuse..
-----Original message-----
From:wp mirror <address@hidden>
Sent:Sat 16-11-2013 09:46
Subject:Re: Issue getting the default configuration of wp-mirror 0.6 to work
To:Guy Castagnoli <address@hidden>; Wp-mirror-list
<address@hidden>; wpmirrordev <address@hidden>;
Dear Guy,
I am glad wp-mirror ran to completion.
1) *wikimedia-site-xdump*
Thank you very much for the debug log regarding the default setting
for *wikimedia-site-xdump*. I have been unable to replicate the
error. So as a first step, I would like to try to distinguish whether
the error is with wp-mirror, curl, or some where between your platform
and <http://ftpmirror.your.org/>. I would very much appreciate if you
could run the following tests, and send me the output.
2) Test
(shell)$ curl http://foo
curl: (6) Couldn't resolve host 'foo'
(shell)$ curl http://ftpmirror.your.org/pub/wikimedia/dumps/
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd";>
<html xmlns="http://www.w3.org/1999/xhtml"; xml:lang="en" lang="en" dir="ltr">
...
</html>
(shell)$ curl
http://ftpmirror.your.org/pub/wikimedia/dumps/rsync-dirlist-last-1-good.txt
/cawikibooks/20131107
...
/svwikinews/20131115
Sincerely Yours,
Kent
On 11/12/13, Guy Castagnoli <address@hidden> wrote:
> Kent,
>
>
> many thanks for your response. Have installed your update, and it looks as
> if it's now working. wp-mirror is currently downloading 9.9GB of commonswiki
> and has scheduled about 2 hours and a quarter for that..
>
>
> Just a remark, relating to the entry for *wikimedia-site-xdump* : once
> again, the fsm had nothing to do running "wp-mirror --mirror" on the default
> configuration - am attaching the log of a run of wp-mirror --mirror --debug
> of that attempt. From looking at the log, it seems like curl isn't finding
> the file `rsync-dirlist-last-1-good.txt' that you mentioned.
>
> So, I gave it a try again with the ftp://ftpmirror.your.org entry by
> uncommenting it in /etc/wp-mirror/local.conf and now it's working..
>
>
> regards, and thanks again,
>
>
> Guy
>
>
> p.s.: shall certainly consult the tuning issues that you address in the
> Experiments section of the wp-mirror manual!
>
debian_curl_test
Description: Binary data
Message not available