wp-mirror-list
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Wp-mirror-list] Download issue with wp-mirror


From: Benjamin Goldsmith
Subject: [Wp-mirror-list] Download issue with wp-mirror
Date: Tue, 19 Mar 2013 18:23:07 -0400

Hello wp-mirror-list.

I'm back and trying out version 0.5 of wp-mirror on enwiki.  I'm very
excited to work on this project.

Here is what I have:

Dell PowerEdge 2950
8 GB RAM
Intel Xeon Dual Core Processor (2 CPU threads)
6 HDs:
  2 36GB SAS drives, /dev/sda, RAID 1, ext4, mount /
  2 300GB SAS drives, /dev/sdb, RAID 1, reiserfs, mount /var
  2 2 TB SATA drives, /dev/sdc, RAID 1, reiserfs, mount
/var/lib/mediawiki/images

The RAIDs are managed by the hardware, not the OS.

I did a wp-mirror --add en to add enwiki
I did a wp-mirror --drop simple to not mirror simplewiki

Then my attempts to run wp-mirror began:

1) The assert-hdd-write-cache-disabled-p check failed.  I made sure my
/etc/rc.local file had the lines:
hdparm -W0 /dev/sdb
hdparm -W0 /dev/sdc

But the check still failed.  So I commented out the call to that check
and re-ran wp-mirror.

2) Next wp-mirror attempts to download the .xml.bz2.  The file appears
in /var/lib/mediawiki/images/wp-mirror.  But after awhile wp-mirror
quits, the file is deleted, and I see the message:
[fail]fsm-file-download enwiki-20130304-pages-articles.xml.bz2

This happens every time.

3) I wget enwiki-20130304-pages-articles.xml.bz2 myself, and copy it
into /var/lib/mediawiki/images/wp-mirror.  Then I run wp-mirror.  It
runs for awhile, but then this happens:

[ ok ]fsm-file-wikix
enwiki-20130304-pages-articles-p005973000-c000001000.xml
[ ok ]fsm-file-count
enwiki-20130304-pages-articles-p005974000-c000001000.xml
[ ok ]fsm-file-md5sum
enwiki-20130304-pages-articles-p005974000-c000001000.xml
[....]fsm-file-wikix
enwiki-20130304-pages-articles-p005974000-c000001000.xml
*** - regexp:regexp-exec: argument eof is not a string

And it halts.

I wonder if step 1 is screwing up the rest?  Any insights are welcome.

Thank you in advance,
-Ben



reply via email to

[Prev in Thread] Current Thread [Next in Thread]