Re: [Duplicity-talk] Duplicity stops after 40 volumes

[Carlos Chavez]

On 9/2/14, 4:14 AM, address@hidden wrote:
> On 02.09.2014 00:12, Carlos Chavez wrote:
> >      I just installed a new CentOS 6.5 server with Duplicity 0.6.22 but I am 
> > having trouble completing the first full backup.  The backup stops every 40 
> > volumes.  So far had to restart it several times and it has stopped at 40, 80, 
> > 120 and 160.  I really cannot understand why it is doing that.  The network 
> > connection between the servers is fast and stable.  Here is the output of 
> > duplicity:
> >
> > Import of duplicity.backends.dpbxbackend Failed: No module named dropbox
> > Reading globbing filelist /root/backupinclude.txt
> > Local and Remote metadata are synchronized, no sync needed.
> > Last full backup left a partial set, restarting.
> > Last full backup date: Sun Aug 31 12:21:25 2014
> > RESTART: The first volume failed to upload before termination.
> >           Restart is impossible...starting backup from beginning.
> > Import of duplicity.backends.dpbxbackend Failed: No module named dropbox
> > Reading globbing filelist /root/backupinclude.txt
> > Local and Remote metadata are synchronized, no sync needed.
> > Last full backup date: none
> > Last full backup is too old, forcing full backup
> > No handlers could be found for logger "paramiko.transport"
> > sftp put of /tmp/duplicity-4AxEur-tempdir/mktemp-N6NWhN-42 (as 
> > duplicity-full.20140831T223248Z.vol41.difftar.gz) failed:  (Try 1 of 5) Will 
> > retry in 10 seconds.
> > sftp put of /tmp/duplicity-4AxEur-tempdir/mktemp-N6NWhN-42 (as 
> > duplicity-full.20140831T223248Z.vol41.difftar.gz) failed:  (Try 2 of 5) Will 
> > retry in 10 seconds.
> > sftp put of /tmp/duplicity-4AxEur-tempdir/mktemp-N6NWhN-42 (as 
> > duplicity-full.20140831T223248Z.vol41.difftar.gz) failed:  (Try 3 of 5) Will 
> > retry in 10 seconds.
> > sftp put of /tmp/duplicity-4AxEur-tempdir/mktemp-N6NWhN-42 (as 
> > duplicity-full.20140831T223248Z.vol41.difftar.gz) failed:  (Try 4 of 5) Will 
> > retry in 10 seconds.
> > sftp put of /tmp/duplicity-4AxEur-tempdir/mktemp-N6NWhN-42 (as 
> > duplicity-full.20140831T223248Z.vol41.difftar.gz) failed:  (Try 5 of 5) Will 
> > retry in 10 seconds.
> > BackendException: Giving up trying to upload 
> > 'duplicity-full.20140831T223248Z.vol41.difftar.gz' after 5 attempts
> > address@hidden ~]#
> > address@hidden ~]# /usr/bin/duplicity --no-encryption --full-if-older-than 7D 
> > --include-globbing-filelist /root/backupinclude.txt / 
> > ssh://telecomab.dyndns.org//respaldos/cabana
> > Import of duplicity.backends.dpbxbackend Failed: No module named dropbox
> > Reading globbing filelist /root/backupinclude.txt
> > Local and Remote metadata are synchronized, no sync needed.
> > Last full backup left a partial set, restarting.
> > Last full backup date: Sun Aug 31 17:32:48 2014
> > RESTART: Volumes 41 to 41 failed to upload before termination.
> >           Restarting backup at volume 41.
> > Restarting after volume 40, file 
> > home/circulobienesraices/homes/conchaazuara/Maildir/cur/1409498005.000044.mbox:2,RS,
> >  block 181
> > No handlers could be found for logger "paramiko.transport"
> > sftp put of /tmp/duplicity-a3mSS0-tempdir/mktemp-qM53j6-42 (as 
> > duplicity-full.20140831T223248Z.vol81.difftar.gz) failed: Server connection 
> > dropped:  (Try 1 of 5) Will retry in 10 seconds.
> > sftp put of /tmp/duplicity-a3mSS0-tempdir/mktemp-qM53j6-42 (as 
> > duplicity-full.20140831T223248Z.vol81.difftar.gz) failed:  (Try 2 of 5) Will 
> > retry in 10 seconds.
> > sftp put of /tmp/duplicity-a3mSS0-tempdir/mktemp-qM53j6-42 (as 
> > duplicity-full.20140831T223248Z.vol81.difftar.gz) failed:  (Try 3 of 5) Will 
> > retry in 10 seconds.
> > sftp put of /tmp/duplicity-a3mSS0-tempdir/mktemp-qM53j6-42 (as 
> > duplicity-full.20140831T223248Z.vol81.difftar.gz) failed:  (Try 4 of 5) Will 
> > retry in 10 seconds.
> > sftp put of /tmp/duplicity-a3mSS0-tempdir/mktemp-qM53j6-42 (as 
> > duplicity-full.20140831T223248Z.vol81.difftar.gz) failed:  (Try 5 of 5) Will 
> > retry in 10 seconds.
> > BackendException: Giving up trying to upload 
> > 'duplicity-full.20140831T223248Z.vol81.difftar.gz' after 5 attempts
> > address@hidden ~]# /usr/bin/duplicity --no-encryption --full-if-older-than 7D 
> > --include-globbing-filelist /root/backupinclude.txt / 
> > ssh://telecomab.dyndns.org//respaldos/cabana
> > Import of duplicity.backends.dpbxbackend Failed: No module named dropbox
> > Reading globbing filelist /root/backupinclude.txt
> > Local and Remote metadata are synchronized, no sync needed.
> > Last full backup left a partial set, restarting.
> > Last full backup date: Sun Aug 31 17:32:48 2014
> > RESTART: Volumes 81 to 81 failed to upload before termination.
> >           Restarting backup at volume 81.
> > Restarting after volume 80, file 
> > home/circulobienesraices/homes/doloresestrada/Maildir/.sent-mail/cur/1409498271.000672.mbox:2,S,
> >  block 11
> > No handlers could be found for logger "paramiko.transport"
> > sftp put of /tmp/duplicity-Jm9zjA-tempdir/mktemp-GwwkhD-42 (as 
> > duplicity-full.20140831T223248Z.vol121.difftar.gz) failed: Server connection 
> > dropped:  (Try 1 of 5) Will retry in 10 seconds.
> > sftp put of /tmp/duplicity-Jm9zjA-tempdir/mktemp-GwwkhD-42 (as 
> > duplicity-full.20140831T223248Z.vol121.difftar.gz) failed:  (Try 2 of 5) Will 
> > retry in 10 seconds.
> > sftp put of /tmp/duplicity-Jm9zjA-tempdir/mktemp-GwwkhD-42 (as 
> > duplicity-full.20140831T223248Z.vol121.difftar.gz) failed:  (Try 3 of 5) Will 
> > retry in 10 seconds.
> > sftp put of /tmp/duplicity-Jm9zjA-tempdir/mktemp-GwwkhD-42 (as 
> > duplicity-full.20140831T223248Z.vol121.difftar.gz) failed:  (Try 4 of 5) Will 
> > retry in 10 seconds.
> > sftp put of /tmp/duplicity-Jm9zjA-tempdir/mktemp-GwwkhD-42 (as 
> > duplicity-full.20140831T223248Z.vol121.difftar.gz) failed:  (Try 5 of 5) Will 
> > retry in 10 seconds.
> > BackendException: Giving up trying to upload 
> > 'duplicity-full.20140831T223248Z.vol121.difftar.gz' after 5 attempts
> > address@hidden ~]# /usr/bin/duplicity --no-encryption --full-if-older-than 7D 
> > --include-globbing-filelist /root/backupinclude.txt / 
> > ssh://telecomab.dyndns.org//respaldos/cabana
> > Import of duplicity.backends.dpbxbackend Failed: No module named dropbox
> > Reading globbing filelist /root/backupinclude.txt
> > Local and Remote metadata are synchronized, no sync needed.
> > Last full backup left a partial set, restarting.
> > Last full backup date: Sun Aug 31 17:32:48 2014
> > RESTART: Volumes 121 to 121 failed to upload before termination.
> >           Restarting backup at volume 121.
> > Restarting after volume 120, file 
> > home/circulobienesraices/homes/edelamora/Maildir/cur/1409498342.000415.mbox:2,S,
> >  block 7
> > No handlers could be found for logger "paramiko.transport"
> > sftp put of /tmp/duplicity-akynaz-tempdir/mktemp-lxSklg-42 (as 
> > duplicity-full.20140831T223248Z.vol161.difftar.gz) failed: Server connection 
> > dropped:  (Try 1 of 5) Will retry in 10 seconds.
> > sftp put of /tmp/duplicity-akynaz-tempdir/mktemp-lxSklg-42 (as 
> > duplicity-full.20140831T223248Z.vol161.difftar.gz) failed:  (Try 2 of 5) Will 
> > retry in 10 seconds.
> > sftp put of /tmp/duplicity-akynaz-tempdir/mktemp-lxSklg-42 (as 
> > duplicity-full.20140831T223248Z.vol161.difftar.gz) failed:  (Try 3 of 5) Will 
> > retry in 10 seconds.
> > sftp put of /tmp/duplicity-akynaz-tempdir/mktemp-lxSklg-42 (as 
> > duplicity-full.20140831T223248Z.vol161.difftar.gz) failed:  (Try 4 of 5) Will 
> > retry in 10 seconds.
> > sftp put of /tmp/duplicity-akynaz-tempdir/mktemp-lxSklg-42 (as 
> > duplicity-full.20140831T223248Z.vol161.difftar.gz) failed:  (Try 5 of 5) Will 
> > retry in 10 seconds.
> > BackendException: Giving up trying to upload 
> > 'duplicity-full.20140831T223248Z.vol161.difftar.gz' after 5 attempts
> smells like a backend issue. first update to latest duplicity 0.6.24 to make 
> sure this is a bug already fixed.
>
> try updating your local python paramiko, if possible.
>
> a quick workaround might be to use '--ssh-backend pexpect' to use the legacy 
> ssh backend.
>
> ..ede/duply.net
    Ok, I compiled 0.6.24 and now I get this error when it stops after 
40 volumes:

Reading globbing filelist /root/backupinclude.txt
Local and Remote metadata are synchronized, no sync needed.
Last full backup left a partial set, restarting.
Last full backup date: Sun Aug 31 17:32:48 2014
RESTART: Volumes 281 to 281 failed to upload before termination.
         Restarting backup at volume 281.
Restarting after volume 280, file 
home/circulobienesraices/homes/lucero/Maildir/.saved-messages/cur/1409498839.000018.mbox:2,S, 
block 94
ssh: Exception: Remote transport is ignoring rekey requests
ssh: Traceback (most recent call last):
ssh:   File "/usr/lib/python2.6/site-packages/paramiko/transport.py", 
line 1517, in run
ssh:     ptype, m = self.packetizer.read_message()
ssh:   File "/usr/lib/python2.6/site-packages/paramiko/packet.py", line 
381, in read_message
ssh:     raise SSHException('Remote transport is ignoring rekey requests')
ssh: SSHException: Remote transport is ignoring rekey requests
ssh:
sftp put of /tmp/duplicity-f53sta-tempdir/mktemp-zem2en-42 (as 
duplicity-full.20140831T223248Z.vol321.difftar.gz) failed: Server 
connection dropped:  (Try 1 of 5) Will retry in 10 seconds.
sftp put of /tmp/duplicity-f53sta-tempdir/mktemp-zem2en-42 (as 
duplicity-full.20140831T223248Z.vol321.difftar.gz) failed:  (Try 2 of 5) 
Will retry in 10 seconds.
sftp put of /tmp/duplicity-f53sta-tempdir/mktemp-zem2en-42 (as 
duplicity-full.20140831T223248Z.vol321.difftar.gz) failed:  (Try 3 of 5) 
Will retry in 10 seconds.
sftp put of /tmp/duplicity-f53sta-tempdir/mktemp-zem2en-42 (as 
duplicity-full.20140831T223248Z.vol321.difftar.gz) failed:  (Try 4 of 5) 
Will retry in 10 seconds.
sftp put of /tmp/duplicity-f53sta-tempdir/mktemp-zem2en-42 (as 
duplicity-full.20140831T223248Z.vol321.difftar.gz) failed:  (Try 5 of 5) 
Will retry in 10 seconds.
BackendException: Giving up trying to upload 
'duplicity-full.20140831T223248Z.vol321.difftar.gz' after 5 attempts


--
Telecomunicaciones Abiertas de México S.A. de C.V.
Carlos Chávez
+52 (55)9116-91161