Re: [Duplicity-talk] Duplicity stops after 40 volumes

[edgar . soldin]

On 03.09.2014 20:19, Carlos Chavez wrote:
> On 9/2/14, 4:14 AM, address@hidden wrote:
>> On 02.09.2014 00:12, Carlos Chavez wrote:
>>>      I just installed a new CentOS 6.5 server with Duplicity 0.6.22 but I 
>>> am having trouble completing the first full backup.  The backup stops every 
>>> 40 volumes.  So far had to restart it several times and it has stopped at 
>>> 40, 80, 120 and 160.  I really cannot understand why it is doing that.  The 
>>> network connection between the servers is fast and stable.  Here is the 
>>> output of duplicity:
>>>
>>> Import of duplicity.backends.dpbxbackend Failed: No module named dropbox
>>> Reading globbing filelist /root/backupinclude.txt
>>> Local and Remote metadata are synchronized, no sync needed.
>>> Last full backup left a partial set, restarting.
>>> Last full backup date: Sun Aug 31 12:21:25 2014
>>> RESTART: The first volume failed to upload before termination.
>>>           Restart is impossible...starting backup from beginning.
>>> Import of duplicity.backends.dpbxbackend Failed: No module named dropbox
>>> Reading globbing filelist /root/backupinclude.txt
>>> Local and Remote metadata are synchronized, no sync needed.
>>> Last full backup date: none
>>> Last full backup is too old, forcing full backup
>>> No handlers could be found for logger "paramiko.transport"
>>> sftp put of /tmp/duplicity-4AxEur-tempdir/mktemp-N6NWhN-42 (as 
>>> duplicity-full.20140831T223248Z.vol41.difftar.gz) failed:  (Try 1 of 5) 
>>> Will retry in 10 seconds.
>>> sftp put of /tmp/duplicity-4AxEur-tempdir/mktemp-N6NWhN-42 (as 
>>> duplicity-full.20140831T223248Z.vol41.difftar.gz) failed:  (Try 2 of 5) 
>>> Will retry in 10 seconds.
>>> sftp put of /tmp/duplicity-4AxEur-tempdir/mktemp-N6NWhN-42 (as 
>>> duplicity-full.20140831T223248Z.vol41.difftar.gz) failed:  (Try 3 of 5) 
>>> Will retry in 10 seconds.
>>> sftp put of /tmp/duplicity-4AxEur-tempdir/mktemp-N6NWhN-42 (as 
>>> duplicity-full.20140831T223248Z.vol41.difftar.gz) failed:  (Try 4 of 5) 
>>> Will retry in 10 seconds.
>>> sftp put of /tmp/duplicity-4AxEur-tempdir/mktemp-N6NWhN-42 (as 
>>> duplicity-full.20140831T223248Z.vol41.difftar.gz) failed:  (Try 5 of 5) 
>>> Will retry in 10 seconds.
>>> BackendException: Giving up trying to upload 
>>> 'duplicity-full.20140831T223248Z.vol41.difftar.gz' after 5 attempts
>>> address@hidden ~]#
>>> address@hidden ~]# /usr/bin/duplicity --no-encryption --full-if-older-than 
>>> 7D --include-globbing-filelist /root/backupinclude.txt / 
>>> ssh://telecomab.dyndns.org//respaldos/cabana
>>> Import of duplicity.backends.dpbxbackend Failed: No module named dropbox
>>> Reading globbing filelist /root/backupinclude.txt
>>> Local and Remote metadata are synchronized, no sync needed.
>>> Last full backup left a partial set, restarting.
>>> Last full backup date: Sun Aug 31 17:32:48 2014
>>> RESTART: Volumes 41 to 41 failed to upload before termination.
>>>           Restarting backup at volume 41.
>>> Restarting after volume 40, file 
>>> home/circulobienesraices/homes/conchaazuara/Maildir/cur/1409498005.000044.mbox:2,RS,
>>>  block 181
>>> No handlers could be found for logger "paramiko.transport"
>>> sftp put of /tmp/duplicity-a3mSS0-tempdir/mktemp-qM53j6-42 (as 
>>> duplicity-full.20140831T223248Z.vol81.difftar.gz) failed: Server connection 
>>> dropped:  (Try 1 of 5) Will retry in 10 seconds.
>>> sftp put of /tmp/duplicity-a3mSS0-tempdir/mktemp-qM53j6-42 (as 
>>> duplicity-full.20140831T223248Z.vol81.difftar.gz) failed:  (Try 2 of 5) 
>>> Will retry in 10 seconds.
>>> sftp put of /tmp/duplicity-a3mSS0-tempdir/mktemp-qM53j6-42 (as 
>>> duplicity-full.20140831T223248Z.vol81.difftar.gz) failed:  (Try 3 of 5) 
>>> Will retry in 10 seconds.
>>> sftp put of /tmp/duplicity-a3mSS0-tempdir/mktemp-qM53j6-42 (as 
>>> duplicity-full.20140831T223248Z.vol81.difftar.gz) failed:  (Try 4 of 5) 
>>> Will retry in 10 seconds.
>>> sftp put of /tmp/duplicity-a3mSS0-tempdir/mktemp-qM53j6-42 (as 
>>> duplicity-full.20140831T223248Z.vol81.difftar.gz) failed:  (Try 5 of 5) 
>>> Will retry in 10 seconds.
>>> BackendException: Giving up trying to upload 
>>> 'duplicity-full.20140831T223248Z.vol81.difftar.gz' after 5 attempts
>>> address@hidden ~]# /usr/bin/duplicity --no-encryption --full-if-older-than 
>>> 7D --include-globbing-filelist /root/backupinclude.txt / 
>>> ssh://telecomab.dyndns.org//respaldos/cabana
>>> Import of duplicity.backends.dpbxbackend Failed: No module named dropbox
>>> Reading globbing filelist /root/backupinclude.txt
>>> Local and Remote metadata are synchronized, no sync needed.
>>> Last full backup left a partial set, restarting.
>>> Last full backup date: Sun Aug 31 17:32:48 2014
>>> RESTART: Volumes 81 to 81 failed to upload before termination.
>>>           Restarting backup at volume 81.
>>> Restarting after volume 80, file 
>>> home/circulobienesraices/homes/doloresestrada/Maildir/.sent-mail/cur/1409498271.000672.mbox:2,S,
>>>  block 11
>>> No handlers could be found for logger "paramiko.transport"
>>> sftp put of /tmp/duplicity-Jm9zjA-tempdir/mktemp-GwwkhD-42 (as 
>>> duplicity-full.20140831T223248Z.vol121.difftar.gz) failed: Server 
>>> connection dropped:  (Try 1 of 5) Will retry in 10 seconds.
>>> sftp put of /tmp/duplicity-Jm9zjA-tempdir/mktemp-GwwkhD-42 (as 
>>> duplicity-full.20140831T223248Z.vol121.difftar.gz) failed:  (Try 2 of 5) 
>>> Will retry in 10 seconds.
>>> sftp put of /tmp/duplicity-Jm9zjA-tempdir/mktemp-GwwkhD-42 (as 
>>> duplicity-full.20140831T223248Z.vol121.difftar.gz) failed:  (Try 3 of 5) 
>>> Will retry in 10 seconds.
>>> sftp put of /tmp/duplicity-Jm9zjA-tempdir/mktemp-GwwkhD-42 (as 
>>> duplicity-full.20140831T223248Z.vol121.difftar.gz) failed:  (Try 4 of 5) 
>>> Will retry in 10 seconds.
>>> sftp put of /tmp/duplicity-Jm9zjA-tempdir/mktemp-GwwkhD-42 (as 
>>> duplicity-full.20140831T223248Z.vol121.difftar.gz) failed:  (Try 5 of 5) 
>>> Will retry in 10 seconds.
>>> BackendException: Giving up trying to upload 
>>> 'duplicity-full.20140831T223248Z.vol121.difftar.gz' after 5 attempts
>>> address@hidden ~]# /usr/bin/duplicity --no-encryption --full-if-older-than 
>>> 7D --include-globbing-filelist /root/backupinclude.txt / 
>>> ssh://telecomab.dyndns.org//respaldos/cabana
>>> Import of duplicity.backends.dpbxbackend Failed: No module named dropbox
>>> Reading globbing filelist /root/backupinclude.txt
>>> Local and Remote metadata are synchronized, no sync needed.
>>> Last full backup left a partial set, restarting.
>>> Last full backup date: Sun Aug 31 17:32:48 2014
>>> RESTART: Volumes 121 to 121 failed to upload before termination.
>>>           Restarting backup at volume 121.
>>> Restarting after volume 120, file 
>>> home/circulobienesraices/homes/edelamora/Maildir/cur/1409498342.000415.mbox:2,S,
>>>  block 7
>>> No handlers could be found for logger "paramiko.transport"
>>> sftp put of /tmp/duplicity-akynaz-tempdir/mktemp-lxSklg-42 (as 
>>> duplicity-full.20140831T223248Z.vol161.difftar.gz) failed: Server 
>>> connection dropped:  (Try 1 of 5) Will retry in 10 seconds.
>>> sftp put of /tmp/duplicity-akynaz-tempdir/mktemp-lxSklg-42 (as 
>>> duplicity-full.20140831T223248Z.vol161.difftar.gz) failed:  (Try 2 of 5) 
>>> Will retry in 10 seconds.
>>> sftp put of /tmp/duplicity-akynaz-tempdir/mktemp-lxSklg-42 (as 
>>> duplicity-full.20140831T223248Z.vol161.difftar.gz) failed:  (Try 3 of 5) 
>>> Will retry in 10 seconds.
>>> sftp put of /tmp/duplicity-akynaz-tempdir/mktemp-lxSklg-42 (as 
>>> duplicity-full.20140831T223248Z.vol161.difftar.gz) failed:  (Try 4 of 5) 
>>> Will retry in 10 seconds.
>>> sftp put of /tmp/duplicity-akynaz-tempdir/mktemp-lxSklg-42 (as 
>>> duplicity-full.20140831T223248Z.vol161.difftar.gz) failed:  (Try 5 of 5) 
>>> Will retry in 10 seconds.
>>> BackendException: Giving up trying to upload 
>>> 'duplicity-full.20140831T223248Z.vol161.difftar.gz' after 5 attempts
>>>
>> smells like a backend issue. first update to latest duplicity 0.6.24 to make 
>> sure this is a bug already fixed.
>>
>> try updating your local python paramiko, if possible.
>>
>> a quick workaround might be to use '--ssh-backend pexpect' to use the legacy 
>> ssh backend.
>>
>> ..ede/duply.net
>>
>>
>>
>     Ok, I compiled 0.6.24 and now I get this error when it stops after 40 
> volumes:
> 
> Reading globbing filelist /root/backupinclude.txt
> Local and Remote metadata are synchronized, no sync needed.
> Last full backup left a partial set, restarting.
> Last full backup date: Sun Aug 31 17:32:48 2014
> RESTART: Volumes 281 to 281 failed to upload before termination.
>          Restarting backup at volume 281.
> Restarting after volume 280, file 
> home/circulobienesraices/homes/lucero/Maildir/.saved-messages/cur/1409498839.000018.mbox:2,S,
>  block 94
> ssh: Exception: Remote transport is ignoring rekey requests
> ssh: Traceback (most recent call last):
> ssh:   File "/usr/lib/python2.6/site-packages/paramiko/transport.py", line 
> 1517, in run
> ssh:     ptype, m = self.packetizer.read_message()
> ssh:   File "/usr/lib/python2.6/site-packages/paramiko/packet.py", line 381, 
> in read_message
> ssh:     raise SSHException('Remote transport is ignoring rekey requests')
> ssh: SSHException: Remote transport is ignoring rekey requests
> ssh:
> sftp put of /tmp/duplicity-f53sta-tempdir/mktemp-zem2en-42 (as 
> duplicity-full.20140831T223248Z.vol321.difftar.gz) failed: Server connection 
> dropped:  (Try 1 of 5) Will retry in 10 seconds.
> sftp put of /tmp/duplicity-f53sta-tempdir/mktemp-zem2en-42 (as 
> duplicity-full.20140831T223248Z.vol321.difftar.gz) failed:  (Try 2 of 5) Will 
> retry in 10 seconds.
> sftp put of /tmp/duplicity-f53sta-tempdir/mktemp-zem2en-42 (as 
> duplicity-full.20140831T223248Z.vol321.difftar.gz) failed:  (Try 3 of 5) Will 
> retry in 10 seconds.
> sftp put of /tmp/duplicity-f53sta-tempdir/mktemp-zem2en-42 (as 
> duplicity-full.20140831T223248Z.vol321.difftar.gz) failed:  (Try 4 of 5) Will 
> retry in 10 seconds.
> sftp put of /tmp/duplicity-f53sta-tempdir/mktemp-zem2en-42 (as 
> duplicity-full.20140831T223248Z.vol321.difftar.gz) failed:  (Try 5 of 5) Will 
> retry in 10 seconds.
> BackendException: Giving up trying to upload 
> 'duplicity-full.20140831T223248Z.vol321.difftar.gz' after 5 attempts
> 
> 

did you try to google it? seems to be a paramiko issue
https://github.com/paramiko/paramiko/issues/49

..ede/duply.net