duplicity-talk
[Top][All Lists]
Advanced
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Duplicity-talk] Duplicity error message/traceback

From: Joe Auty
Subject: Re: [Duplicity-talk] Duplicity error message/traceback
Date: Wed, 19 Sep 2012 00:37:21 -0400
User-agent: Postbox 3.0.5 (Macintosh/20120826)
Hmmm.. For some reason my cache doesn't have files ending with difftar.gpg:

# ls *
a67fc78086219ec50c01ba4b23c7cc96:

c7fe99c17ad6b9f4050106dfd1267dce:
duplicity-full.20120915T071457Z.manifest  duplicity-full-signatures.20120915T071457Z.sigtar.gz

dff4abdd3f1f0ba52de0cae7860641d6:

f1c2e1f58d8be01f446d36ae1fec6831:
duplicity-full.20110803T073117Z.manifest
duplicity-full-signatures.20110803T073117Z.sigtar.gz
duplicity-inc.20110803T073117Z.to.20110805T000912Z.manifest
duplicity-new-signatures.20110803T073117Z.to.20110805T000912Z.sigtar.gz


Turning the cache folder over (and it is not running out of space, there is tons available), I'm still getting the same error. I'll post stuff to Pastebin shortly for you guys to see more of the output.
September 18, 2012 10:41 PM
Joe, it looks like the error is happening when trying to read an
existing signature tarfile, which is something duplicity uses
internally to determine which files have changed and such.
(.sigtar.gpg files)

You might have lots of those files. It would help to see which one is
causing you pain. You'll have two copies of each, one in your cache
and one in Amazon S3. For now, let's look at the ones in the cache.

** Brief aside, if you move ~/.cache/duplicity aside (*Do not delete,
and move it back after testing this*), do you get the same behavior
when you try your backup command?

So let's try to find which of your existing cache sigtar files might be bogus:

cd ~/.cache/duplicity/* (whichever cache directory is being used here)
gpg --multifile --decrypt duplicity*signatures.*.*.difftar.gpg
for t in duplicity-full.20110127T131352Z.*.difftar; do tar xf $t; done

This is rather a shotgun approach, that will decrypt and untar all
your signature files. You can delete them safely afterward, I'm just
trying to see which, if any, tar will complain about.

-mt

_______________________________________________
Duplicity-talk mailing list
address@hidden
https://lists.nongnu.org/mailman/listinfo/duplicity-talk
September 18, 2012 3:15 PM
well, yes.. i need to see what is going on: espeially command line and maybe 100 lines before the stack.. something like that. you can as well just attach a compressed file if pastebin says it's to big.

..ede

_______________________________________________
Duplicity-talk mailing list
address@hidden
https://lists.nongnu.org/mailman/listinfo/duplicity-talk
September 18, 2012 1:25 PM
It's an absolutely massive backup, do you mean this literally? Everything before the snipped stuff was just pages upon pages of file comparison output. There was nothing unusual immediately before the Pastebin output other than another file comparison.



_______________________________________________
Duplicity-talk mailing list
address@hidden
https://lists.nongnu.org/mailman/listinfo/duplicity-talk
September 18, 2012 5:18 AM
sorry.. i need the _full_ output.. ede

_______________________________________________
Duplicity-talk mailing list
address@hidden
https://lists.nongnu.org/mailman/listinfo/duplicity-talk
September 18, 2012 5:15 AM
September 18, 2012 4:00 AM
please do your backup with debug verbosity '-v9' and post the complete output (obfuscate private strings) to püastebin and post the link.

Thanks in advance for your help!

http://pastebin.com/F6USYLQG

ede/duply.net

_______________________________________________
Duplicity-talk mailing list
address@hidden
https://lists.nongnu.org/mailman/listinfo/duplicity-talk
September 18, 2012 3:52 AM
After upgrading to Duplicity 0.6.19 I'm still getting the same error as below:

Is it possible my backup is corrupt or something? I also downgraded back to Python 2.6 and the stable Debian Python packages, to no avail.





_______________________________________________
Duplicity-talk mailing list
address@hidden
https://lists.nongnu.org/mailman/listinfo/duplicity-talk
September 17, 2012 5:23 PM
September 17, 2012 3:49 PM

https://bugs.launchpad.net/duplicity/+bug/642279
claims that this is probably fixed in 0.6.16 .. in any case please use the latest stable 0.6.19 and see if the error persists
Thanks! I didn't know what to search for to research this error further.

0.6.18 appears to be the latest version available in Debian right now, and I'm getting a different error message there, search "ReadError: missing or bad subsequent header" in Launchpad doesn't turn up anything... Any ideas, before I look for a 0.6.19 package or aim to compile my own?

Import of duplicity.backends.giobackend Failed: No module named gio
Local and Remote metadata are synchronized, no sync needed.
Last full backup date: Sat Sep 15 03:14:57 2012
Reuse configured PASSPHRASE as SIGN_PASSPHRASE
Traceback (most recent call last):
  File "/usr/bin/duplicity", line 1404, in <module>
    with_tempdir(main)
  File "/usr/bin/duplicity", line 1397, in with_tempdir
    fn()
  File "/usr/bin/duplicity", line 1379, in main
    incremental_backup(sig_chain)
  File "/usr/bin/duplicity", line 574, in incremental_backup
    globals.backend)
  File "/usr/bin/duplicity", line 380, in write_multivol
    globals.gpg_profile, globals.volsize)
  File "/usr/lib/python2.7/dist-packages/duplicity/gpg.py", line 320, in GPGWriteFile
    data = "" bytes_to_go)).data
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 507, in next
    result = self.process(self.input_iter.next(), size)
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 188, in get_delta_iter
    for new_path, sig_path in collated:
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 277, in collate2iters
    relem2 = riter2.next()
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 346, in combine_path_iters
    refresh_triple_list(triple_list)
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 332, in refresh_triple_list
    new_triple = get_triple(old_triple[1])
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 318, in get_triple
    path = path_iter_list[iter_index].next()
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 230, in sigtar2path_iter
    for tarinfo in tf:
  File "/usr/lib/python2.7/dist-packages/duplicity/tarfile.py", line 2472, in next
    tarinfo = self.tarfile.next()
  File "/usr/lib/python2.7/dist-packages/duplicity/tarfile.py", line 2345, in next
    raise ReadError(str(e))
ReadError: missing or bad subsequent header


..ede

_______________________________________________
Duplicity-talk mailing list
address@hidden
https://lists.nongnu.org/mailman/listinfo/duplicity-talk
September 17, 2012 3:36 PM
Hello,

Running the following command is now producing this error message consistently... Any ideas what is causing this and what I can do to fix this? I'm using version 0.6.15.

duplicity --full-if-older-than 3M --tempdir ${TEMPDIR} --archive-dir ${ARCHIVEDIR} --gpg-options "--compress-algo=bzip2 --bzip2-compress-level=9" --asynchronous-upload --encrypt-key=${GPG_KEY} --sign-key=${GPG_KEY} --s3-use-rrs --s3-use-new-style ${SOURCE} ${DEST}

these variables, of course, have values.



Local and Remote metadata are synchronized, no sync needed.
Last full backup date: Sat Sep 15 03:14:57 2012
No old backup sets found, nothing deleted.
Local and Remote metadata are synchronized, no sync needed.
Last full backup date: Sat Sep 15 03:14:57 2012
Reuse configured PASSPHRASE as SIGN_PASSPHRASE
Traceback (most recent call last):
  File "/usr/bin/duplicity", line 1344, in <module>
    with_tempdir(main)
  File "/usr/bin/duplicity", line 1327, in with_tempdir
    fn()
  File "/usr/bin/duplicity", line 1309, in main
    incremental_backup(sig_chain)
  File "/usr/bin/duplicity", line 526, in incremental_backup
    globals.backend)
  File "/usr/bin/duplicity", line 333, in write_multivol
    globals.gpg_profile, globals.volsize)
  File "/usr/lib/python2.7/dist-packages/duplicity/gpg.py", line 294, in GPGWriteFile
    data = "" bytes_to_go)).data
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 509, in next
    result = self.process(self.input_iter.next(), size)
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 187, in get_delta_iter
    for new_path, sig_path in collated:
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 275, in collate2iters
    relem2 = riter2.next()
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 344, in combine_path_iters
    refresh_triple_list(triple_list)
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 330, in refresh_triple_list
    new_triple = get_triple(old_triple[1])
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 316, in get_triple
    path = path_iter_list[iter_index].next()
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 229, in sigtar2path_iter
    for tarinfo in tf:
  File "/usr/lib/python2.7/dist-packages/duplicity/tarfile.py", line 1214, in next
    tarinfo = self.tarfile.next()
  File "/usr/lib/python2.7/dist-packages/duplicity/tarfile.py", line 564, in next
    tarinfo = self._proc_gnulong(tarinfo, tarinfo.type)
  File "/usr/lib/python2.7/dist-packages/duplicity/tarfile.py", line 1113, in _proc_gnulong
    tarinfo = self._buftoinfo(buf)
  File "/usr/lib/python2.7/dist-packages/duplicity/tarfile.py", line 1068, in _buftoinfo
    tarinfo.mode = int(buf[100:107], 8)
ValueError: invalid literal for int() with base 8: '\x00\x00\x00\x00\x00\x00\x00'


_______________________________________________
Duplicity-talk mailing list
address@hidden
https://lists.nongnu.org/mailman/listinfo/duplicity-talk


_______________________________________________
Duplicity-talk mailing list
address@hidden
https://lists.nongnu.org/mailman/listinfo/duplicity-talk
September 17, 2012 3:49 PM

https://bugs.launchpad.net/duplicity/+bug/642279
claims that this is probably fixed in 0.6.16 .. in any case please use the latest stable 0.6.19 and see if the error persists

..ede

_______________________________________________
Duplicity-talk mailing list
address@hidden
https://lists.nongnu.org/mailman/listinfo/duplicity-talk
September 17, 2012 3:36 PM
Hello,

Running the following command is now producing this error message consistently... Any ideas what is causing this and what I can do to fix this? I'm using version 0.6.15.

duplicity --full-if-older-than 3M --tempdir ${TEMPDIR} --archive-dir ${ARCHIVEDIR} --gpg-options "--compress-algo=bzip2 --bzip2-compress-level=9" --asynchronous-upload --encrypt-key=${GPG_KEY} --sign-key=${GPG_KEY} --s3-use-rrs --s3-use-new-style ${SOURCE} ${DEST}

these variables, of course, have values.



Local and Remote metadata are synchronized, no sync needed.
Last full backup date: Sat Sep 15 03:14:57 2012
No old backup sets found, nothing deleted.
Local and Remote metadata are synchronized, no sync needed.
Last full backup date: Sat Sep 15 03:14:57 2012
Reuse configured PASSPHRASE as SIGN_PASSPHRASE
Traceback (most recent call last):
  File "/usr/bin/duplicity", line 1344, in <module>
    with_tempdir(main)
  File "/usr/bin/duplicity", line 1327, in with_tempdir
    fn()
  File "/usr/bin/duplicity", line 1309, in main
    incremental_backup(sig_chain)
  File "/usr/bin/duplicity", line 526, in incremental_backup
    globals.backend)
  File "/usr/bin/duplicity", line 333, in write_multivol
    globals.gpg_profile, globals.volsize)
  File "/usr/lib/python2.7/dist-packages/duplicity/gpg.py", line 294, in GPGWriteFile
    data = "" bytes_to_go)).data
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 509, in next
    result = self.process(self.input_iter.next(), size)
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 187, in get_delta_iter
    for new_path, sig_path in collated:
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 275, in collate2iters
    relem2 = riter2.next()
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 344, in combine_path_iters
    refresh_triple_list(triple_list)
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 330, in refresh_triple_list
    new_triple = get_triple(old_triple[1])
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 316, in get_triple
    path = path_iter_list[iter_index].next()
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 229, in sigtar2path_iter
    for tarinfo in tf:
  File "/usr/lib/python2.7/dist-packages/duplicity/tarfile.py", line 1214, in next
    tarinfo = self.tarfile.next()
  File "/usr/lib/python2.7/dist-packages/duplicity/tarfile.py", line 564, in next
    tarinfo = self._proc_gnulong(tarinfo, tarinfo.type)
  File "/usr/lib/python2.7/dist-packages/duplicity/tarfile.py", line 1113, in _proc_gnulong
    tarinfo = self._buftoinfo(buf)
  File "/usr/lib/python2.7/dist-packages/duplicity/tarfile.py", line 1068, in _buftoinfo
    tarinfo.mode = int(buf[100:107], 8)
ValueError: invalid literal for int() with base 8: '\x00\x00\x00\x00\x00\x00\x00'


_______________________________________________
Duplicity-talk mailing list
address@hidden
https://lists.nongnu.org/mailman/listinfo/duplicity-talk


_______________________________________________
Duplicity-talk mailing list
address@hidden
https://lists.nongnu.org/mailman/listinfo/duplicity-talk


--
Joe Auty, NetMusician
NetMusician helps musicians, bands and artists create beautiful, professional, custom designed, career-essential websites that are easy to maintain and to integrate with popular social networks.
www.netmusician.org
address@hidden

reply via email to
[Prev in Thread] Current Thread [Next in Thread]