Re: [Duplicity-talk] Duplicity error message/traceback

[Joe Auty]

It's an absolutely massive backup, do you mean this literally? Everything before the snipped stuff was just pages upon pages of file comparison output. There was nothing unusual immediately before the Pastebin output other than another file comparison.

address@hidden

September 18, 2012 5:18 AM

sorry.. i need the _full_ output.. ede

_______________________________________________
Duplicity-talk mailing list
address@hidden
https://lists.nongnu.org/mailman/listinfo/duplicity-talk

Joe Auty

September 18, 2012 5:15 AM

address@hidden

September 18, 2012 4:00 AM

please do your backup with debug verbosity '-v9' and post the complete output (obfuscate private strings) to püastebin and post the link.

Thanks in advance for your help!

http://pastebin.com/F6USYLQG

ede/duply.net

_______________________________________________
Duplicity-talk mailing list
address@hidden
https://lists.nongnu.org/mailman/listinfo/duplicity-talk

Joe Auty

September 18, 2012 3:52 AM

After upgrading to Duplicity 0.6.19 I'm still getting the same error as below:

Is it possible my backup is corrupt or something? I also downgraded back to Python 2.6 and the stable Debian Python packages, to no avail.

_______________________________________________
Duplicity-talk mailing list
address@hidden
https://lists.nongnu.org/mailman/listinfo/duplicity-talk

Joe Auty

September 17, 2012 5:23 PM

address@hidden

September 17, 2012 3:49 PM

https://bugs.launchpad.net/duplicity/+bug/642279
claims that this is probably fixed in 0.6.16 .. in any case please use the latest stable 0.6.19 and see if the error persists

Thanks! I didn't know what to search for to research this error further.

0.6.18 appears to be the latest version available in Debian right now, and I'm getting a different error message there, search "ReadError: missing or bad subsequent header" in Launchpad doesn't turn up anything... Any ideas, before I look for a 0.6.19 package or aim to compile my own?

Import of duplicity.backends.giobackend Failed: No module named gio
Local and Remote metadata are synchronized, no sync needed.
Last full backup date: Sat Sep 15 03:14:57 2012
Reuse configured PASSPHRASE as SIGN_PASSPHRASE
Traceback (most recent call last):
  File "/usr/bin/duplicity", line 1404, in <module>
    with_tempdir(main)
  File "/usr/bin/duplicity", line 1397, in with_tempdir
    fn()
  File "/usr/bin/duplicity", line 1379, in main
    incremental_backup(sig_chain)
  File "/usr/bin/duplicity", line 574, in incremental_backup
    globals.backend)
  File "/usr/bin/duplicity", line 380, in write_multivol
    globals.gpg_profile, globals.volsize)
  File "/usr/lib/python2.7/dist-packages/duplicity/gpg.py", line 320, in GPGWriteFile
    data = "" bytes_to_go)).data
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 507, in next
    result = self.process(self.input_iter.next(), size)
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 188, in get_delta_iter
    for new_path, sig_path in collated:
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 277, in collate2iters
    relem2 = riter2.next()
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 346, in combine_path_iters
    refresh_triple_list(triple_list)
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 332, in refresh_triple_list
    new_triple = get_triple(old_triple[1])
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 318, in get_triple
    path = path_iter_list[iter_index].next()
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 230, in sigtar2path_iter
    for tarinfo in tf:
  File "/usr/lib/python2.7/dist-packages/duplicity/tarfile.py", line 2472, in next
    tarinfo = self.tarfile.next()
  File "/usr/lib/python2.7/dist-packages/duplicity/tarfile.py", line 2345, in next
    raise ReadError(str(e))
ReadError: missing or bad subsequent header

..ede

_______________________________________________
Duplicity-talk mailing list
address@hidden
https://lists.nongnu.org/mailman/listinfo/duplicity-talk

Joe Auty

September 17, 2012 3:36 PM

Hello,

Running the following command is now producing this error message consistently... Any ideas what is causing this and what I can do to fix this? I'm using version 0.6.15.

duplicity --full-if-older-than 3M --tempdir ${TEMPDIR} --archive-dir ${ARCHIVEDIR} --gpg-options "--compress-algo=bzip2 --bzip2-compress-level=9" --asynchronous-upload --encrypt-key=${GPG_KEY} --sign-key=${GPG_KEY} --s3-use-rrs --s3-use-new-style ${SOURCE} ${DEST}

these variables, of course, have values.



Local and Remote metadata are synchronized, no sync needed.
Last full backup date: Sat Sep 15 03:14:57 2012
No old backup sets found, nothing deleted.
Local and Remote metadata are synchronized, no sync needed.
Last full backup date: Sat Sep 15 03:14:57 2012
Reuse configured PASSPHRASE as SIGN_PASSPHRASE
Traceback (most recent call last):
  File "/usr/bin/duplicity", line 1344, in <module>
    with_tempdir(main)
  File "/usr/bin/duplicity", line 1327, in with_tempdir
    fn()
  File "/usr/bin/duplicity", line 1309, in main
    incremental_backup(sig_chain)
  File "/usr/bin/duplicity", line 526, in incremental_backup
    globals.backend)
  File "/usr/bin/duplicity", line 333, in write_multivol
    globals.gpg_profile, globals.volsize)
  File "/usr/lib/python2.7/dist-packages/duplicity/gpg.py", line 294, in GPGWriteFile
    data = "" bytes_to_go)).data
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 509, in next
    result = self.process(self.input_iter.next(), size)
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 187, in get_delta_iter
    for new_path, sig_path in collated:
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 275, in collate2iters
    relem2 = riter2.next()
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 344, in combine_path_iters
    refresh_triple_list(triple_list)
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 330, in refresh_triple_list
    new_triple = get_triple(old_triple[1])
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 316, in get_triple
    path = path_iter_list[iter_index].next()
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 229, in sigtar2path_iter
    for tarinfo in tf:
  File "/usr/lib/python2.7/dist-packages/duplicity/tarfile.py", line 1214, in next
    tarinfo = self.tarfile.next()
  File "/usr/lib/python2.7/dist-packages/duplicity/tarfile.py", line 564, in next
    tarinfo = self._proc_gnulong(tarinfo, tarinfo.type)
  File "/usr/lib/python2.7/dist-packages/duplicity/tarfile.py", line 1113, in _proc_gnulong
    tarinfo = self._buftoinfo(buf)
  File "/usr/lib/python2.7/dist-packages/duplicity/tarfile.py", line 1068, in _buftoinfo
    tarinfo.mode = int(buf[100:107], 8)
ValueError: invalid literal for int() with base 8: '\x00\x00\x00\x00\x00\x00\x00'

_______________________________________________
Duplicity-talk mailing list
address@hidden
https://lists.nongnu.org/mailman/listinfo/duplicity-talk

---

_______________________________________________
Duplicity-talk mailing list
address@hidden
https://lists.nongnu.org/mailman/listinfo/duplicity-talk

address@hidden

September 17, 2012 3:49 PM

https://bugs.launchpad.net/duplicity/+bug/642279
claims that this is probably fixed in 0.6.16 .. in any case please use the latest stable 0.6.19 and see if the error persists

..ede

_______________________________________________
Duplicity-talk mailing list
address@hidden
https://lists.nongnu.org/mailman/listinfo/duplicity-talk

Joe Auty

September 17, 2012 3:36 PM

Hello,

Running the following command is now producing this error message consistently... Any ideas what is causing this and what I can do to fix this? I'm using version 0.6.15.

duplicity --full-if-older-than 3M --tempdir ${TEMPDIR} --archive-dir ${ARCHIVEDIR} --gpg-options "--compress-algo=bzip2 --bzip2-compress-level=9" --asynchronous-upload --encrypt-key=${GPG_KEY} --sign-key=${GPG_KEY} --s3-use-rrs --s3-use-new-style ${SOURCE} ${DEST}

these variables, of course, have values.



Local and Remote metadata are synchronized, no sync needed.
Last full backup date: Sat Sep 15 03:14:57 2012
No old backup sets found, nothing deleted.
Local and Remote metadata are synchronized, no sync needed.
Last full backup date: Sat Sep 15 03:14:57 2012
Reuse configured PASSPHRASE as SIGN_PASSPHRASE
Traceback (most recent call last):
  File "/usr/bin/duplicity", line 1344, in <module>
    with_tempdir(main)
  File "/usr/bin/duplicity", line 1327, in with_tempdir
    fn()
  File "/usr/bin/duplicity", line 1309, in main
    incremental_backup(sig_chain)
  File "/usr/bin/duplicity", line 526, in incremental_backup
    globals.backend)
  File "/usr/bin/duplicity", line 333, in write_multivol
    globals.gpg_profile, globals.volsize)
  File "/usr/lib/python2.7/dist-packages/duplicity/gpg.py", line 294, in GPGWriteFile
    data = "" bytes_to_go)).data
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 509, in next
    result = self.process(self.input_iter.next(), size)
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 187, in get_delta_iter
    for new_path, sig_path in collated:
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 275, in collate2iters
    relem2 = riter2.next()
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 344, in combine_path_iters
    refresh_triple_list(triple_list)
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 330, in refresh_triple_list
    new_triple = get_triple(old_triple[1])
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 316, in get_triple
    path = path_iter_list[iter_index].next()
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 229, in sigtar2path_iter
    for tarinfo in tf:
  File "/usr/lib/python2.7/dist-packages/duplicity/tarfile.py", line 1214, in next
    tarinfo = self.tarfile.next()
  File "/usr/lib/python2.7/dist-packages/duplicity/tarfile.py", line 564, in next
    tarinfo = self._proc_gnulong(tarinfo, tarinfo.type)
  File "/usr/lib/python2.7/dist-packages/duplicity/tarfile.py", line 1113, in _proc_gnulong
    tarinfo = self._buftoinfo(buf)
  File "/usr/lib/python2.7/dist-packages/duplicity/tarfile.py", line 1068, in _buftoinfo
    tarinfo.mode = int(buf[100:107], 8)
ValueError: invalid literal for int() with base 8: '\x00\x00\x00\x00\x00\x00\x00'

_______________________________________________
Duplicity-talk mailing list
address@hidden
https://lists.nongnu.org/mailman/listinfo/duplicity-talk

---

_______________________________________________
Duplicity-talk mailing list
address@hidden
https://lists.nongnu.org/mailman/listinfo/duplicity-talk

address@hidden

September 18, 2012 4:00 AM

please do your backup with debug verbosity '-v9' and post the complete output (obfuscate private strings) to püastebin and post the link.

ede/duply.net

_______________________________________________
Duplicity-talk mailing list
address@hidden
https://lists.nongnu.org/mailman/listinfo/duplicity-talk

Joe Auty

September 18, 2012 3:52 AM

After upgrading to Duplicity 0.6.19 I'm still getting the same error as below:

Is it possible my backup is corrupt or something? I also downgraded back to Python 2.6 and the stable Debian Python packages, to no avail.

_______________________________________________
Duplicity-talk mailing list
address@hidden
https://lists.nongnu.org/mailman/listinfo/duplicity-talk

Joe Auty

September 17, 2012 5:23 PM

address@hidden

September 17, 2012 3:49 PM

https://bugs.launchpad.net/duplicity/+bug/642279
claims that this is probably fixed in 0.6.16 .. in any case please use the latest stable 0.6.19 and see if the error persists

Thanks! I didn't know what to search for to research this error further.

0.6.18 appears to be the latest version available in Debian right now, and I'm getting a different error message there, search "ReadError: missing or bad subsequent header" in Launchpad doesn't turn up anything... Any ideas, before I look for a 0.6.19 package or aim to compile my own?

Import of duplicity.backends.giobackend Failed: No module named gio
Local and Remote metadata are synchronized, no sync needed.
Last full backup date: Sat Sep 15 03:14:57 2012
Reuse configured PASSPHRASE as SIGN_PASSPHRASE
Traceback (most recent call last):
  File "/usr/bin/duplicity", line 1404, in <module>
    with_tempdir(main)
  File "/usr/bin/duplicity", line 1397, in with_tempdir
    fn()
  File "/usr/bin/duplicity", line 1379, in main
    incremental_backup(sig_chain)
  File "/usr/bin/duplicity", line 574, in incremental_backup
    globals.backend)
  File "/usr/bin/duplicity", line 380, in write_multivol
    globals.gpg_profile, globals.volsize)
  File "/usr/lib/python2.7/dist-packages/duplicity/gpg.py", line 320, in GPGWriteFile
    data = "" bytes_to_go)).data
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 507, in next
    result = self.process(self.input_iter.next(), size)
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 188, in get_delta_iter
    for new_path, sig_path in collated:
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 277, in collate2iters
    relem2 = riter2.next()
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 346, in combine_path_iters
    refresh_triple_list(triple_list)
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 332, in refresh_triple_list
    new_triple = get_triple(old_triple[1])
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 318, in get_triple
    path = path_iter_list[iter_index].next()
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 230, in sigtar2path_iter
    for tarinfo in tf:
  File "/usr/lib/python2.7/dist-packages/duplicity/tarfile.py", line 2472, in next
    tarinfo = self.tarfile.next()
  File "/usr/lib/python2.7/dist-packages/duplicity/tarfile.py", line 2345, in next
    raise ReadError(str(e))
ReadError: missing or bad subsequent header

..ede

_______________________________________________
Duplicity-talk mailing list
address@hidden
https://lists.nongnu.org/mailman/listinfo/duplicity-talk

Joe Auty

September 17, 2012 3:36 PM

Hello,

Running the following command is now producing this error message consistently... Any ideas what is causing this and what I can do to fix this? I'm using version 0.6.15.

duplicity --full-if-older-than 3M --tempdir ${TEMPDIR} --archive-dir ${ARCHIVEDIR} --gpg-options "--compress-algo=bzip2 --bzip2-compress-level=9" --asynchronous-upload --encrypt-key=${GPG_KEY} --sign-key=${GPG_KEY} --s3-use-rrs --s3-use-new-style ${SOURCE} ${DEST}

these variables, of course, have values.



Local and Remote metadata are synchronized, no sync needed.
Last full backup date: Sat Sep 15 03:14:57 2012
No old backup sets found, nothing deleted.
Local and Remote metadata are synchronized, no sync needed.
Last full backup date: Sat Sep 15 03:14:57 2012
Reuse configured PASSPHRASE as SIGN_PASSPHRASE
Traceback (most recent call last):
  File "/usr/bin/duplicity", line 1344, in <module>
    with_tempdir(main)
  File "/usr/bin/duplicity", line 1327, in with_tempdir
    fn()
  File "/usr/bin/duplicity", line 1309, in main
    incremental_backup(sig_chain)
  File "/usr/bin/duplicity", line 526, in incremental_backup
    globals.backend)
  File "/usr/bin/duplicity", line 333, in write_multivol
    globals.gpg_profile, globals.volsize)
  File "/usr/lib/python2.7/dist-packages/duplicity/gpg.py", line 294, in GPGWriteFile
    data = "" bytes_to_go)).data
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 509, in next
    result = self.process(self.input_iter.next(), size)
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 187, in get_delta_iter
    for new_path, sig_path in collated:
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 275, in collate2iters
    relem2 = riter2.next()
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 344, in combine_path_iters
    refresh_triple_list(triple_list)
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 330, in refresh_triple_list
    new_triple = get_triple(old_triple[1])
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 316, in get_triple
    path = path_iter_list[iter_index].next()
  File "/usr/lib/python2.7/dist-packages/duplicity/diffdir.py", line 229, in sigtar2path_iter
    for tarinfo in tf:
  File "/usr/lib/python2.7/dist-packages/duplicity/tarfile.py", line 1214, in next
    tarinfo = self.tarfile.next()
  File "/usr/lib/python2.7/dist-packages/duplicity/tarfile.py", line 564, in next
    tarinfo = self._proc_gnulong(tarinfo, tarinfo.type)
  File "/usr/lib/python2.7/dist-packages/duplicity/tarfile.py", line 1113, in _proc_gnulong
    tarinfo = self._buftoinfo(buf)
  File "/usr/lib/python2.7/dist-packages/duplicity/tarfile.py", line 1068, in _buftoinfo
    tarinfo.mode = int(buf[100:107], 8)
ValueError: invalid literal for int() with base 8: '\x00\x00\x00\x00\x00\x00\x00'

_______________________________________________
Duplicity-talk mailing list
address@hidden
https://lists.nongnu.org/mailman/listinfo/duplicity-talk

---

_______________________________________________
Duplicity-talk mailing list
address@hidden
https://lists.nongnu.org/mailman/listinfo/duplicity-talk

---

--
Joe Auty, NetMusician
NetMusician helps musicians, bands and artists create beautiful, professional, custom designed, career-essential websites that are easy to maintain and to integrate with popular social networks.
www.netmusician.org
address@hidden