Re: [Rdiff-backup-bugs] [bug #42463] rdiff-backup 1.3.3 crashed -- zlib.error: Error -3 while decompressing: invalid stored block lengths

[bblister]

Hi,

Thank you for your answer, but what mailing list do you refer to? 
I am checking the rdiff-backup-bugs mailing list ( 
http://lists.nongnu.org/archive/html/rdiff-backup-bugs/ ) . 
My bug report was also posted there, as well as your answer. Is there another 
mailing list for rdiff-backup ?

I do not mind deleting the rdiff-backup destination folder, but I would like to 
fix this, because I use rdiff-backup
in an unattended mode via crontab, and I would like to know what parameters to 
add to my backup script, in order to
automatically fix such errors if they occur. Thus, I will wait with this 
corrupted backup destination for some weeks,
until somebody gives me suggestions. 

So, my question is IF I detect such condition from my backup script, what
parameter should I pass to rdiff-backup to fix it, in order to keep working, in
an unattended way without required administrator involvement?


I believe that if you dont fix a bug that you found, and just bypass it, it 
will come down to you in a more tragic and
catastrophic way. 

So, I am willing to test anything here...

Thanks




On Fri, May 30, 2014 at 01:45:24PM +0000, Edward Ned Harvey (rdiff-backup) 
wrote:
> You'll get the best support by asking the community (join the mailing list), 
> but if you have corruption in your backup destination, most likely the 
> solution for you is to start a new fresh backup free of corruption.  It's not 
> a bug, but a feature you'd benefit from, if rdiff-backup had the ability to 
> automatically detect corruption, rewind to a point before the corruption, and 
> then continue forward with minimal effort and maximal efficiency...  I just 
> don't see that happening...
> 
> 
> > -----Original Message-----
> > From: rdiff-backup-bugs-bounces+rdiff-
> > address@hidden [mailto:rdiff-backup-bugs-
> > address@hidden On Behalf Of Brother
> > Lister
> > Sent: Friday, May 30, 2014 1:32 AM
> > To: Brother Lister; address@hidden
> > Subject: [Rdiff-backup-bugs] [bug #42463] rdiff-backup 1.3.3 crashed --
> > zlib.error: Error -3 while decompressing: invalid stored block lengths
> > 
> > URL:
> >   <http://savannah.nongnu.org/bugs/?42463>
> > 
> >                  Summary: rdiff-backup 1.3.3 crashed -- zlib.error: Error -3
> > while decompressing: invalid stored block lengths
> >                  Project: rdiff-backup
> >             Submitted by: bblister
> >             Submitted on: Fri 30 May 2014 05:32:04 AM GMT
> >                 Category: None
> >                 Severity: 3 - Normal
> >               Item Group: None
> >                   Status: None
> >                  Privacy: Public
> >              Assigned to: None
> >              Open/Closed: Open
> >          Discussion Lock: Any
> > 
> >     _______________________________________________________
> > 
> > Details:
> > 
> > First, I searched the mailing list for "invalid stored block lengths" but I
> > did not find any relavent info:
> > http://lists.nongnu.org/archive/cgi-
> > bin/namazu.cgi?query=invalid+stored+block+lengths&submit=Search%21&i
> > dxname=rdiff-backup-bugs&max=20&result=normal&sort=score
> > 
> > 
> > My problem is that a backup has failed, and from that time I can no longer
> > use
> > this archive. I haven't found any
> > solution yet and no workarround.
> > 
> > Operating system: 9.2-STABLE FreeBSD 9.2-STABLE #1 r264312: amd64
> > 
> > Previous backup seems to have failed, regressing destination now.
> > Traceback (most recent call last):
> >   File "/usr/local/bin/rdiff-backup", line 30, in <module>
> >     rdiff_backup.Main.error_check_Main(sys.argv[1:])
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/Main.py", line
> > 306, in error_check_Main
> >     try: Main(arglist)
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/Main.py", line
> > 326, in Main
> >     take_action(rps)
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/Main.py", line
> > 282, in take_action
> >     elif action == "backup": Backup(rps[0], rps[1])
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/Main.py", line
> > 339, in Backup
> >     backup_final_init(rpout)
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/Main.py", line
> > 504, in backup_final_init
> >     checkdest_if_necessary(rpout)
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/Main.py", line
> > 938, in checkdest_if_necessary
> >     dest_rp.conn.regress.Regress(dest_rp)
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/regress.py", 
> > line
> > 71, in Regress
> >     for rf in iterate_meta_rfs(mirror_rp, inc_rpath): ITR(rf.index, rf)
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/regress.py", 
> > line
> > 197, in iterate_meta_rfs
> >     for raw_rf, metadata_rorp in collated:
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/rorpiter.py", 
> > line
> > 100, in Collate2Iters
> >     try: relem2 = riter2.next()
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/metadata.py",
> > line
> > 274, in iterate
> >     for record in self.iterate_records():
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/metadata.py",
> > line
> > 283, in iterate_records
> >     next_pos = self.get_next_pos()
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/metadata.py",
> > line
> > 266, in get_next_pos
> >     newbuf = self.fileobj.read(self.blocksize)
> >   File "/usr/local/lib/python2.7/gzip.py", line 261, in read
> >     self._read(readsize)
> >   File "/usr/local/lib/python2.7/gzip.py", line 312, in _read
> >     uncompress = self.decompress.decompress(buf)
> > zlib.error: Error -3 while decompressing: invalid stored block lengths
> > 
> > 
> > 
> > I tried also:
> > rdiff-backup --check-destination-dir --force XXXXXXXXXXXX
> > 
> > 
> > but the result:
> > 
> > Exception 'Error -3 while decompressing: invalid stored block lengths' 
> > raised
> > of class '<class 'zlib.error'>':
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/Main.py", line
> > 306, in error_check_Main
> >     try: Main(arglist)
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/Main.py", line
> > 326, in Main
> >     take_action(rps)
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/Main.py", line
> > 284, in take_action
> >     elif action == "check-destination-dir": CheckDest(rps[0])
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/Main.py", line
> > 888, in CheckDest
> >     dest_rp.conn.regress.Regress(dest_rp)
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/regress.py", 
> > line
> > 71, in Regress
> >     for rf in iterate_meta_rfs(mirror_rp, inc_rpath): ITR(rf.index, rf)
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/regress.py", 
> > line
> > 197, in iterate_meta_rfs
> >     for raw_rf, metadata_rorp in collated:
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/rorpiter.py", 
> > line
> > 100, in Collate2Iters
> >     try: relem2 = riter2.next()
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/metadata.py",
> > line
> > 274, in iterate
> >     for record in self.iterate_records():
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/metadata.py",
> > line
> > 283, in iterate_records
> >     next_pos = self.get_next_pos()
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/metadata.py",
> > line
> > 266, in get_next_pos
> >     newbuf = self.fileobj.read(self.blocksize)
> >   File "/usr/local/lib/python2.7/gzip.py", line 261, in read
> >     self._read(readsize)
> >   File "/usr/local/lib/python2.7/gzip.py", line 312, in _read
> >     uncompress = self.decompress.decompress(buf)
> > 
> > Traceback (most recent call last):
> >   File "/usr/local/bin/rdiff-backup", line 30, in <module>
> >     rdiff_backup.Main.error_check_Main(sys.argv[1:])
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/Main.py", line
> > 306, in error_check_Main
> >     try: Main(arglist)
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/Main.py", line
> > 326, in Main
> >     take_action(rps)
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/Main.py", line
> > 284, in take_action
> >     elif action == "check-destination-dir": CheckDest(rps[0])
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/Main.py", line
> > 888, in CheckDest
> >     dest_rp.conn.regress.Regress(dest_rp)
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/regress.py", 
> > line
> > 71, in Regress
> >     for rf in iterate_meta_rfs(mirror_rp, inc_rpath): ITR(rf.index, rf)
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/regress.py", 
> > line
> > 197, in iterate_meta_rfs
> >     for raw_rf, metadata_rorp in collated:
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/rorpiter.py", 
> > line
> > 100, in Collate2Iters
> >     try: relem2 = riter2.next()
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/metadata.py",
> > line
> > 274, in iterate
> >     for record in self.iterate_records():
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/metadata.py",
> > line
> > 283, in iterate_records
> >     next_pos = self.get_next_pos()
> >   File "/usr/local/lib/python2.7/site-packages/rdiff_backup/metadata.py",
> > line
> > 266, in get_next_pos
> >     newbuf = self.fileobj.read(self.blocksize)
> >   File "/usr/local/lib/python2.7/gzip.py", line 261, in read
> >     self._read(readsize)
> >   File "/usr/local/lib/python2.7/gzip.py", line 312, in _read
> >     uncompress = self.decompress.decompress(buf)
> > zlib.error: Error -3 while decompressing: invalid stored block lengths
> > 
> > 
> > 
> > 
> > 
> > 
> >     _______________________________________________________
> > 
> > Reply to this item at:
> > 
> >   <http://savannah.nongnu.org/bugs/?42463>
> > 
> > _______________________________________________
> >   Message sent via/by Savannah
> >   http://savannah.nongnu.org/
> > 
> > 
> > _______________________________________________
> > Rdiff-backup-bugs mailing list
> > address@hidden
> > https://lists.nongnu.org/mailman/listinfo/rdiff-backup-bugs