rdiff-backup-users
[Top][All Lists]
Advanced
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [rdiff-backup-users] IOError: [Errno 75] Value too large for defined

From: Dominic Raferd
Subject: Re: [rdiff-backup-users] IOError: [Errno 75] Value too large for defined data type
Date: Tue, 10 May 2011 20:39:46 +0100
User-agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.2.17) Gecko/20110424 Thunderbird/3.1.10 
Bruno:
Do you need to use NTFS for the external drive? I suggest you try again using a Linux format such as ext3 and see if you have more success. My impression is that a high proportion of problems with rdiff-backup relate to backups to NTFS volumes (backup *from* NTFS generally works fine). 

Dominic

On 10/05/11 16:21, Bruno Basilio wrote:

Hi,

I'm new at using rdiff-backup but already fascinated with the simple principle.
Hope it will not stop to be maintained.

I'm running Ubuntu 10.04, installed the rdiff-backup 1.2.8 and tried
to backup 80GB of pictures and movies using to USB external drives
with NTFS, at around 30GB, it stopped with following error:

<<<
$  rdiff-backup -v9 --print-statistics --no-hard-links
/media/BBasilioHomeBackup/fotos/ /media/Elements/rdiff-backup/fotos/
Mon May  9 22:23:34 2011  Using rdiff-backup version 1.2.8
Mon May  9 22:23:34 2011  Found interrupted initial backup. Removing...
Mon May  9 22:23:34 2011  Determining if directory contains files:
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/increments
Mon May  9 22:23:34 2011  Determining if directory contains files:
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/increments/2009
Mon May  9 22:23:34 2011  Determining if directory contains files:
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/increments/2009/2009_08_08
Mon May  9 22:23:34 2011  Determining if directory contains files:
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/increments/2009/2009_08_08/2009_08_08
- Bruno
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/increments
Mon May  9 22:23:34 2011  Removing directory
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/increments
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/backup.log
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/chars_to_quote
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/file_statistics.2011-05-09T22:20:28+01:00.data.gz
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/mirror_metadata.2011-05-09T22:20:28+01:00.snapshot.gz
Mon May  9 22:23:34 2011  POSIX ACLs not supported by filesystem at
/media/BBasilioHomeBackup/fotos
Mon May  9 22:23:34 2011  Unable to import win32security module. Windows ACLs
not supported by filesystem at /media/BBasilioHomeBackup/fotos
Mon May  9 22:23:34 2011  escape_dos_devices not required by
filesystem at /media/BBasilioHomeBackup/fotos
Mon May  9 22:23:34 2011
-----------------------------------------------------------------
Detected abilities for source (read only) file system:
   Access control lists                         Off
   Extended attributes                          On
   Windows access control lists                 Off
   Case sensitivity                             On
   Escape DOS devices                           Off
   Escape trailing spaces                       Off
   Mac OS X style resource forks                Off
   Mac OS X Finder information                  Off
-----------------------------------------------------------------
Mon May  9 22:23:34 2011  Making directory
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0
Mon May  9 22:23:34 2011  Touching
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/5-_
a.snapshot.gz
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/5-_
a.snapshot.gz
Mon May  9 22:23:34 2011  Touching
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/uniᄉ
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/uniᄉ
Mon May  9 22:23:34 2011  Touching
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/:\"
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/:\"
Mon May  9 22:23:34 2011  Touching
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/A
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/A
Mon May  9 22:23:34 2011  Touching
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/foo
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/foo
Mon May  9 22:23:34 2011  Making directory
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/hl
Mon May  9 22:23:34 2011  Touching
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/hardlinked_file1
Mon May  9 22:23:34 2011  Hard linking
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/hl/hardlinked_file2
to 
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/hardlinked_file1
Mon May  9 22:23:34 2011  POSIX ACLs not supported by filesystem at
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0
Mon May  9 22:23:34 2011  Unable to import win32security module. Windows ACLs
not supported by filesystem at
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0
Mon May  9 22:23:34 2011  Touching
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/dir_inc_check
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/dir_inc_check
Mon May  9 22:23:34 2011  Touching
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/regfile
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/regfile
Mon May  9 22:23:34 2011  Touching
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/high_perms_file
Mon May  9 22:23:34 2011  Touching
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/high_perms_dir
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/high_perms_file
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/high_perms_dir
Mon May  9 22:23:34 2011  Touching
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/symlinked_file1
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/symlinked_file2
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0/symlinked_file1
Mon May  9 22:23:34 2011  escape_dos_devices not required by
filesystem at 
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0
Mon May  9 22:23:34 2011  Deleting
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0
Mon May  9 22:23:34 2011  Removing directory
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/rdiff-backup.tmp.0
Mon May  9 22:23:34 2011
-----------------------------------------------------------------
Detected abilities for destination (read/write) file system:
   Ownership changing                           Off
   Hard linking                                 On
   fsync() directories                          On
   Directory inc permissions                    Off
   High-bit permissions                         On
   Symlink permissions                          Off
   Extended filenames                           On
   Windows reserved filenames                   Off
   Access control lists                         Off
   Extended attributes                          On
   Windows access control lists                 Off
   Case sensitivity                             On
   Escape DOS devices                           Off
   Escape trailing spaces                       Off
   Mac OS X style resource forks                Off
   Mac OS X Finder information                  Off
-----------------------------------------------------------------
Mon May  9 22:23:34 2011  Backup: must_escape_dos_devices = 0
Mon May  9 22:23:34 2011  Starting mirror
/media/BBasilioHomeBackup/fotos to /media/Elements/rdiff-backup/fotos
Mon May  9 22:23:34 2011  Processing changed file .
Mon May  9 22:24:00 2011  Processing changed file 2009
Mon May  9 22:24:00 2011  Making directory path
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/increments
Mon May  9 22:24:09 2011  Processing changed file 2009/2009_08_08
Mon May  9 22:24:09 2011  Making directory path
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/increments/2009
Mon May  9 22:24:09 2011  Processing changed file
2009/2009_08_08/2009_08_08 - Bruno
Mon May  9 22:24:09 2011  Making directory path
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/increments/2009/2009_08_08
- Benfica
Mon May  9 22:24:09 2011  Processing changed file 2009/2009_08_08 -
Benfica/2009_08_08 - Bruno/P1030107.JPG
Mon May  9 22:24:09 2011  Making directory path
/media/Elements/rdiff-backup/fotos/rdiff-backup-data/increments/2009/2009_08_08
- Benfica/2009_08_08 - Bruno
Mon May  9 22:24:09 2011  Regular copying ('2009', '2009_08_08 -
Benfica', '2009_08_08 - Bruno', 'P1030107.JPG') to
/media/Elements/rdiff-backup/fotos/2009/2009_08_08 -
Benfica/2009_08_08 - Bruno/rdiff-backup.tmp.2
Mon May  9 22:24:09 2011  Writing file object to
/media/Elements/rdiff-backup/fotos/2009/2009_08_08 -
Benfica/2009_08_08 - Bruno/rdiff-backup.tmp.2
Mon May  9 22:24:09 2011  Exception '[Errno 75] Value too large for
defined data type' raised of class '<type 'exceptions.IOError'>':
   File "/usr/lib/pymodules/python2.6/rdiff_backup/robust.py", line 32,
in check_common_error
     try: return function(*args)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line 105, in copy
     if rpin.isreg(): return copy_reg_file(rpin, rpout, compress)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line 133,
in copy_reg_file
     return rpout.write_from_fileobj(rpin.open("rb"), compress = compress)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line
1195, in write_from_fileobj
     copyfileobj(fp, outfp)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line 62,
in copyfileobj
     inbuf = inputfp.read(blocksize)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line 1415, in read
     def read(self, length = -1): return self.file.read(length)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/hash.py", line 47, in read
     buf = self.fileobj.read(length)

Mon May  9 22:24:09 2011  Exception '[Errno 75] Value too large for
defined data type' raised of class '<type 'exceptions.IOError'>':
   File "/usr/lib/pymodules/python2.6/rdiff_backup/Main.py", line 304,
in error_check_Main
     try: Main(arglist)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/Main.py", line 324, in Main
     take_action(rps)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/Main.py", line 280,
in take_action
     elif action == "backup": Backup(rps[0], rps[1])
   File "/usr/lib/pymodules/python2.6/rdiff_backup/Main.py", line 346, in Backup
     backup.Mirror(rpin, rpout)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/backup.py", line 38, in 
Mirror
     DestS.patch(dest_rpath, source_diffiter)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/backup.py", line 232, in 
patch
     ITR(diff.index, diff)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/rorpiter.py", line
281, in __call__
     last_branch.fast_process(*args)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/backup.py", line
529, in fast_process
     if self.patch_to_temp(mirror_rp, diff_rorp, tf):
   File "/usr/lib/pymodules/python2.6/rdiff_backup/backup.py", line
553, in patch_to_temp
     result = self.patch_snapshot_to_temp(diff_rorp, new)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/backup.py", line
582, in patch_snapshot_to_temp
     (diff_rorp, new))
   File "/usr/lib/pymodules/python2.6/rdiff_backup/robust.py", line 32,
in check_common_error
     try: return function(*args)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line 105, in copy
     if rpin.isreg(): return copy_reg_file(rpin, rpout, compress)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line 133,
in copy_reg_file
     return rpout.write_from_fileobj(rpin.open("rb"), compress = compress)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line
1195, in write_from_fileobj
     copyfileobj(fp, outfp)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line 62,
in copyfileobj
     inbuf = inputfp.read(blocksize)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line 1415, in read
     def read(self, length = -1): return self.file.read(length)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/hash.py", line 47, in read
     buf = self.fileobj.read(length)

Traceback (most recent call last):
   File "/usr/bin/rdiff-backup", line 30, in<module>
     rdiff_backup.Main.error_check_Main(sys.argv[1:])
   File "/usr/lib/pymodules/python2.6/rdiff_backup/Main.py", line 304,
in error_check_Main
     try: Main(arglist)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/Main.py", line 324, in Main
     take_action(rps)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/Main.py", line 280,
in take_action
     elif action == "backup": Backup(rps[0], rps[1])
   File "/usr/lib/pymodules/python2.6/rdiff_backup/Main.py", line 346, in Backup
     backup.Mirror(rpin, rpout)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/backup.py", line 38, in 
Mirror
     DestS.patch(dest_rpath, source_diffiter)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/backup.py", line 232, in 
patch
     ITR(diff.index, diff)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/rorpiter.py", line
281, in __call__
     last_branch.fast_process(*args)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/backup.py", line
529, in fast_process
     if self.patch_to_temp(mirror_rp, diff_rorp, tf):
   File "/usr/lib/pymodules/python2.6/rdiff_backup/backup.py", line
553, in patch_to_temp
     result = self.patch_snapshot_to_temp(diff_rorp, new)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/backup.py", line
582, in patch_snapshot_to_temp
     (diff_rorp, new))
   File "/usr/lib/pymodules/python2.6/rdiff_backup/robust.py", line 32,
in check_common_error
     try: return function(*args)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line 105, in copy
     if rpin.isreg(): return copy_reg_file(rpin, rpout, compress)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line 133,
in copy_reg_file
     return rpout.write_from_fileobj(rpin.open("rb"), compress = compress)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line
1195, in write_from_fileobj
     copyfileobj(fp, outfp)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line 62,
in copyfileobj
     inbuf = inputfp.read(blocksize)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/rpath.py", line 1415, in read
     def read(self, length = -1): return self.file.read(length)
   File "/usr/lib/pymodules/python2.6/rdiff_backup/hash.py", line 47, in read
     buf = self.fileobj.read(length)
IOError: [Errno 75] Value too large for defined data type
Search through the rdiff-backup-users Archives but couldn't find
any cue to solve the problem.

Search the net for similar information and it seems to be related with
python version before 2.2 and presently I'm using 2.6.5.
Follow some version information.

<<<
$ python --version
Python 2.6.5
$ rsync --version
rsync  version 3.0.7  protocol version 30
$ dpkg -l | grep rsync
ii  librsync1                                        0.9.7-7
                               rsync remote-delta algorithm library
ii  rsync                                            3.0.7-1ubuntu1.1
                               fast remote file copy program (like rcp)
Thank you for your time.
reply via email to
[Prev in Thread] Current Thread [Next in Thread]