[Top][All Lists]
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [rdiff-backup-users] one more bug in rdiff-backup-1.1.16
From: |
Farkas Levente |
Subject: |
Re: [rdiff-backup-users] one more bug in rdiff-backup-1.1.16 |
Date: |
Mon, 23 Jun 2008 23:12:15 +0200 |
User-agent: |
Thunderbird 2.0.0.14 (X11/20080501) |
Andrew Ferguson wrote:
On Jun 23, 2008, at 10:04 AM, Farkas Levente wrote:
Andrew Ferguson wrote:
On Jun 23, 2008, at 5:24 AM, Farkas Levente wrote:
Andrew Ferguson wrote:
On Jun 21, 2008, at 4:45 PM, Farkas Levente wrote:
hi,
we just try rdiff-backup-1.1.16 and we've got this error all the
time we run:
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py",
line 58, in copyfileobj
inbuf = inputfp.read(blocksize)
File "/usr/lib64/python2.4/gzip.py", line 225, in read
self._read(readsize)
File "/usr/lib64/python2.4/gzip.py", line 273, in _read
self._read_eof()
File "/usr/lib64/python2.4/gzip.py", line 309, in _read_eof
raise IOError, "CRC check failed"
IOError: CRC check failed
Hi Farkas,
Does this happen if you revert to 1.1.15? It doesn't look like a
1.1.16-specific bug to me. It looks more like trouble with a file
or hardware (CRC check). Do you get this message all computers
which you have installed 1.1.16 on? Or only this one?
I agree the error message could be more helpful!
i've got only one system with 1.1.16 all other use the stable
version. this one backup a windows server which is mounted as a cifs
filesystem. the reason i try the latest development since there are
many hungarian, vietnamese characters in filename and the stable
release can't handle it. unfortunately this version has more error
and it's not backup anything:-(.
this means today i losse 90GB backup. so i start to think it'd be
useful to give such option as in rsync --max-delete.
our command was:
rdiff-backup -v5 --print-statistics --ssh-no-compression
--include-globbing-filelist /etc/rdiff-backup/filelist/windows /
/srv/backup/windows
/etc/rdiff-backup/filelist/windows:
-----------------------------
- /mnt/windows/f/System**
- /mnt/windows/f/shared/backup
+ /mnt/windows/f/shared
- **
-----------------------------
my real problems what is the:
what is these file in the error log:
-----------------------------
mnt/windows/f/proc
mnt/windows/f/selinux
mnt/windows/f/sys
-----------------------------
there is no such files and shouldn't have to happened? ha can it be
checked???
I'm afraid I don't understand what you've described. Are you claiming
rdiff-backup tried to backup files which don't exist? I suppose that
could happen since it doesn't look like you excluded
"/srv/backup/windows" from the excluded paths. Remember, a circular
backup is guaranteed to cause problems.
no. i backup / to /srv/backup/windows (just look at again my command
line) this is a bigger script all backups backup / with different
filelist. of course there is no such file as mnt/windows/f/proc and i
don't know what's the reason for this:
-----------------------------------
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py",
line 357, in read_from_rp
sListError mnt/windows/f/proc [Errno 95] Operation not supported
ListError mnt/windows/f/selinux [Errno 95] Operation not supported
ListError mnt/windows/f/sys [Errno 95] Operation not supported
-----------------------------------
Ok, this is what I'm thinking:
1) Rdiff-backup tried to open files like "/mnt/windows/f/proc" and
"/mnt/windows/f/selinux" and "/mnt/windows/f/sys". These files MUST have
existed when rdiff-backup was running -- there is no way for it to
imagine files which don't exist!
2) You claim these files do not exist, never did, and never should. I am
inclined to believe you since "proc" "selinux" and "sys" are all
Linux-specific root-level directories.
The conclusion I draw from these two facts is that your mount points or
filepaths were some how screwed-up while rdiff-backup was running. There
was nothing rdiff-backup could do about that. The system was simply
mis-configured at the time.
it's not happened once, it's always. there should have to be some bug in
rdiff-backup somewhere.
what kind of proof would be enough:
# ls -l /mnt/windows; rdiff-backup --force -v5 --print-statistics
--ssh-no-compression --include-globbing-filelist
/etc/rdiff-backup/filelist/windows / /srv/backup/windows
total 24
drwxr-xr-x 2 root root 4096 Sep 6 2007 c
drwxr-xr-x 2 root root 4096 Sep 6 2007 d
drwxr-xr-x 2 root root 4096 Sep 6 2007 e
drwxrwxrwx 1 root root 0 Jun 23 22:00 f
Using rdiff-backup version 1.1.16
escape_dos_devices not required by filesystem at /
-----------------------------------------------------------------
Detected abilities for source (read only) file system:
Access control lists On
Extended attributes On
Case sensitivity On
Escape DOS devices Off
Mac OS X style resource forks Off
Mac OS X Finder information Off
-----------------------------------------------------------------
escape_dos_devices not required by filesystem at
/srv/backup/windows/rdiff-backup-data/rdiff-backup.tmp.0
-----------------------------------------------------------------
Detected abilities for destination (read/write) file system:
Ownership changing On
Hard linking On
fsync() directories On
Directory inc permissions On
High-bit permissions On
Symlink permissions Off
Extended filenames On
Windows reserved filenames Off
Access control lists On
Extended attributes On
Case sensitivity On
Escape DOS devices Off
Mac OS X style resource forks Off
Mac OS X Finder information Off
-----------------------------------------------------------------
Backup: must_escape_dos_devices = 0
Reading globbing filelist /etc/rdiff-backup/filelist/windows
Starting increment operation / to /srv/backup/windows
Exception '[Errno 95] Operation not supported' raised of class
'exceptions.IOError':
File "/usr/lib64/python2.4/site-packages/rdiff_backup/robust.py",
line 32, in check_common_error
try: return function(*args)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line
1050, in append
return self.__class__(self.conn, self.base, self.index + (ext,))
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line
767, in __init__
else: self.setdata()
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line
792, in setdata
if self.lstat(): self.conn.rpath.setdata_local(self)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line
1396, in setdata_local
if Globals.acls_conn: rpath.data['acl'] = acl_get(rpath)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py",
line 562, in rpath_acl_get
if not rp.issym(): acl.read_from_rp(rp)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py",
line 357, in read_from_rp
self.entry_list, self.default_entry_list = \
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py",
line 383, in get_acl_lists_from_rp
try: acl = posix1e.ACL(file=rp.path)
ListError dev [Errno 95] Operation not supported
Exception '[Errno 95] Operation not supported' raised of class
'exceptions.IOError':
File "/usr/lib64/python2.4/site-packages/rdiff_backup/robust.py",
line 32, in check_common_error
try: return function(*args)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line
1050, in append
return self.__class__(self.conn, self.base, self.index + (ext,))
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line
767, in __init__
else: self.setdata()
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line
792, in setdata
if self.lstat(): self.conn.rpath.setdata_local(self)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line
1396, in setdata_local
if Globals.acls_conn: rpath.data['acl'] = acl_get(rpath)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py",
line 562, in rpath_acl_get
if not rp.issym(): acl.read_from_rp(rp)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py",
line 357, in read_from_rp
self.entry_list, self.default_entry_list = \
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py",
line 383, in get_acl_lists_from_rp
try: acl = posix1e.ACL(file=rp.path)
ListError mnt/windows/f [Errno 95] Operation not supported
Exception '[Errno 95] Operation not supported' raised of class
'exceptions.IOError':
File "/usr/lib64/python2.4/site-packages/rdiff_backup/robust.py",
line 32, in check_common_error
try: return function(*args)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line
1050, in append
return self.__class__(self.conn, self.base, self.index + (ext,))
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line
767, in __init__
else: self.setdata()
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line
792, in setdata
if self.lstat(): self.conn.rpath.setdata_local(self)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line
1396, in setdata_local
if Globals.acls_conn: rpath.data['acl'] = acl_get(rpath)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py",
line 562, in rpath_acl_get
if not rp.issym(): acl.read_from_rp(rp)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py",
line 357, in read_from_rp
self.entry_list, self.default_entry_list = \
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py",
line 383, in get_acl_lists_from_rp
try: acl = posix1e.ACL(file=rp.path)
ListError mnt/windows/proc [Errno 95] Operation not supported
Exception '[Errno 95] Operation not supported' raised of class
'exceptions.IOError':
File "/usr/lib64/python2.4/site-packages/rdiff_backup/robust.py",
line 32, in check_common_error
try: return function(*args)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line
1050, in append
return self.__class__(self.conn, self.base, self.index + (ext,))
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line
767, in __init__
else: self.setdata()
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line
792, in setdata
if self.lstat(): self.conn.rpath.setdata_local(self)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line
1396, in setdata_local
if Globals.acls_conn: rpath.data['acl'] = acl_get(rpath)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py",
line 562, in rpath_acl_get
if not rp.issym(): acl.read_from_rp(rp)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py",
line 357, in read_from_rp
self.entry_list, self.default_entry_list = \
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py",
line 383, in get_acl_lists_from_rp
try: acl = posix1e.ACL(file=rp.path)
ListError mnt/windows/selinux [Errno 95] Operation not supported
Exception '[Errno 95] Operation not supported' raised of class
'exceptions.IOError':
File "/usr/lib64/python2.4/site-packages/rdiff_backup/robust.py",
line 32, in check_common_error
try: return function(*args)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line
1050, in append
return self.__class__(self.conn, self.base, self.index + (ext,))
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line
767, in __init__
else: self.setdata()
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line
792, in setdata
if self.lstat(): self.conn.rpath.setdata_local(self)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rpath.py", line
1396, in setdata_local
if Globals.acls_conn: rpath.data['acl'] = acl_get(rpath)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py",
line 562, in rpath_acl_get
if not rp.issym(): acl.read_from_rp(rp)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py",
line 357, in read_from_rp
self.entry_list, self.default_entry_list = \
File "/usr/lib64/python2.4/site-packages/rdiff_backup/eas_acls.py",
line 383, in get_acl_lists_from_rp
try: acl = posix1e.ACL(file=rp.path)
ListError mnt/windows/sys [Errno 95] Operation not supported
--------------[ Session statistics ]--------------
StartTime 1214254965.00 (Mon Jun 23 23:02:45 2008)
EndTime 1214254965.81 (Mon Jun 23 23:02:45 2008)
ElapsedTime 0.81 (0.81 seconds)
SourceFiles 3
SourceFileSize 0 (0 bytes)
MirrorFiles 3
MirrorFileSize 0 (0 bytes)
NewFiles 0
NewFileSize 0 (0 bytes)
DeletedFiles 0
DeletedFileSize 0 (0 bytes)
ChangedFiles 0
ChangedSourceSize 0 (0 bytes)
ChangedMirrorSize 0 (0 bytes)
IncrementFiles 0
IncrementFileSize 0 (0 bytes)
TotalDestinationSizeChange 0 (0 bytes)
Errors 5
--------------------------------------------------
I have two more concerns:
1) Why are you excluding /mnt/windows/... ? Is that the same machine as
"backup" -- what is this mount setup you are running? It clearly has
many parts.
i wan't to backup /mnt/windows/ to /srv/backup/windows/
/mnt/windows/ is a mount point to where the windows drive is mounted.
2) Based on your include file, aren't you really just trying to do this:
$ rdiff-backup -v5 --print-statistics --ssh-no-compression --exclude
/mnt/windows/f/shared/backup /mnt/windows/f/shared /srv/backup/windows
Why aren't you running it like that?
yes this is true, but i've got more scripts which backup different
remote and local hosts. that's why i use this way.
anyway today i try exactly the above. now i've got a different character
problem:
Exception '('Document', '2007', 'Hansol', 'Tectonbol', 'Jakab Tamastol
pendrive', '07_0120_Hansol data', '070120 samjin lnd data', 'Samjin LND
Sample', '????(?).JPG')' raised of class 'exceptions.KeyError':
File "/usr/lib64/python2.4/site-packages/rdiff_backup/Main.py", line
302, in error_check_Main
try: Main(arglist)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/Main.py", line
322, in Main
take_action(rps)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/Main.py", line
278, in take_action
elif action == "backup": Backup(rps[0], rps[1])
File "/usr/lib64/python2.4/site-packages/rdiff_backup/Main.py", line
344, in Backup
backup.Mirror(rpin, rpout)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/backup.py",
line 38, in Mirror
DestS.patch(dest_rpath, source_diffiter)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/backup.py",
line 230, in patch
for diff in rorpiter.FillInIter(source_diffiter, dest_rpath):
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rorpiter.py",
line 177, in FillInIter
for rp in rpiter:
File "/usr/lib64/python2.4/site-packages/rdiff_backup/backup.py",
line 103, in get_diffs
for dest_sig in dest_sigiter:
File "/usr/lib64/python2.4/site-packages/rdiff_backup/backup.py",
line 166, in get_sigs
for src_rorp, dest_rorp in cls.CCPP:
File "/usr/lib64/python2.4/site-packages/rdiff_backup/backup.py",
line 320, in next
source_rorp, dest_rorp = self.iter.next()
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rorpiter.py",
line 103, in Collate2Iters
for relem1 in riter1:
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rorpiter.py",
line 348, in next
del self.cache_dict[self.cache_indicies[0]]
Traceback (most recent call last):
File "/usr/bin/rdiff-backup", line 23, in ?
rdiff_backup.Main.error_check_Main(sys.argv[1:])
File "/usr/lib64/python2.4/site-packages/rdiff_backup/Main.py", line
302, in error_check_Main
try: Main(arglist)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/Main.py", line
322, in Main
take_action(rps)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/Main.py", line
278, in take_action
elif action == "backup": Backup(rps[0], rps[1])
File "/usr/lib64/python2.4/site-packages/rdiff_backup/Main.py", line
344, in Backup
backup.Mirror(rpin, rpout)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/backup.py",
line 38, in Mirror
DestS.patch(dest_rpath, source_diffiter)
File "/usr/lib64/python2.4/site-packages/rdiff_backup/backup.py",
line 230, in patch
for diff in rorpiter.FillInIter(source_diffiter, dest_rpath):
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rorpiter.py",
line 177, in FillInIter
for rp in rpiter:
File "/usr/lib64/python2.4/site-packages/rdiff_backup/backup.py",
line 103, in get_diffs
for dest_sig in dest_sigiter:
File "/usr/lib64/python2.4/site-packages/rdiff_backup/backup.py",
line 166, in get_sigs
for src_rorp, dest_rorp in cls.CCPP:
File "/usr/lib64/python2.4/site-packages/rdiff_backup/backup.py",
line 320, in next
source_rorp, dest_rorp = self.iter.next()
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rorpiter.py",
line 103, in Collate2Iters
for relem1 in riter1:
File "/usr/lib64/python2.4/site-packages/rdiff_backup/rorpiter.py",
line 348, in next
del self.cache_dict[self.cache_indicies[0]]
KeyError: ('Document', '2007', 'Hansol', 'Tectonbol', 'Jakab Tamastol
pendrive', '07_0120_Hansol data', '070120 samjin lnd data', 'Samjin LND
Sample', '????(?).JPG')
--
Levente "Si vis pacem para bellum!"
- [rdiff-backup-users] one more bug in rdiff-backup-1.1.16, Farkas Levente, 2008/06/21
- Re: [rdiff-backup-users] one more bug in rdiff-backup-1.1.16, Andrew Ferguson, 2008/06/21
- Re: [rdiff-backup-users] one more bug in rdiff-backup-1.1.16, Farkas Levente, 2008/06/23
- Re: [rdiff-backup-users] one more bug in rdiff-backup-1.1.16, Andrew Ferguson, 2008/06/23
- Re: [rdiff-backup-users] one more bug in rdiff-backup-1.1.16, Farkas Levente, 2008/06/23
- Re: [rdiff-backup-users] one more bug in rdiff-backup-1.1.16, Andrew Ferguson, 2008/06/23
- Re: [rdiff-backup-users] one more bug in rdiff-backup-1.1.16,
Farkas Levente <=
- Re: [rdiff-backup-users] one more bug in rdiff-backup-1.1.16, Andrew Ferguson, 2008/06/23
- Re: [rdiff-backup-users] one more bug in rdiff-backup-1.1.16, Farkas Levente, 2008/06/24
- Re: [rdiff-backup-users] one more bug in rdiff-backup-1.1.16, Andrew Ferguson, 2008/06/24
- Re: [rdiff-backup-users] one more bug in rdiff-backup-1.1.16, Farkas Levente, 2008/06/29
- Re: [rdiff-backup-users] one more bug in rdiff-backup-1.1.16, Farkas Levente, 2008/06/30
- Re: [rdiff-backup-users] one more bug in rdiff-backup-1.1.16, Andrew Ferguson, 2008/06/30
- Re: [rdiff-backup-users] one more bug in rdiff-backup-1.1.16, Farkas Levente, 2008/06/30
- Re: [rdiff-backup-users] one more bug in rdiff-backup-1.1.16, Farkas Levente, 2008/06/24