Re: [rdiff-backup-users] Problems with file permissions

[Ralph Lehmann]

Andrew Ferguson schrieb:
> Ralph Lehmann wrote:
>> After including the three new files from CVS I've a permission problem
>> now with the mirror-metadata files on Cygwin:
> 
> Ok, having permissions 000 on mirror_metadata is just weird. Try setting
> them back to 600 and the problem should go away. 

Unfortunately not. On next backup, rdiff-backup creates a new
mirror_metadata with 000 permissions and tries to access it, which fails.
--------------------------------------------------------------------------
ls -l mirror*
-rw------- 1 lehmann2 Kein 263 Jul  9 10:39
mirror_metadata.2007-07-09T10;05839;05825+02;05800.snapshot.gz
---------- 1 lehmann2 Kein 263 Jul  9 16:09
mirror_metadata.2007-07-09T16;05809;05830+02;05800.snapshot.gz

chmod 600 chmod 600 mirror_metadata*
ls -l mirror*
-rw------- 1 lehmann2 Kein 263 Jul  9 10:39
mirror_metadata.2007-07-09T10;05839;05825+02;05800.snapshot.gz
-rw------- 1 lehmann2 Kein 263 Jul  9 16:09
mirror_metadata.2007-07-09T16;05809;05830+02;05800.snapshot.gz

cd ../../
rdiff-backup -v9 -b foo/ bar/
Mon Jul  9 16:18:59 2007  Unable to import module xattr.
Extended attributes not supported on filesystem at foo
Mon Jul  9 16:18:59 2007  Unable to import module posix1e from pylibacl
package.
ACLs not supported on filesystem at foo
Mon Jul  9 16:18:59 2007  escape_dos_devices required by filesystem at foo
Mon Jul  9 16:18:59 2007
-----------------------------------------------------------------
Detected abilities for source (read only) file system:
  Access control lists                         Off
  Extended attributes                          Off
  Case sensitivity                             Off
  Escape DOS devices                           On
  Mac OS X style resource forks                Off
  Mac OS X Finder information                  Off
-----------------------------------------------------------------
Mon Jul  9 16:18:59 2007  Making directory
bar/rdiff-backup-data/rdiff-backup.tmp.0
Mon Jul  9 16:18:59 2007  Touching
bar/rdiff-backup-data/rdiff-backup.tmp.0/5-_ a.snapshot.gz
Mon Jul  9 16:18:59 2007  Deleting
bar/rdiff-backup-data/rdiff-backup.tmp.0/5-_ a.snapshot.gz
Mon Jul  9 16:18:59 2007  Touching
bar/rdiff-backup-data/rdiff-backup.tmp.0/:\ á"%
Mon Jul  9 16:18:59 2007  Touching
bar/rdiff-backup-data/rdiff-backup.tmp.0/A
Mon Jul  9 16:18:59 2007  Deleting
bar/rdiff-backup-data/rdiff-backup.tmp.0/a
Mon Jul  9 16:18:59 2007  Touching
bar/rdiff-backup-data/rdiff-backup.tmp.0/foo
Mon Jul  9 16:18:59 2007  Deleting
bar/rdiff-backup-data/rdiff-backup.tmp.0/foo
Mon Jul  9 16:18:59 2007  Making directory
bar/rdiff-backup-data/rdiff-backup.tmp.0/hl
Mon Jul  9 16:18:59 2007  Touching
bar/rdiff-backup-data/rdiff-backup.tmp.0/hardlinked_file1
Mon Jul  9 16:18:59 2007  Hard linking
bar/rdiff-backup-data/rdiff-backup.tmp.0/hl/hardlinked_file2 to
bar/rdiff-backup-data/rdiff-backup.
Mon Jul  9 16:18:59 2007  Unable to import module xattr.
Extended attributes not supported on filesystem at
bar/rdiff-backup-data/rdiff-backup.tmp.0
Mon Jul  9 16:18:59 2007  Unable to import module posix1e from pylibacl
package.
ACLs not supported on filesystem at bar/rdiff-backup-data/rdiff-backup.tmp.0
Mon Jul  9 16:18:59 2007  Touching
bar/rdiff-backup-data/rdiff-backup.tmp.0/dir_inc_check
Mon Jul  9 16:18:59 2007  Deleting
bar/rdiff-backup-data/rdiff-backup.tmp.0/dir_inc_check
Mon Jul  9 16:18:59 2007  Touching
bar/rdiff-backup-data/rdiff-backup.tmp.0/regfile
Mon Jul  9 16:18:59 2007  Deleting
bar/rdiff-backup-data/rdiff-backup.tmp.0/regfile
Mon Jul  9 16:18:59 2007  Touching
bar/rdiff-backup-data/rdiff-backup.tmp.0/high_perms
Mon Jul  9 16:18:59 2007  Deleting
bar/rdiff-backup-data/rdiff-backup.tmp.0/high_perms
Mon Jul  9 16:18:59 2007  Touching
bar/rdiff-backup-data/rdiff-backup.tmp.0/symlinked_file1
Mon Jul  9 16:18:59 2007  Deleting
bar/rdiff-backup-data/rdiff-backup.tmp.0/symlinked_file2
Mon Jul  9 16:18:59 2007  Deleting
bar/rdiff-backup-data/rdiff-backup.tmp.0/symlinked_file1
Mon Jul  9 16:18:59 2007  escape_dos_devices required by filesystem at
bar/rdiff-backup-data/rdiff-backup.tmp.0
Mon Jul  9 16:18:59 2007  Deleting bar/rdiff-backup-data/rdiff-backup.tmp.0
Mon Jul  9 16:18:59 2007  Removing directory
bar/rdiff-backup-data/rdiff-backup.tmp.0
Mon Jul  9 16:18:59 2007
-----------------------------------------------------------------
Detected abilities for destination (read/write) file system:
  Ownership changing                           Off
  Hard linking                                 On
  fsync() directories                          On
  Directory inc permissions                    On
  High-bit permissions                         On
  Symlink permissions                          Off
  Extended filenames                           Off
  Access control lists                         Off
  Extended attributes                          Off
  Case sensitivity                             Off
  Escape DOS devices                           On
  Mac OS X style resource forks                Off
  Mac OS X Finder information                  Off
-----------------------------------------------------------------
Mon Jul  9 16:19:00 2007  Backup: must_escape_dos_devices = 1
Mon Jul  9 16:19:00 2007  Previous backup seems to have failed,
regressing destination now.
Mon Jul  9 16:19:00 2007  Regressing to Mon Jul  9 10:39:25 2007
Mon Jul  9 16:19:00 2007  Deleting old diff at
bar/rdiff-backup-data/file_statistics.2007-07-09T16;05809;05830+02;05800.data.gz
Mon Jul  9 16:19:00 2007  Deleting
bar/rdiff-backup-data/file_statistics.2007-07-09T16;05809;05830+02;05800.data.gz
Mon Jul  9 16:19:00 2007  Deleting old diff at
bar/rdiff-backup-data/mirror_metadata.2007-07-09T16;05809;05830+02;05800.snapshot.gz
Mon Jul  9 16:19:00 2007  Deleting
bar/rdiff-backup-data/mirror_metadata.2007-07-09T16;05809;05830+02;05800.snapshot.gz
Mon Jul  9 16:19:00 2007  Deleting
bar/rdiff-backup-data/current_mirror.2007-07-09T16;05809;05830+02;05800.data
Mon Jul  9 16:19:00 2007  Writing mirror marker
bar/rdiff-backup-data/current_mirror.2007-07-09T16;05818;05859+02;05800.data
Mon Jul  9 16:19:00 2007  Starting increment operation foo to bar
Mon Jul  9 16:19:00 2007  Writing mirror_metadata diff
Traceback (most recent call last):
  File "/usr/bin/rdiff-backup", line 23, in <module>
    rdiff_backup.Main.Main(sys.argv[1:])
  File "/usr/lib/python2.5/site-packages/rdiff_backup/Main.py", line
319, in Main
    take_action(rps)
  File "/usr/lib/python2.5/site-packages/rdiff_backup/Main.py", line
275, in take_action
    elif action == "backup": Backup(rps[0], rps[1])
  File "/usr/lib/python2.5/site-packages/rdiff_backup/Main.py", line
338, in Backup
    backup.Mirror_and_increment(rpin, rpout, incdir)
  File "/usr/lib/python2.5/site-packages/rdiff_backup/backup.py", line
51, in Mirror_and_increment
    DestS.patch_and_increment(dest_rpath, source_diffiter, inc_rpath)
  File "/usr/lib/python2.5/site-packages/rdiff_backup/backup.py", line
231, in patch_and_increment
    cls.CCPP.close()
  File "/usr/lib/python2.5/site-packages/rdiff_backup/backup.py", line
477, in close
    metadata.ManagerObj.ConvertMetaToDiff()
  File "/usr/lib/python2.5/site-packages/rdiff_backup/metadata.py", line
618, in ConvertMetaToDiff
    new_iter = MetadataFile(newrp, 'r').get_objects()
  File "/usr/lib/python2.5/site-packages/rdiff_backup/metadata.py", line
379, in __init__
    self.fileobj = self.rp.open("rb", compress)
  File "/usr/lib/python2.5/site-packages/rdiff_backup/rpath.py", line
1033, in open
    if compress: return GzipFile(self.path, mode)
  File "/usr/lib/python2.5/gzip.py", line 95, in __init__
    fileobj = self.myfileobj = __builtin__.open(filename, mode or 'rb')
IOError: [Errno 13] Permission denied:
'bar/rdiff-backup-data/mirror_metadata.2007-07-09T16;05818;05859+02;05800.snapshot.gz'

ls -l bar/rdiff-backup-data/mirror_metadata*
-rw------- 1 lehmann2 Kein 263 Jul  9 10:39
bar/rdiff-backup-data/mirror_metadata.2007-07-09T10;05839;05825+02;05800.snapshot.gz
---------- 1 lehmann2 Kein 263 Jul  9 16:19
bar/rdiff-backup-data/mirror_metadata.2007-07-09T16;05818;05859+02;05800.snapshot.gz
--------------------------------------------------------------------------------------

> Do any other files
> (say, in ./rdiff-backup-data/increments/ ) have this problem? 

No, all seems to be in order:
-----------------------------
drwx------+ 3 lehmann2 Kein 0 Jul  9 16:19 rdiff-backup-data
-rw-r--r--  1 lehmann2 Kein 2 Jul  9 10:39 test.txt

./bar/rdiff-backup-data:
total 12
-rw-------  1 lehmann2 Kein 2744 Jul  9 16:19 backup.log
-rw-------  1 lehmann2 Kein   15 Jul  9 10:39 chars_to_quote
-rw-------  1 lehmann2 Kein    9 Jul  9 10:39
current_mirror.2007-07-09T10;05839;05825+02;05800.data
-rw-------  1 lehmann2 Kein    9 Jul  9 16:19
current_mirror.2007-07-09T16;05818;05859+02;05800.data
-rw-------  1 lehmann2 Kein    0 Jul  9 10:39
error_log.2007-07-09T10;05839;05825+02;05800.data
-rw-------  1 lehmann2 Kein  205 Jul  9 10:39
file_statistics.2007-07-09T10;05839;05825+02;05800.data.gz
-rw-------  1 lehmann2 Kein   88 Jul  9 16:19
file_statistics.2007-07-09T16;05818;05859+02;05800.data.gz
drwx------+ 2 lehmann2 Kein    0 Jul  9 10:39 increments
-rw-------  1 lehmann2 Kein  263 Jul  9 10:39
mirror_metadata.2007-07-09T10;05839;05825+02;05800.snapshot.gz
----------  1 lehmann2 Kein  263 Jul  9 16:19
mirror_metadata.2007-07-09T16;05818;05859+02;05800.snapshot.gz
-rw-------  1 lehmann2 Kein  462 Jul  9 10:39
session_statistics.2007-07-09T10;05839;05825+02;05800.data

./bar/rdiff-backup-data/increments:
total 0

./foo:
total 1
-rw-r--r-- 1 lehmann2 Kein 2 Jul  9 10:39 test.txt

./recover:
total 0
-------------------------------------------------------------------------


> What are
> the permissions on the ./rdiff-backup-data/ dir itself? 

See above.

> It also looks
> like you have ACL's on the increments dir (the + sign after the
> permissions).

If I disable ACLs on Cygwin with CYGWIN=nontsec
rdiff-backup hangs after:
----------------------------------------------
address@hidden ~/test2
$ rdiff-backup -v9 -b foo/ bar/
Mon Jul  9 16:48:00 2007  Unable to import module xattr.
Extended attributes not supported on filesystem at foo
Mon Jul  9 16:48:00 2007  Unable to import module posix1e from pylibacl
package.

ACLs not supported on filesystem at foo
----------------------------------------------
The option "--no-acls" don't helps.

> If you make a new repository does the problem appear?

On the first run all seems to be in order, because no mirror_marker will
be created. On the second run -> see above. :-/

>> On Slackware, backup fails too:
> 
> Your Slackware system is not running the latest version. Please update
> all of the files to the current CVS versions. I know that bug is fixed.

I'll try it again.

ciao Ralph