[rdiff-backup-users] Bad index order during --check-destination-directory

[Giorgio Moscardi]

Hi,

I have recently started using rdiff-backup to backup the personal data
of the users of a server I administer. The backup is scheduled to run at
night (through cron), while everybody is out of office.

It all worked fine until last night. This morning I got a mail from cron
reporting some backup errors (filenames obfuscated):

UpdateError aaa/bbb/ccc/ddd.xxx [Errno 13] Permission denied
UpdateError aaa/bbb/ccc/eee.xxx [Errno 5] Input/output error
Exception '[Errno 26] Text file busy:
'/mnt/backup/linux/backup_new/aaa/bbb/ccc/rdiff-backup.tmp.10'' raised
of class 'exceptions.OSError':
  File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line
304, in error_check_Main
    try: Main(arglist)
  File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line
324, in Main
    take_action(rps)
  File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line
280, in take_action
    elif action == "backup": Backup(rps[0], rps[1])
  File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line
343, in Backup
    backup.Mirror_and_increment(rpin, rpout, incdir)
  File "/usr/lib/python2.3/site-packages/rdiff_backup/backup.py", line
51, in Mirror_and_increment
    DestS.patch_and_increment(dest_rpath, source_diffiter, inc_rpath)
  File "/usr/lib/python2.3/site-packages/rdiff_backup/backup.py", line
243, in patch_and_increment
    ITR(diff.index, diff)
  File "/usr/lib/python2.3/site-packages/rdiff_backup/rorpiter.py", line
281, in __call__
    last_branch.fast_process(*args)
  File "/usr/lib/python2.3/site-packages/rdiff_backup/backup.py", line
710, in fast_process
    if tf.lstat(): tf.delete()
  File "/usr/lib/python2.3/site-packages/rdiff_backup/rpath.py", line
1072, in delete
    try: self.conn.os.unlink(self.path)

Traceback (most recent call last):
  File "/usr/bin/rdiff-backup", line 30, in ?
    rdiff_backup.Main.error_check_Main(sys.argv[1:])
  File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line
304, in error_check_Main
    try: Main(arglist)
  File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line
324, in Main
    take_action(rps)
  File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line
280, in take_action
    elif action == "backup": Backup(rps[0], rps[1])
  File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line
343, in Backup
    backup.Mirror_and_increment(rpin, rpout, incdir)
  File "/usr/lib/python2.3/site-packages/rdiff_backup/backup.py", line
51, in Mirror_and_increment
    DestS.patch_and_increment(dest_rpath, source_diffiter, inc_rpath)
  File "/usr/lib/python2.3/site-packages/rdiff_backup/backup.py", line
243, in patch_and_increment
    ITR(diff.index, diff)
  File "/usr/lib/python2.3/site-packages/rdiff_backup/rorpiter.py", line
281, in __call__
    last_branch.fast_process(*args)
  File "/usr/lib/python2.3/site-packages/rdiff_backup/backup.py", line
710, in fast_process
    if tf.lstat(): tf.delete()
  File "/usr/lib/python2.3/site-packages/rdiff_backup/rpath.py", line
1072, in delete
    try: self.conn.os.unlink(self.path)
OSError: [Errno 26] Text file busy:
'/mnt/backup/linux/backup_new/aaa/bbb/ccc/rdiff-backup.tmp.10'


This error was probably due to network issues (/mnt/backup is a
smbmount'ed share from a Windows server).

Unfortunately, when I went to run rdiff-backup --check-destination in
order to clean the backup and start it again, I got the following error:

srvlinux root # rdiff-backup --check-destination-dir
/mnt/backup/linux/backup_new/
Warning: hard linking not supported by filesystem at
/mnt/backup/linux/backup_new/rdiff-backup-data
Exception 'Bad index order: ('long_filename_data', '1') >= ('yyy',
'zzz', 'somedir', 'someotherdir', 'somefile')' raised of class
'exceptions.AssertionError':
  File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line
304, in error_check_Main
    try: Main(arglist)
  File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line
324, in Main
    take_action(rps)
  File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line
282, in take_action
    elif action == "check-destination-dir": CheckDest(rps[0])
  File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line
857, in CheckDest
    dest_rp.conn.regress.Regress(dest_rp)
  File "/usr/lib/python2.3/site-packages/rdiff_backup/regress.py", line
71, in Regress
    for rf in iterate_meta_rfs(mirror_rp, inc_rpath): ITR(rf.index, rf)
  File "/usr/lib/python2.3/site-packages/rdiff_backup/rorpiter.py", line
275, in __call__
    assert 0, "Bad index order: %s >= %s" % (self.index, index)

Traceback (most recent call last):
  File "/usr/bin/rdiff-backup", line 30, in ?
    rdiff_backup.Main.error_check_Main(sys.argv[1:])
  File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line
304, in error_check_Main
    try: Main(arglist)
  File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line
324, in Main
    take_action(rps)
  File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line
282, in take_action
    elif action == "check-destination-dir": CheckDest(rps[0])
  File "/usr/lib/python2.3/site-packages/rdiff_backup/Main.py", line
857, in CheckDest
    dest_rp.conn.regress.Regress(dest_rp)
  File "/usr/lib/python2.3/site-packages/rdiff_backup/regress.py", line
71, in Regress
    for rf in iterate_meta_rfs(mirror_rp, inc_rpath): ITR(rf.index, rf)
  File "/usr/lib/python2.3/site-packages/rdiff_backup/rorpiter.py", line
275, in __call__
    assert 0, "Bad index order: %s >= %s" % (self.index, index)
AssertionError: Bad index order: ('long_filename_data', '1') >= ('yyy',
'zzz', 'somedir', 'someotherdir', 'somefile')


This error always occurs when I try to --check-destination-directory or
when I try to run a backup (because it tries to clean the directory
first, I guess). Now, the FAQ only seem to deal with the "Bad index
error" when it occurs during a backup, rather than during the cleaning,
so I don't know what to do.

Is there any way to bring my backup folder back to working order?

I am using rdiff-backup 1.2.6.

Thanks,
Giorgio