rdiff-backup-users
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [rdiff-backup-users] Recurring error on RH


From: Joe Steele
Subject: Re: [rdiff-backup-users] Recurring error on RH
Date: Wed, 22 Jan 2014 12:51:06 -0500
User-agent: Mozilla/5.0 (Windows NT 5.1; rv:17.0) Gecko/20130801 Thunderbird/17.0.8

Based on experience with CentOS 4, I suspect that if you stat /usr/share/terminfo/P/P9-W on the source system, you will find that it has multiple hard links.

It could be totally irrelevant, but my first thought (because of the hard links) is that the problem may stem from this bug:
http://savannah.nongnu.org/bugs/?26848

Consequently, I would proceed by investigating the backup metadata.

From what you provided, it looks like /mnt/storage/srx-fhq-ocsi/rdiff-backup-data/mirror_metadata.2014-01-15T17:15:02+01:00.snapshot.gz is the metadata for the last successful backup (I'm presuming the error message about that file not existing is some sort of red herring caused by the regress script and that the file actually does exist).

I would look in that file and extract the metadata for the /usr/share/terminfo/P/P9-W file. I would also extract metadata for any other files shown with the same inode as /usr/share/terminfo/P/P9-W (i.e., all the other files that are hard linked to it).

The metadata for each file should contain a 'NumHardLinks' entry that matches the number of files found in the metadata. The *first* such file found in the metadata should also include a 'SHA1Digest' entry. I would check and see if those files exist within the backup mirror located under /mnt/storage/srx-fhq-ocsi (they would not be hardlinked together). I would check their SHA1Digest against the metadata value. I would check the metadata against what is found on the source system. I would look at the backup history of those files (e.g., "ls /mnt/storage/srx-fhq-ocsi/rdiff-backup-data/increments/usr/share/terminfo/P/P9-W*") to see when/if they changed.

Note that the bug report shows problems with inconsistent NumHardLinks entries and with the SHA1Digest not being attached to the *first* hardlinked file listed in the metadata.

What to do after that depends on what you find. Feel free to report back here anything relevant or unusual that you find.

--Joe


On 1/22/2014 4:18 AM, Laurent De Buyst wrote:
Hello everyone,


I'm hoping someone will be able to help me out with the error
below. I have a Red Hat 4.5 server which has been doing a backup
every day for a while now and all of a sudden this happens.

Something must have gone wrong with a backup and the following
error occurs every time it tries to regress.

I have tried using the rdiff-backup-regress script I got from
this list a few months ago, here's the output from that:

         Using repository: /mnt/storage/srx-fhq-ocsi
         Started wo jan 22 10:02:14 CET 2014
         Note: rdiff-backup recognises this repository as damaged
         About to regress /mnt/storage/srx-fhq-ocsi repository
from 2014-01-16T17:15:01+01:00
         2014-01-17T17:15:01+01:00 to 2014-01-15T17:15:02+01:00:
ok (y/-)? yRegression 1 of 1: from 2014-01-16T17:15:01+01:00
         2014-01-17T17:15:01+01:00 to 2014-01-15T17:15:02+01:00...

         <here it repeats verbatim the error below>

         There was an error 1 while attempting to regress
repository...
         ls: cannot access
/mnt/storage/srx-fhq-ocsi/rdiff-backup-data/mirror_metadata.2014-01-15T17:15:02+01:00.snapshot.gz:
No such file or directory
         Correcting ownership of 2 key files to root:root: chown:
cannot access
`/mnt/storage/srx-fhq-ocsi/rdiff-backup-data/mirror_metadata.2014-01-15T17:15:02+01:00.snapshot.gz':
No         such file or directory
         [FAIL] chown: cannot access
`/mnt/storage/srx-fhq-ocsi/rdiff-backup-data/current_mirror.2014-01-15T17:15:02+01:00.data':
No such file or directory
         [FAIL]
         Ended wo jan 22 10:04:17 CET 2014


And now for the really interesting bit: this isn't the first such
error I've seen.

About a year ago, I had the EXACT same error on the backup of a
server. And when I mean EXACT, it was absolutely the same,
complaining about the exact same files (the ELsmp/ELxenU
ipt_DSCP.ko and the terminfos). I never found a solution and
ended up nuking the backup and starting from scratch.

Then, starting early this month, the very SAME error occurred on
a backup. Again, no solution so I restarted from scratch.

And then now, two days after I did that, this backup gives me the
very same error.


So, by now, I have had 3 different occurrences of this error bite
me and I would really like to find a solution that does not
involve starting from scratch. Note that the last two errors came
from two different source servers, both running RH 4.5. I don't
remember that much about the incident one year ago, but I do
believe it was also a RH 4.5.

Help?

*Laurent De Buyst*
System administrator
ICT
address@hidden
----- Doorgestuurd door Laurent De Buyst/FHQ/USERS/FEDASIL op
2014-01-22 09:45 -----
address@hidden (Cron Daemon)*

2014-01-21 17:16

        
Aan
        
Cc
        
Onderwerp
        Cron <address@hidden> rdiff-backup --print-statistics
--exclude-special-files srx-fhq-ocsi::/mnt/backup
/mnt/storage/srx-fhq-ocsi > /var/log/fedbackup/srv-fhq-ocsi.log
(failed)


        





Previous backup seems to have failed, regressing destination now.
Warning, repeated index ('lib', 'modules', '2.6.9-55.ELsmp',
'kernel', 'net', 'ipv4', 'netfilter', 'ipt_DSCP.ko'), bad filesystem?
Warning, repeated index ('lib', 'modules', '2.6.9-55.ELxenU',
'kernel', 'net', 'ipv4', 'netfilter', 'ipt_DSCP.ko'), bad filesystem?
Exception 'Bad index order: ('usr', 'share', 'terminfo', 'P',
'P9-W') >= ('usr', 'share', 'terminfo', 'P')' raised of class
'<type 'exceptions.AssertionError'>':
  File "/usr/lib/python2.7/dist-packages/rdiff_backup/Main.py",
line 304, in error_check_Main
    try: Main(arglist)
  File "/usr/lib/python2.7/dist-packages/rdiff_backup/Main.py",
line 324, in Main
    take_action(rps)
  File "/usr/lib/python2.7/dist-packages/rdiff_backup/Main.py",
line 280, in take_action
    elif action == "backup": Backup(rps[0], rps[1])
  File "/usr/lib/python2.7/dist-packages/rdiff_backup/Main.py",
line 337, in Backup
    backup_final_init(rpout)
  File "/usr/lib/python2.7/dist-packages/rdiff_backup/Main.py",
line 501, in backup_final_init
    checkdest_if_necessary(rpout)
  File "/usr/lib/python2.7/dist-packages/rdiff_backup/Main.py",
line 920, in checkdest_if_necessary
    dest_rp.conn.regress.Regress(dest_rp)
  File
"/usr/lib/python2.7/dist-packages/rdiff_backup/regress.py", line
71, in Regress
    for rf in iterate_meta_rfs(mirror_rp, inc_rpath):
ITR(rf.index, rf)
  File
"/usr/lib/python2.7/dist-packages/rdiff_backup/rorpiter.py", line
275, in __call__
    assert 0, "Bad index order: %s >= %s" % (self.index, index)

Traceback (most recent call last):
  File "/usr/bin/rdiff-backup", line 30, in <module>
    rdiff_backup.Main.error_check_Main(sys.argv[1:])
  File "/usr/lib/python2.7/dist-packages/rdiff_backup/Main.py",
line 304, in error_check_Main
    try: Main(arglist)
  File "/usr/lib/python2.7/dist-packages/rdiff_backup/Main.py",
line 324, in Main
    take_action(rps)
  File "/usr/lib/python2.7/dist-packages/rdiff_backup/Main.py",
line 280, in take_action
    elif action == "backup": Backup(rps[0], rps[1])
  File "/usr/lib/python2.7/dist-packages/rdiff_backup/Main.py",
line 337, in Backup
    backup_final_init(rpout)
  File "/usr/lib/python2.7/dist-packages/rdiff_backup/Main.py",
line 501, in backup_final_init
    checkdest_if_necessary(rpout)
  File "/usr/lib/python2.7/dist-packages/rdiff_backup/Main.py",
line 920, in checkdest_if_necessary
    dest_rp.conn.regress.Regress(dest_rp)
  File
"/usr/lib/python2.7/dist-packages/rdiff_backup/regress.py", line
71, in Regress
    for rf in iterate_meta_rfs(mirror_rp, inc_rpath):
ITR(rf.index, rf)
  File
"/usr/lib/python2.7/dist-packages/rdiff_backup/rorpiter.py", line
275, in __call__
    assert 0, "Bad index order: %s >= %s" % (self.index, index)
AssertionError: Bad index order: ('usr', 'share', 'terminfo',
'P', 'P9-W') >= ('usr', 'share', 'terminfo', 'P')


_______________________________________________
rdiff-backup-users mailing list at address@hidden
https://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki




reply via email to

[Prev in Thread] Current Thread [Next in Thread]