Re: [rdiff-backup-users] The rdiff-backup poll!

[Ben Escoto]

>>>>> Ben Escoto <address@hidden>
>>>>> wrote the following on Tue, 20 Dec 2005 20:45:10 -0600
>
> Ok, I'll take a stab at rewriting it.  My perl is worse than your
> python but I think I can handle it.

I checked in the first version into CVS, see:

http://cvs.savannah.nongnu.org/viewcvs/rdiff-backup/rdiff-backup-statistics?rev=1.1&root=rdiff-backup&view=markup

Here's some sample output after I ran it on one of my personal daily
backups:


SourceFileSize 19448821151 (18.1 GB)
MirrorFiles 1050384
MirrorFileSize 19440719611 (18.1 GB)
NewFiles 282
NewFileSize 1867465 (1.78 MB)
DeletedFiles 3
DeletedFileSize 2901879 (2.77 MB)
ChangedFiles 507
ChangedSourceSize 82952399 (79.1 MB)
ChangedMirrorSize 73816445 (70.4 MB)
IncrementFiles 805
IncrementFileSize 4886203 (4.66 MB)
TotalDestinationSizeChange 12987743 (12.4 MB)
Errors 0


Average statistics:
--------------[ Average of 140 stat files ]--------------
ElapsedTime 1771.61 (29 minutes 31.61 seconds)
SourceFiles 969912.807143
SourceFileSize 19839683232.8 (18.5 GB)
MirrorFiles 968478.25
MirrorFileSize 20041924181.7 (18.7 GB)
NewFiles 4522.62142857
NewFileSize 232045028.507 (221 MB)
DeletedFiles 3088.06428571
DeletedFileSize 437963283.793 (418 MB)
ChangedFiles 16055.1
ChangedSourceSize 373019259.279 (356 MB)
ChangedMirrorSize 369341952.936 (352 MB)
IncrementFiles 23702.4142857
IncrementFileSize 377228492.75 (360 MB)
TotalDestinationSizeChange 174987543.807 (167 MB)
Errors 40
---------------------------------------------------------


Top directories by source size (percent of total)
-------------------------------------------------
home/ben/Maildir (22.1%)
var/cache/yum/updates-released/packages (17.9%)
usr/share (15.3%)
usr (11.2%)
. (9.3%)
usr/lib64 (9.3%)
home/ben (8.4%)
usr/lib/openoffice.org2.0 (6.5%)

Top directories by increment size (percent of total)
----------------------------------------------------
home/ben/.spamassassin/bayes_toks (34.9%)
var/cache/yum/extras/primary.xml.gz (18.5%)
var/lib/slocate/slocate.db.tmp (12.9%)
var/cache/yum/updates-released/primary.xml.gz (8.3%)
var/cache/yum/updates-released/primary.xml.gz.sqlite (8.3%)
var (6.1%)
var/cache/yum/extras/primary.xml.gz.sqlite (6.0%)
home/ben (5.0%)

Top directories by number of files changed (percent of total)
-------------------------------------------------------------
home/ben/Maildir (49.1%)
var (10.1%)
home/ben/Maildir/.all/cur (9.7%)
home/ben/Maildir/.list/cur (8.7%)
home/ben/Maildir/.received/cur (7.8%)
home/ben (7.5%)
home/ben/Maildir/.lists.rdiff-backup/cur (5.8%)


Unfortunately it uses way too much memory now---1GB to make this
output.  It does hold the entire tree in memory, but 1k per file is
more than I expected.


-- 
Ben Escoto

pgpNEDqI8x8HO.pgp
Description: PGP signature