[Mldonkey-bugs] [bug #34110] Shared files scan at startup introduces too much file cache

[Huang Hang]

URL:
  <http://savannah.nongnu.org/bugs/?34110>

                 Summary: Shared files scan at startup introduces too much
file cache
                 Project: mldonkey, a multi-networks file-sharing client
            Submitted by: seakage2h
            Submitted on: Wed 24 Aug 2011 04:25:53 AM GMT
                Category: Core
                Severity: 3 - Normal
              Item Group: Program malfunction
                  Status: None
             Assigned to: None
             Open/Closed: Open
         Discussion Lock: Any
                 Release: All
                 Release: 3.1.0
        Operating System: Linux
         Binaries Origin: Gentoo ebuild
                CPU type: None

    _______________________________________________________

Details:

At present, when mldonkey is starting up(start by init scripts or by manually
called), it will do a full range scan of all shared files in the shared paths.
If there're a lot of shared files, the scanning will introduced huge amount of
file caches and the whole performance of the system is quite slow.

For example, in my case, I have 2000+ files and totally in 220+ GB large(some
are small ebooks, while some are large movies). I've setup mldonkey
auto-startup in Gentoo. After system boot up and mldonkey is running, my
harddisk will keep busy for a couple of minutes, CPU usage is ~20%, and all 4G
memory are occupied by file cache, and ~70M swap in use. If I don't make
mldonkey auto-startup, this won't happen.

So I think mldonkey should do incremental scan instead of the full scan. Since
the info of all shared files are stored in shared_files_new.ini, mldonkey can
check whether the shared file is in the list or not, just fully examine those
not in the list, and delay verification of the file info when the shared file
is requested(e.g. recompute the MD4 sum when other clients ask for sharing the
file).




    _______________________________________________________

Reply to this item at:

  <http://savannah.nongnu.org/bugs/?34110>

_______________________________________________
  Message sent via/by Savannah
  http://savannah.nongnu.org/