Re: [Sks-devel] sks build times

[John Clizbe]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

Andy Ruddock wrote:
> Hi,
> 
> I'm currently rebuilding the database for keyserver.rainydayz.org.
> I'm using the normalbuild rather than the fastbuild.
> I'm presuming that the process displays the time taken after it's
> processed each file, which means that the rebuild is going to take about
> three weeks.

It's the time after processing each set of files, i.e. the value you have -n set
to on the sks build command line. On a 1.5G Hz Sempron box with 1GB RAM, I can
load just under 200,000 keys per pass without starting to swap. So, if I'm using
a dump from pramberger.at where each file is 25k keys, I use -n 7. From
linux.prato.it, each dump is 15k keys, and then I use -n 13.

ls -ltu on your dump directory will tell you the last access time for each file.
Add -r and you'll easily get the last file read in.

build takes about 6 hours on this box and pbuild approx 2.5 hrs.

> As it's a slow machine I reckoned the extra time spent building the
> database would be compensated for it running faster when it was finished.
> How much faster is the fastbuild process and how much slower does the
> server run when it's finished?

I don't know that this has ever been measured. I've never built with fastbuild

> Would it not be possible to get a file dump of the database and start
> with that?

I guess that could be done, but it would be significantly larger than the
existing key dumps.

- -- 
John P. Clizbe                      Inet:John (a) gingerbear.net
You can't spell fiasco without SCO. hkp://keyserver.gingerbear.net  or
     mailto:address@hidden

Q:"Just how do the residents of Haiku, Hawai'i hold conversations?"
A:"An odd melody / island voices on the winds / surplus of vowels"
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.11-svn5331-2010-05-07 (Windows XP)
Comment: When cryptography is outlawed, bayl bhgynjf jvyy unir cevinpl!
Comment: Be part of the £€37 ECHELON -- Use Strong Encryption.
Comment: It's YOUR right - for the time being.
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iF4EAREIAAYFAkvnGp8ACgkQ614Z89ZWmCV4dgD/W4wRWGaxV6CeXWXklYEcEMiq
d7WdVfnmO7TqJwd6/9QA/2a9//vjnn5J0Dbw2izWGV9djWTdRDSuQe2c1XIVRVI4
=VgPN
-----END PGP SIGNATURE-----