[Sks-devel] Issue Importing Database Dump (Dents in my forehead)

[Brian D Heaton]

Howdy,  I'm Brian and I'm trying to get a keyserver running on a
Rackspace hosted cloud server.  Reading the archives about brokeness in
the Ubuntu packages, I've compiled both BDB and SKS from source. 
Attempting the full-build, the system deadlocks after reading in the 3rd
of 4th dump file.  I'm able to build the DB with a single dump file
(testing).  If I then manually do the cleandb and pbuild, those steps
succeed.    I then attempt to do a merge one at a time with the
remaining dump files, by the 3rd or 4th file, I get a mutex error.  I've
provided a lot of information below based on my reading of the archives
and the questions usually asked when someone posts an issue.

I'm sure I'm missing a simple option somewhere.  I'm open to hints,
whacks over the head, or even simple solutions. :)

THX-Brian
---------------------------------------------------------

OS: Ubuntu 12.04 (LTS)
ARCH:  X86-AMD64
RAM: 1GB
BDB Version: 5.3.21
SKS Version: 1.1.3 and 1.1.4 (cloned repository)

BDB Detail:
-- Configured with with pthread and posixmutex.  I've also built it
without posixmutex with no change.
-- Confirmed that sks is linked against libdb-5.3.so via ldd.
-- Confirmed that only libraries and headers for v5.3 are present.


Output of initial build:
----
address@hidden:/var/lib/sks# sks build /var/lib/sks/dump/sks-dump-0001.pgp
-debug -debuglevel 10 -stdoutlog -cache 100
2012-06-16 04:42:35 Opening KeyDB database
Loading keys...done
DB time:  0.03 min.  Total time: 0.04 min.
---

Output of PTree Build:
---
address@hidden:/var/lib/sks# sks pbuild -cache 20 -ptree_cache 70
-diskptree -debug -debuglevel 10 -stdoutlog
2012-06-16 04:45:21 Opening PTree database
2012-06-16 04:45:22 Opening dbs...
2012-06-16 04:45:22 Opening KeyDB database
2012-06-16 04:45:22 5000 hashes processed
2012-06-16 04:45:22 10000 hashes processed
2012-06-16 04:45:23 15000 hashes processed
2012-06-16 04:45:23 Cleaning Tree.
---

Failing output of merge:
--
sks merge /var/lib/sks/dump/sks-dump-0002.pgp -debug -debuglevel 10
-stdoutlog -cache 100
...
....
2012-06-16 04:48:35 Adding hash 03C0D889F24E3D48DB6B0572504947F3
2012-06-16 04:48:36 Fatal database error: Bdb.DBError("BDB2034 unable to
allocate memory for mutex; resize mutex region")
2012-06-16 04:48:36 closing database...


DB_CONFIG file present in both KDB and PTree directories:
Note:  Yes, I got frustrated and cranked up the mutex_set_max.  Looking
at "dbstat -x" it doesn't appear mutexes are being released between
merge runs.
----
set_mp_mmapsize         268435456
set_cachesize    0      134217728 1
set_flags               DB_LOG_AUTOREMOVE
set_lg_regionmax        1048576
set_lg_max              10485760
set_lg_bsize            2097152
set_lk_detect           DB_LOCK_DEFAULT
set_tmp_dir             /tmp
set_lock_timeout        1000
set_txn_timeout         1000
mutex_set_max           655360000
set_mp_mmapsize         16777216
---