[Savannah-hackers-public] Re: hgweb going wild?

[Sylvain Beucler]

Hi,

On Sat, Sep 20, 2008 at 10:00:08PM +0200, Aleix Conchillo Flaqué wrote:
> On Sat, Sep 20, 2008 at 15:47, Sylvain Beucler <address@hidden> wrote:
> > Hi Aleix,
> >
> > I'd like to know if you've heard of issues with hgweb+wsgi.
> >
> 
> Not really. I've been like in a idle state for a couple of months. And
> I think I still am :-?.
> 
> > Savannah regularly gets 100% utilization (check
> > http://savannah.gnu.org:8080/cacti/graph_view.php) which is apparently
> > due to mod_wsgi (according to apache2 gdb backtraces).
> >
> 
> Oooops, bad news.
> 
> > I've recompiled apache2 and mod_wsgi without stripping debugging
> > symbols for inspection if needed.
> >
> 
> OK.
> 
> Tomorrow I am leaving for a week, so I will not be able to even check my 
> email.
> 
> I hope I can help when I am back (if the issue is still there).

The issue is still here.

I moved banned search engines, switched hgweb to CGI mode, which
wasn't enough, and I added a RLimitCPU 60 in Apache, which wasn't so
efficient:

root     30292  0.0  0.0  13576  5068 ?        Ss   Sep28   0:09 
/usr/sbin/apache2 -k start
www-data 30293  0.0  0.0  12532  2732 ?        S    Sep28   0:18  \_ 
/usr/sbin/apache2 -k start
www-data  9944 75.8  0.1  11484  9940 ?        R    07:46 428:53  |   \_ python 
/var/www/off-site/hgweb/hgwebdir.cgi
www-data 11598 57.9  0.1  11008  9740 ?        R    12:56 147:52  |   \_ python 
/var/www/off-site/hgweb/hgwebdir.cgi
www-data 13314 56.0  0.1  11008  9744 ?        R    13:11 134:55  |   \_ python 
/var/www/off-site/hgweb/hgwebdir.cgi
www-data 13676 55.9  0.1  11012  9748 ?        R    13:15 132:14  |   \_ python 
/var/www/off-site/hgweb/hgwebdir.cgi
www-data 17457  0.1  1.3 311488 78260 ?        Sl   Sep29   2:16  \_ 
/usr/sbin/apache2 -k start
www-data 16641  0.2  1.3 318616 81456 ?        Sl   Sep29   2:26  \_ 
/usr/sbin/apache2 -k start
www-data  2837  0.4  1.7 341644 103188 ?       Sl   01:26   4:03  \_ 
/usr/sbin/apache2 -k start

So apparently in some corner cases hgwebdir is eating all the CPU and doesn't 
quit.

-- 
Sylvain