Re: [Gnewsense-dev] gnewsense.org unreachable?

[Sam Geeraerts]

Op Sun, 8 May 2016 18:15:29 +0200
schreef "address@hidden" <address@hidden>:

> the website http://gnewsense.org/ seems unreachable.

The web server is under heavy load:

load average: 19.88, 16.97, 16.09

Processes are mostly in waiting state:

%Cpu(s):  1.5 us,  0.2 sy,  0.0 ni,  0.0 id, 98.3 wa,  0.0 hi,  0.0
si,  0.0 st

There's some swapping going on:

# free -h
             total     used       free     shared    buffers     cached
Mem:          508M     503M       5.1M         0B       1.9M       8.8M
-/+ buffers/cache:     493M        15M
Swap:         2.0G     436M       1.6G
# iotop -o -b -n1
Total DISK READ:       3.63 K/s | Total DISK WRITE:       0.00 B/s
  TID  PRIO  USER     DISK READ  DISK WRITE  SWAPIN      IO    COMMAND
   22 be/4 root        0.00 B/s    0.00 B/s  0.00 % 72.79 % [kswapd0]
  184 be/4 root        0.00 B/s    7.71 K/s  0.00 % 17.41 % [kjournald]
 8528 be/4 www-data    3.63 K/s    0.00 B/s  2.26 %  0.00 % apache2 -k start
 6432 be/4 www-data    6.80 K/s  464.52 B/s  3.13 %  0.00 % apache2 -k start
 6442 be/4 www-data    4.08 K/s  929.04 B/s  2.02 %  0.00 % apache2 -k start
 6445 be/4 www-data  464.52 B/s    0.00 B/s 11.24 %  0.00 % apache2 -k start

So Apache looks pretty busy. But what's it doing? I've attached the last 100 
lines of Apache's access and error logs (anonymized). We have a fairly active 
SemrushBot. I already put a disallow for it in robots.txt yesterday, but it 
apparently it hasn't picked up on that yet. But this does not look like an 
immense amount of traffic. I suspect Moin's timeouts happen because of swapping.

I could ask FSF sysadmins for some more RAM, but I'd like to find the root 
cause of this high system load first. I find it unlikely that this traffic is 
to blame for it.

gnewsense.access.log
Description: Text Data

gnewsense.error.log
Description: Text Data