Mar 27 08:05:44 DNTX014 abrt[10150]: Saved core dump of pid 5803
(/usr/local/sbin/nginx) to /var/spool/abrt/ccpp-2014-03-27-12:05:44-5803
(60538880 bytes)
Could someone tell me what is that ?
Regards.
Shahzaib
Hello!
On Thu, Mar 27, 2014 at 12:37:29PM +0500, shahzaib shahzaib wrote:
Mar 27 08:05:44 DNTX014 abrt[10150]: Saved core dump of pid 5803
(/usr/local/sbin/nginx) to /var/spool/abrt/ccpp-2014-03-27-12:05:44-5803
(60538880 bytes)Could someone tell me what is that ?
–
Maxim D.
http://nginx.org/
Hi,
Mar 27 08:05:44 DNTX014 abrt[10150]: Saved core dump of pid 5803
(/usr/local/sbin/nginx) to
/var/spool/abrt/ccpp-2014-03-27-12:05:44-5803 (60538880 bytes)Could someone tell me what is that ?
Its a crash.
Provide output of “/usr/local/sbin/nginx -V” and check:
http://nginx.org/en/docs/debugging_log.html
Regards,
Lukas
nginx -V
nginx version: nginx/1.2.8
I have found not a single issue with 1.2.1 but all other versions have
some
kind of issue.
Regards.
Shahzaib
sorry the same issue have found with nginx-1.2.1 
I enabled debugging and following is the error_log :
2014/03/27 15:26:09 [debug] 8185#0: *2118538 http write filter: l:0 f:1
s:141632
2014/03/27 15:26:09 [debug] 8185#0: *2118538 http write filter limit
131072
2014/03/27 15:26:09 [debug] 8185#0: *2118538 writev: 131072
2014/03/27 15:26:09 [debug] 8185#0: *2118538 http write filter
000000000130A8B0
2014/03/27 15:26:09 [debug] 8185#0: *2118538 event timer del: 27:
1395916149293
2014/03/27 15:26:09 [debug] 8185#0: *2118538 event timer add: 27:
213:1395915969928
2014/03/27 15:26:09 [debug] 8185#0: *2118538 http copy filter: -2
“/files/videos/2014/03/24/1395674643a4202-240.mp4?”
2014/03/27 15:26:09 [debug] 8185#0: *2118538 http writer output filter:
-2,
“/files/videos/2014/03/24/1395674643a4202-240.mp4?”
2014/03/27 15:26:09 [debug] 8178#0: *2118703 event timer del: 90:
1395915969743
2014/03/27 15:26:09 [debug] 8178#0: *2118703 http run request:
“/files/videos/2014/03/25/13957610474dea7-240.mp4?”
2014/03/27 15:26:09 [debug] 8178#0: *2118703 http writer handler:
“/files/videos/2014/03/25/13957610474dea7-240.mp4?”
2014/03/27 15:26:09 [debug] 8178#0: *2118703 event timer add: 90:
180000:1395916149744
2014/03/27 15:26:09 [debug] 8178#0: *2118688 event timer del: 79:
1395915969760
2014/03/27 15:26:09 [debug] 8178#0: *2118688 http run request:
“/files/videos/2014/03/23/1395581722c99fc-240.mp4?”
2014/03/27 15:26:09 [debug] 8178#0: *2118688 http writer handler:
“/files/videos/2014/03/23/1395581722c99fc-240.mp4?”
2014/03/27 15:26:09 [debug] 8178#0: *2118688 http output filter
“/files/videos/2014/03/23/1395581722c99fc-240.mp4?”
2014/03/27 15:26:09 [debug] 8178#0: *2118688 http copy filter:
“/files/videos/2014/03/23/1395581722c99fc-240.mp4?”
2014/03/27 15:26:09 [debug] 8178#0: *2118688 http postpone filter
“/files/videos/2014/03/23/1395581722c99fc-240.mp4?” 0000000000000000
2014/03/27 15:26:09 [debug] 8178#0: *2118688 write old buf t:1 f:0
0000000001E92650, pos 0000000001EF2650, size: 131072 file: 0, size: 0
2014/03/27 15:26:09 [debug] 8178#0: *2118688 http write filter: l:0 f:1
s:131072
2014/03/27 15:26:09 [debug] 8178#0: *2118688 http write filter limit
131072
2014/03/27 15:26:09 [debug] 8178#0: *2118688 writev: 131072
2014/03/27 15:26:09 [debug] 8178#0: *2118688 http write filter
0000000000000000
2014/03/27 15:26:09 [debug] 8178#0: *2118688 event timer add: 79:
213:1395915969973
2014/03/27 15:26:09 [debug] 8178#0: *2118688 read: 80, 0000000001E92650,
524288, 3306231
2014/03/27 15:26:09 [debug] 8178#0: *2118688 http postpone filter
“/files/videos/2014/03/23/1395581722c99fc-240.mp4?” 0000000001493110
2014/03/27 15:26:09 [debug] 8178#0: *2118688 write new buf t:1 f:0
0000000001E92650, pos 0000000001E92650, size: 524288 file: 0, size: 0
2014/03/27 15:26:09 [debug] 8178#0: *2118688 http write filter: l:0 f:1
s:524288
2014/03/27 15:26:09 [debug] 8178#0: *2118688 http copy filter: -2
“/files/videos/2014/03/23/1395581722c99fc-240.mp4?”
2014/03/27 15:26:09 [debug] 8178#0: *2118688 http writer output filter:
-2,
“/files/videos/2014/03/23/1395581722c99fc-240.mp4?”
Regards.
Shahzaib
Thats not the complete output of -V (capital letter). Either you
truncated the output by yourself or you sent us the output of -v.Please send the complete output of “nginx -V”, where the V is a
capital letter.Also compile nginx without third party modules.
And, also important, upgrade to latest stable1.4.7.
[root@DNTX002 nginx-1.2.1]# nginx -V
nginx version: nginx/1.2.1
built by gcc 4.4.6 20120305 (Red Hat 4.4.6-4) (GCC)
configure arguments: --add-module=/root/nginx_mod_h264_streaming-2.2.7
–with-http_flv_module --with-file-aio --sbin-path=/usr/local/sbin
–with-debug
we’re using nginx for streaming videos like youtube.com. Usually it is
5000
concurrent connections on the server.
Should we upgrde to 1.4.7 . It is stable ?
Hi,
[root@DNTX002 nginx-1.2.1]# nginx -V
nginx version: nginx/1.2.1
built by gcc 4.4.6 20120305 (Red Hat 4.4.6-4) (GCC)
configure arguments: --add-module=/root/nginx_mod_h264_streaming-2.2.7
–with-http_flv_module --with-file-aio --sbin-path=/usr/local/sbin
–with-debug
nginx_mod_h264_streaming is a unsupported third party module and
probably
causing your crash. There is generally no support for those modules on
the mailing list.
Drop nginx_mod_h264_streaming and migrate the official
ngx_http_mp4_module:
http://nginx.org/en/docs/http/ngx_http_mp4_module.html
Please be aware that this also means changing configurations.
And yes, nginx-1.4.7 is stable.
Regards,
Lukas
Thanks Lukas, now i saw these errors in /var/log/messages. Also due to
3rd
party module ?
Mar 27 12:04:47 DNTX002 kernel: nginx[8190]: segfault at 40174353c ip
000000000046a482 sp 00007fff1fd93810 error 4 in nginx[400000+92000]
Mar 27 12:04:47 DNTX002 xinetd[6599]: START: nrpe pid=9442
from=209.59.234.13
Mar 27 12:04:47 DNTX002 abrtd: Directory ‘ccpp-2014-03-27-16:04:47-8190’
creation detected
Mar 27 12:04:47 DNTX002 abrt[9441]: Saved core dump of pid 8190
(/usr/local/sbin/nginx) to /var/spool/abrt/ccpp-2014-03-27-16:04:47-8190
(67911680 bytes)
Mar 27 12:04:47 DNTX002 xinetd[6599]: EXIT: nrpe status=0 pid=9442
duration=0(sec)
Mar 27 12:04:48 DNTX002 abrtd: Executable ‘/usr/local/sbin/nginx’
doesn’t
belong to any package
Mar 27 12:04:48 DNTX002 abrtd: ‘post-create’ on
‘/var/spool/abrt/ccpp-2014-03-27-16:04:47-8190’ exited with 1
Mar 27 12:04:48 DNTX002 abrtd: Corrupted or bad directory
‘/var/spool/abrt/ccpp-2014-03-27-16:04:47-8190’, deleting
Regards.
Shahzaib
nginx -V
nginx version: nginx/1.2.8
Thats not the complete output of -V (capital letter). Either you
truncated the output by yourself or you sent us the output of -v.
Please send the complete output of “nginx -V”, where the V is a
capital letter.
Also compile nginx without third party modules.
Thanks,
Lukas
You can check the following version now :
[root@DNTX002 nginx-1.4.7]# nginx -V
nginx version: nginx/1.4.7
built by gcc 4.4.7 20120313 (Red Hat 4.4.7-3) (GCC)
configure arguments: --with-http_mp4_module --with-http_flv_module
–with-file-aio --sbin-path=/usr/local/sbin --with-debug
Still the /var/log/messages showing the following errors :
Mar 27 12:32:12 DNTX002 kernel: nginx[12215]: segfault at 40172f51c ip
000000000046a482 sp 00007fff1fd93810 error 4 in nginx
(deleted)[400000+92000]
Mar 27 12:32:12 DNTX002 abrt[12401]: File ‘/usr/local/sbin/nginx’ seems
to
be deleted
Mar 27 12:32:12 DNTX002 abrt[12401]: Saved core dump of pid 12215
(/usr/local/sbin/nginx) to
/var/spool/abrt/ccpp-2014-03-27-16:32:12-12215
(38105088 bytes)
Mar 27 12:32:12 DNTX002 abrtd: Directory
‘ccpp-2014-03-27-16:32:12-12215’
creation detected
Mar 27 12:32:12 DNTX002 abrtd: Executable ‘/usr/local/sbin/nginx’
doesn’t
belong to any package
Mar 27 12:32:12 DNTX002 abrtd: ‘post-create’ on
‘/var/spool/abrt/ccpp-2014-03-27-16:32:12-12215’ exited with 1
Mar 27 12:32:12 DNTX002 abrtd: Corrupted or bad directory
‘/var/spool/abrt/ccpp-2014-03-27-16:32:12-12215’, deleting
Mar 27 12:32:29 DNTX002 xinetd[6599]: START: nrpe pid=12414
from=209.59.234.13
Mar 27 12:32:30 DNTX002 xinetd[6599]: EXIT: nrpe status=0 pid=12414
duration=1(sec)
Mar 27 12:32:36 DNTX002 kernel: nginx[12226]: segfault at 401598e6c ip
000000000046a482 sp 00007fff1fd93810 error 4 in nginx
(deleted)[400000+92000]
Mar 27 12:32:36 DNTX002 abrt[12421]: File ‘/usr/local/sbin/nginx’ seems
to
be deleted
Mar 27 12:32:36 DNTX002 abrt[12421]: Saved core dump of pid 12226
(/usr/local/sbin/nginx) to
/var/spool/abrt/ccpp-2014-03-27-16:32:36-12226
(54018048 bytes)
Mar 27 12:32:36 DNTX002 abrtd: Directory
‘ccpp-2014-03-27-16:32:36-12226’
creation detected
Mar 27 12:32:36 DNTX002 abrtd: Executable ‘/usr/local/sbin/nginx’
doesn’t
belong to any package
Mar 27 12:32:36 DNTX002 abrtd: ‘post-create’ on
‘/var/spool/abrt/ccpp-2014-03-27-16:32:36-12226’ exited with 1
Mar 27 12:32:36 DNTX002 abrtd: Corrupted or bad directory
‘/var/spool/abrt/ccpp-2014-03-27-16:32:36-12226’, deleting
Mar 27 12:32:42 DNTX002 kernel: nginx[12220]: segfault at 400ffafac ip
000000000046a482 sp 00007fff1fd93810 error 4 in nginx
(deleted)[400000+92000]
Mar 27 12:32:42 DNTX002 abrt[12426]: File ‘/usr/local/sbin/nginx’ seems
to
be deleted
Mar 27 12:32:42 DNTX002 abrt[12426]: Not saving repeating crash in
‘/usr/local/sbin/nginx’
Mar 27 12:32:49 DNTX002 kernel: nginx[12212]: segfault at 400ffb0fc ip
000000000046a482 sp 00007fff1fd93810 error 4 in nginx
(deleted)[400000+92000]
Mar 27 12:32:49 DNTX002 abrt[12431]: File ‘/usr/local/sbin/nginx’ seems
to
be deleted
Mar 27 12:32:49 DNTX002 abrt[12431]: Not saving repeating crash in
‘/usr/local/sbin/nginx’
Mar 27 12:32:54 DNTX002 kernel: nginx[12219]: segfault at 400ff740c ip
000000000046a482 sp 00007fff1fd93810 error 4 in nginx
(deleted)[400000+92000]
Mar 27 12:32:54 DNTX002 abrt[12434]: File ‘/usr/local/sbin/nginx’ seems
to
be deleted
Mar 27 12:32:54 DNTX002 abrt[12434]: Not saving repeating crash in
‘/usr/local/sbin/nginx’
One quick question, i’ve updated nginx to 1.4.7 with http_mp4_module.
What
if i go with the same config as before ? i.e
server {
listen 80;
server_name storage10.domain.com storage10.gear3rd.com
storage10.gear3rd.net;
client_max_body_size 800m;
limit_rate 250k;
# access_log /websites/theos.in/logs/access.log main;
add_header "X-Content-Type-Options" "nosniff";
add_header Content-Type text/plain;
add_header X-Download-Options noopen ;
location / {
root /var/www/html/domain;
index index.html index.htm index.php;
autoindex off;
}
location ~ .(flv|jpg|jpeg)$ {
flv;
root /var/www/html/domain;
aio on;
directio 512;
output_buffers 1 2m;
expires 7d;
valid_referers none blocked tune.pk *.tune.pk
.facebook.com.
twitter.com *.domain.com *.gear3rd.net tunemedia.tv www.tunemedia.tv
embed.tunemedia.tv;
if ($invalid_referer) {
return 403;
}
}
location ~ -720.(mp4)$ {
mp4;
expires 7d;
limit_rate 1000k;
root /var/www/html/domain;
valid_referers none blocked tune.pk *.tune.pk *.
facebook.com *.twitter.com *.domain.com *.gear3rd.net tunemedia.tv
www.tunemedia.tv embed.tunemedia.tv;
if ($invalid_referer) {
return 403;
}
}
location ~ -480.(mp4)$ {
mp4;
expires 7d;
limit_rate 250k;
root /var/www/html/domain;
valid_referers none blocked tune.pk *.tune.pk *.
facebook.com *.twitter.com *.domain.com *.gear3rd.net tunemedia.tv
www.tunemedia.tv embed.tunemedia.tv;
if ($invalid_referer) {
return 403;
}
}
location ~ .(mp4)$ {
mp4;
expires 7d;
add_header “X-Content-Type-Options” “nosniff”;
add_header Content-Type text/plain;
root /var/www/html/domain;
valid_referers none blocked tune.pk *.tune.pk *.
facebook.com *.twitter.com *.domain.com *.gear3rd.net tunemedia.tv
www.tunemedia.tv embed.tunemedia.tv;
if ($invalid_referer) {
return 403;
}
}
pass the PHP scripts to FastCGI server listening on 127.0.0.1:9000
location ~ \.php$ {
root /var/www/html/domain;
fastcgi_pass 127.0.0.1:9000;
fastcgi_index index.php;
fastcgi_param SCRIPT_FILENAME
$document_root$fastcgi_script_name;
include fastcgi_params;
fastcgi_read_timeout 10000;
}
location ~ /\.ht {
deny all;
}
}
Regards.
Shahzaib
Hello!
On Thu, Mar 27, 2014 at 05:32:08PM +0500, shahzaib shahzaib wrote:
Mar 27 12:32:12 DNTX002 kernel: nginx[12215]: segfault at 40172f51c ip
000000000046a482 sp 00007fff1fd93810 error 4 in nginx
(deleted)[400000+92000]
Mar 27 12:32:12 DNTX002 abrt[12401]: File ‘/usr/local/sbin/nginx’ seems to
be deleted
According to the logs, it’s previous version which segfaults (note
that the file was deleted, hence the version on disk, if any, is
different one).
Likley you’ve forgot to upgrade the binary running.
–
Maxim D.
http://nginx.org/
I upgraded nginx to nginx-1.4.7 and then issued the command nginx -s
reload. Maybe nginx -s reload didn’t actually used the latest binary.
Well,
now i killed all other nginx using following command :
killall -9 nginx
nginx (to start new binary)
Ohhh. THANKS a lot for explaining me that. 
Sorry a silly job from my end .
I’ll monitor logs for while and let you know about the progress. I had a
quick question in previous reply. Could you please check that one ?
Regards.
Shahzaib
Hello!
On Thu, Mar 27, 2014 at 06:08:44PM +0500, shahzaib shahzaib wrote:
I upgraded nginx to nginx-1.4.7 and then issued the command nginx -s
reload. Maybe nginx -s reload didn’t actually used the latest binary. Well,
now i killed all other nginx using following command :killall -9 nginx
nginx (to start new binary)
The “nginx -s reload” is a configuration reload command. It won’t
even try to change a binary, it will just sent a SIGHUP to a
running master process.
See here for a documentation on how to control nginx properly:
http://nginx.org/en/docs/control.html
–
Maxim D.
http://nginx.org/
Hi,
One quick question, i’ve updated nginx to 1.4.7 with http_mp4_module.
What if i go with the same config as before ? i.e
That should work, as all you really need to do is to use the “mp4;”
keyword.
(I was not aware that config keyword is actually exactly the same
between
the third party module and the official module).
Regards,
Lukas
Thanks for help guyz.
Regards.
Shahzaib