Buffering / uploading large files

Server NGINX
1

Hi, how can tell nginx not to buffer client’s requests? I need this
capability to upload files larger than the nginx’s max buffering size. I
got
an nginx unknown directive error when I tried the
fastcgi_request_buffering
directive. Is the directive supported and I am missing a module in my
nginx
build? I am running nginx 1.7.9. Thank you!

Posted at Nginx Forum:

2

It’s a planned feature see (Roadmap – nginx)
But it has no ETA.

Kurt C.
https://www.x64architecture.com

3

Thanks Kurt.
In the meantime, is there a way to access the patch? I was not able to
access the link to a patch mentioned in this email thread
http://trac.nginx.org/nginx/ticket/251
Thanks.

Posted at Nginx Forum:

4

I have scratched up a patch from changes in tengine. I haven’t tested
it but it should work. The patch applies against nginx 1.7.9.
Here’s the docs on the options:

$ wget http://nginx.org/download/nginx-1.7.9.tar.gz
$ tar -xzvf nginx-1.7.9.tar.gz
$ wget
https://raw.githubusercontent.com/x64architecture/ngx_nonbuffered/master/nginx-1.7.9.patch
$ patch -p0 < nginx-1.7.9.patch

Kurt C.
https://www.x64architecture.com

5

Module ngx_http_core_module

B. R.

6

Hi, the situation that I am trying to solve is what happens if the
client’s
request is larger than the configured client_max_body_size. Turning off
buffering by nginx should resolve the problem as nginx would forward
every
packet to the back-end server as it comes in. Did I misunderstand the
purpose of “fastcgi_request_buffering off;”? Thanks.

Posted at Nginx Forum:

7

On Tuesday 03 February 2015 01:26:48 nginxuser100 wrote:

Hi, the situation that I am trying to solve is what happens if the client’s
request is larger than the configured client_max_body_size. Turning off
buffering by nginx should resolve the problem as nginx would forward every
packet to the back-end server as it comes in. Did I misunderstand the
purpose of “fastcgi_request_buffering off;”? Thanks.

Then all you need is to configure reasonable client_max_body_size.
The main purpose of this directive is to protect your server from
uploading unlimited amount of data.

wbr, Valentin V. Bartenev

8

Hi Kurt, where can I get a patch for nginx version 1.6.2 (the ‘official’
stable version as of today)? Thank you!

Posted at Nginx Forum:

9

Thanks Kurt.

The patch compiled and got installed fine. I no longer get an unknown
directive error msg. However, the client’s POST request of 1.5M of data
still gives me this error “413 Request Entity Too Large”

even though I added “fastcgi_request_buffering off;”

location / {
    include fastcgi_params;
    fastcgi_request_buffering off;
    fastcgi_pass   127.0.0.1:9000;
}

Here was my test:
curl -X POST -T testfile -v ‘http://localhost:80/’

POST /testfile HTTP/1.1
User-Agent: curl/7.19.7 (i386-redhat-linux-gnu) libcurl/7.19.7
NSS/3.16.2.3 Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2
Host: localhost
Accept: /
Content-Length: 1474560
Expect: 100-continue

< HTTP/1.1 413 Request Entity Too Large
< Server: nginx/1.7.9
< Date: Sun, 01 Feb 2015 20:04:25 GMT
< Content-Type: text/html
< Content-Length: 198
< Connection: close

Has anyone tried the fastcgi_request_buffering … or am I missing
something? Thanks.

Posted at Nginx Forum:

10

On Tuesday 10 February 2015 23:13:49 nginxuser100 wrote:

Hi Kurt, where can I get a patch for nginx version 1.6.2 (the ‘official’
stable version as of today)? Thank you!

Why not to use the latest mainline version?

See the difference: Announcing NGINX 1.6 and 1.7 as Stable & Mainline Versions

wbr, Valentin V. Bartenev

11

I was using 1.7.9 and it was crashing so I now go by the stable version
1.6.2 per nginx: download.
Whichever version I use, I will need the fastcgi_request_buffering
directive
patch. Thanks.

Posted at Nginx Forum: