HTTP/1.1 413 Payload Too Large with Cloudflare Tunnel -> Ngnix -> Deconz

I’m trying to configure access to this container behind nginx, however I’m running into HTTP/1.1 413 Payload Too Large when trying to access the site. My current config is cloudflare tunnel → nginx → deconz, however if I remove cloudflare tunnel (by accessing from locally via nginx → deconz) it works correctly.

I’m not seeing this issue for any other of my sites behind the tunnel (home assistant for example), so I think the problem is with deconz however I’m not entirely sure as even with dbg-http I’m not seeing anything in the logs for a request.
Edit: I ran TCPDUMP in the container and I can see the requests hitting deconz, logs below.

Note: I was originally using deconz-docker, however the issue still occurs if I install deconz outside of a docker container)

Is there any suggestions how I can debug this further? (Included at are the sanitized nginx config and logs which may have something useful in there.

nginx config

map $http_upgrade $connection_upgrade {
  default upgrade;
  '' close;
}

server {
  listen 443 ssl;
  listen [::]:443 ssl;
  server_name deconz.removed.com;

  # Load the certificate files.
  ssl_certificate         /etc/letsencrypt/live/deconz.removed.com/fullchain.pem;
  ssl_certificate_key     /etc/letsencrypt/live/deconz.removed.com/privkey.pem;
  ssl_trusted_certificate /etc/letsencrypt/live/deconz.removed.com/chain.pem;

  # Load the Diffie-Hellman parameter.
  ssl_dhparam /etc/letsencrypt/dhparams/dhparam.pem;

  location / {
    # https://github.com/dresden-elektronik/deconz-rest-plugin/issues/659
    set $p 4080;
    if ($http_upgrade = "websocket") {
      set $p 4443;
    }
    if ($http_upgrade = "") {
      set $p 4080;
    }

    proxy_pass http://deconz:$p/;

    proxy_http_version 1.1;

    proxy_set_header Host $host;
    proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
    proxy_set_header Upgrade $http_upgrade;
    proxy_set_header Connection "upgrade";
    proxy_set_header Connection $connection_upgrade;  

   }
}

tcpdump logs

10:58:46.304858 IP nginx.docker_nginx.57302 > deconz.4080: Flags [S], seq 3789354346, win 64240, options [mss 1460,sackOK,TS val 1670899550 ecr 0,nop,wscale 7], length 0
E..<..@.@..................j........\:.........
c..^........
10:58:46.304893 IP deconz.4080 > nginx.docker_nginx.57302: Flags [S.], seq 3073697715, ack 3789354347, win 65160, options [mss 1460,sackOK,TS val 3032516637 ecr 1670899550,nop,wscale 7], length 0
E..<..@.@................4.....k....\:.........
....c..^....
10:58:46.304935 IP nginx.docker_nginx.57302 > deconz.4080: Flags [.], ack 1, win 502, options [nop,nop,TS val 1670899550 ecr 3032516637], length 0
E..4..@.@..................k.4......\2.....
c..^....
10:58:46.305065 IP nginx.docker_nginx.57302 > deconz.4080: Flags [P.], seq 1:2936, ack 1, win 502, options [nop,nop,TS val 1670899550 ecr 3032516637], length 2935
E.....@.@..V...............k.4......g......
c..^....GET / HTTP/1.1
Host: deconz.removed.com
X-Forwarded-For: 2a00:79e0:d:203:cfb0:ffb7:5226:59ab, 172.0.2.8
Connection: upgrade
Connection: close
User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/101.0.4951.64 Safari/537.36
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9
Accept-Encoding: gzip
Accept-Language: en-GB,en-US;q=0.9,en;q=0.8
Cache-Control: max-age=0
Cdn-Loop: cloudflare
Cf-Access-Authenticated-User-Email: removed@gmail.com
Cf-Access-Jwt-Assertion: <removed>
Cf-Connecting-Ip: 2a00:79e0:d:203:cfb0:ffb7:5226:59ab
Cf-Ipcountry: GB
Cf-Ray: 70cbd6ff3a7571b4-LHR
Cf-Visitor: {"scheme":"https"}
Cf-Warp-Tag-Id: <removed>
Cookie: CF_Authorization=<removed>
Dnt: 1
Sec-Ch-Ua: " Not A;Brand";v="99", "Chromium";v="101", "Google Chrome";v="101"
Sec-Ch-Ua-Mobile: ?0
Sec-Ch-Ua-Platform: "Linux"
Sec-Fetch-Dest: document
Sec-Fetch-Mode: navigate
Sec-Fetch-Site: none
Sec-Fetch-User: ?1
Upgrade-Insecure-Requests: 1
X-Forwarded-Host: deconz.removed.com
X-Forwarded-Proto: https


10:58:46.305082 IP deconz.4080 > nginx.docker_nginx.57302: Flags [.], ack 2936, win 496, options [nop,nop,TS val 3032516637 ecr 1670899550], length 0
E..4.A@.@.3w.............4..........\2.....
....c..^
10:58:46.305362 IP deconz.4080 > nginx.docker_nginx.57302: Flags [P.], seq 1:54, ack 2936, win 501, options [nop,nop,TS val 3032516637 ecr 1670899550], length 53
E..i.B@.@.3A.............4..........\g.....
....c..^HTTP/1.1 413 Payload Too Large
Content-Length: 0


10:58:46.305424 IP nginx.docker_nginx.57302 > deconz.4080: Flags [.], ack 54, win 502, options [nop,nop,TS val 1670899550 ecr 3032516637], length 0
E..4..@.@....................4......\2.....
c..^....
10:58:46.305466 IP deconz.4080 > nginx.docker_nginx.57302: Flags [F.], seq 54, ack 2936, win 501, options [nop,nop,TS val 3032516637 ecr 1670899550], length 0
E..4.C@.@.3u.............4..........\2.....
....c..^
10:58:46.305588 IP nginx.docker_nginx.57302 > deconz.4080: Flags [F.], seq 2936, ack 55, win 502, options [nop,nop,TS val 1670899550 ecr 3032516637], length 0
E..4..@.@....................4......\2.....
c..^....
10:58:46.305601 IP deconz.4080 > nginx.docker_nginx.57302: Flags [.], ack 2937, win 501, options [nop,nop,TS val 3032516637 ecr 1670899550], length 0
E..4.D@.@.3t.............4..........\2.....
....c..^

debug logs

2022/05/13 13:13:01 [debug] 510#510: epoll: fd:10 ev:0001 d:0000556E895E5FD0
2022/05/13 13:13:01 [debug] 510#510: accept on 0.0.0.0:443, ready: 0
2022/05/13 13:13:01 [debug] 510#510: posix_memalign: 0000556E89527FC0:512 @16
2022/05/13 13:13:01 [debug] 510#510: *1 accept: 172.0.2.8:58778 fd:4
2022/05/13 13:13:01 [debug] 510#510: *1 event timer add: 4: 60000:579240785
2022/05/13 13:13:01 [debug] 510#510: *1 reusable connection: 1
2022/05/13 13:13:01 [debug] 510#510: *1 epoll add event: fd:4 op:1 ev:80002001
2022/05/13 13:13:01 [debug] 510#510: epoll del event: fd:10 op:2 ev:00000000
2022/05/13 13:13:01 [debug] 510#510: epoll add event: fd:10 op:1 ev:10000001
2022/05/13 13:13:01 [debug] 510#510: timer delta: 17670
2022/05/13 13:13:01 [debug] 510#510: worker cycle
2022/05/13 13:13:01 [debug] 510#510: epoll timer: 60000
2022/05/13 13:13:01 [debug] 510#510: epoll: fd:4 ev:0001 d:0000556E895E6660
2022/05/13 13:13:01 [debug] 510#510: *1 http check ssl handshake
2022/05/13 13:13:01 [debug] 510#510: *1 http recv(): 1
2022/05/13 13:13:01 [debug] 510#510: *1 https ssl handshake: 0x16
2022/05/13 13:13:01 [debug] 510#510: *1 tcp_nodelay
2022/05/13 13:13:01 [debug] 510#510: *1 reusable connection: 0
2022/05/13 13:13:01 [debug] 510#510: *1 SSL server name: "nginx"
2022/05/13 13:13:01 [debug] 510#510: *1 SSL_do_handshake: -1
2022/05/13 13:13:01 [debug] 510#510: *1 SSL_get_error: 2
2022/05/13 13:13:01 [debug] 510#510: timer delta: 0
2022/05/13 13:13:01 [debug] 510#510: worker cycle
2022/05/13 13:13:01 [debug] 510#510: epoll timer: 60000
2022/05/13 13:13:01 [debug] 510#510: epoll: fd:4 ev:0001 d:0000556E895E6660
2022/05/13 13:13:01 [debug] 510#510: *1 SSL handshake handler: 0
2022/05/13 13:13:01 [debug] 510#510: *1 SSL_do_handshake: 1
2022/05/13 13:13:01 [debug] 510#510: *1 SSL: TLSv1.2, cipher: "ECDHE-ECDSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=ECDSA Enc=AESGCM(128) Mac=AEAD"
2022/05/13 13:13:01 [debug] 510#510: *1 reusable connection: 1
2022/05/13 13:13:01 [debug] 510#510: *1 http wait request handler
2022/05/13 13:13:01 [debug] 510#510: *1 malloc: 0000556E895005F0:1024
2022/05/13 13:13:01 [debug] 510#510: *1 SSL_read: -1
2022/05/13 13:13:01 [debug] 510#510: *1 SSL_get_error: 2
2022/05/13 13:13:01 [debug] 510#510: *1 free: 0000556E895005F0
2022/05/13 13:13:01 [debug] 510#510: timer delta: 3
2022/05/13 13:13:01 [debug] 510#510: worker cycle
2022/05/13 13:13:01 [debug] 510#510: epoll timer: 59997
2022/05/13 13:13:01 [debug] 510#510: epoll: fd:4 ev:0001 d:0000556E895E6660
2022/05/13 13:13:01 [debug] 510#510: *1 http wait request handler
2022/05/13 13:13:01 [debug] 510#510: *1 malloc: 0000556E895005F0:1024
2022/05/13 13:13:01 [debug] 510#510: *1 SSL_read: 1024
2022/05/13 13:13:01 [debug] 510#510: *1 SSL_read: avail:1698
2022/05/13 13:13:01 [debug] 510#510: *1 reusable connection: 0
2022/05/13 13:13:01 [debug] 510#510: *1 posix_memalign: 0000556E89502520:4096 @16
2022/05/13 13:13:01 [debug] 510#510: *1 http process request line
2022/05/13 13:13:01 [debug] 510#510: *1 http request line: "GET / HTTP/1.1"
2022/05/13 13:13:01 [debug] 510#510: *1 http uri: "/"
2022/05/13 13:13:01 [debug] 510#510: *1 http args: ""
2022/05/13 13:13:01 [debug] 510#510: *1 http exten: ""
2022/05/13 13:13:01 [debug] 510#510: *1 posix_memalign: 0000556E895E4C10:4096 @16
2022/05/13 13:13:01 [debug] 510#510: *1 http process request header line
2022/05/13 13:13:01 [debug] 510#510: *1 http header: "Host: deconz.removed.com"
2022/05/13 13:13:01 [debug] 510#510: *1 http header: "User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/101.0.4951.54 Safari/537.36"
2022/05/13 13:13:01 [debug] 510#510: *1 http header: "Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9"
2022/05/13 13:13:01 [debug] 510#510: *1 http header: "Accept-Encoding: gzip"
2022/05/13 13:13:01 [debug] 510#510: *1 http header: "Accept-Language: en-GB,en-US;q=0.9,en;q=0.8"
2022/05/13 13:13:01 [debug] 510#510: *1 http header: "Cdn-Loop: cloudflare"
2022/05/13 13:13:01 [debug] 510#510: *1 http header: "Cf-Access-Authenticated-User-Email: removed@gmail.com"
2022/05/13 13:13:01 [debug] 510#510: *1 http alloc large header buffer
2022/05/13 13:13:01 [debug] 510#510: *1 posix_memalign: 0000556E8952F170:512 @16
2022/05/13 13:13:01 [debug] 510#510: *1 malloc: 0000556E8951A420:8192
2022/05/13 13:13:01 [debug] 510#510: *1 http large header alloc: 0000556E8951A420 8192
2022/05/13 13:13:01 [debug] 510#510: *1 http large header copy: 549
2022/05/13 13:13:01 [debug] 510#510: *1 SSL_read: 155
2022/05/13 13:13:01 [debug] 510#510: *1 SSL_read: 1669
2022/05/13 13:13:01 [debug] 510#510: *1 SSL_read: -1
2022/05/13 13:13:01 [debug] 510#510: *1 SSL_get_error: 2
2022/05/13 13:13:01 [debug] 510#510: *1 http header: "Cf-Access-Jwt-Assertion: <removed>"
2022/05/13 13:13:01 [debug] 510#510: *1 http header: "Cf-Connecting-Ip: RE.MO.VE.D"
2022/05/13 13:13:01 [debug] 510#510: *1 http header: "Cf-Ipcountry: GB"
2022/05/13 13:13:01 [debug] 510#510: *1 http header: "Cf-Ray: 70aba625ff4688bf-LHR"
2022/05/13 13:13:01 [debug] 510#510: *1 http header: "Cf-Visitor: {"scheme":"https"}"
2022/05/13 13:13:01 [debug] 510#510: *1 http header: "Cf-Warp-Tag-Id: <removed>"
2022/05/13 13:13:01 [debug] 510#510: *1 http header: "Connection: keep-alive"
2022/05/13 13:13:01 [debug] 510#510: *1 http header: "Cookie: CF_Authorization<removed>"
2022/05/13 13:13:01 [debug] 510#510: *1 http header: "Dnt: 1"
2022/05/13 13:13:01 [debug] 510#510: *1 http header: "Sec-Ch-Ua: " Not A;Brand";v="99", "Chromium";v="101", "Google Chrome";v="101""
2022/05/13 13:13:01 [debug] 510#510: *1 http header: "Sec-Ch-Ua-Mobile: ?0"
2022/05/13 13:13:01 [debug] 510#510: *1 http header: "Sec-Ch-Ua-Platform: "macOS""
2022/05/13 13:13:01 [debug] 510#510: *1 http header: "Sec-Fetch-Dest: document"
2022/05/13 13:13:01 [debug] 510#510: *1 http header: "Sec-Fetch-Mode: navigate"
2022/05/13 13:13:01 [debug] 510#510: *1 http header: "Sec-Fetch-Site: none"
2022/05/13 13:13:01 [debug] 510#510: *1 http header: "Sec-Fetch-User: ?1"
2022/05/13 13:13:01 [debug] 510#510: *1 http header: "Upgrade-Insecure-Requests: 1"
2022/05/13 13:13:01 [debug] 510#510: *1 http header: "X-Forwarded-For: RE.MO.VE.D"
2022/05/13 13:13:01 [debug] 510#510: *1 http header: "X-Forwarded-Host: deconz.removed.com"
2022/05/13 13:13:01 [debug] 510#510: *1 http header: "X-Forwarded-Proto: https"
2022/05/13 13:13:01 [debug] 510#510: *1 http header done
2022/05/13 13:13:01 [debug] 510#510: *1 event timer del: 4: 579240785
2022/05/13 13:13:01 [debug] 510#510: *1 generic phase: 0
2022/05/13 13:13:01 [debug] 510#510: *1 rewrite phase: 1
2022/05/13 13:13:01 [debug] 510#510: *1 test location: ~ "(/.*)"
2022/05/13 13:13:01 [debug] 510#510: *1 using configuration "(/.*)"
2022/05/13 13:13:01 [debug] 510#510: *1 http cl:-1 max:1048576
2022/05/13 13:13:01 [debug] 510#510: *1 rewrite phase: 3
2022/05/13 13:13:01 [debug] 510#510: *1 http script value: "80"
2022/05/13 13:13:01 [debug] 510#510: *1 http script set $p
2022/05/13 13:13:01 [debug] 510#510: *1 http script var
2022/05/13 13:13:01 [debug] 510#510: *1 http script value: "websocket"
2022/05/13 13:13:01 [debug] 510#510: *1 http script equal
2022/05/13 13:13:01 [debug] 510#510: *1 http script equal: no
2022/05/13 13:13:01 [debug] 510#510: *1 http script if
2022/05/13 13:13:01 [debug] 510#510: *1 http script if: false
2022/05/13 13:13:01 [debug] 510#510: *1 http script var
2022/05/13 13:13:01 [debug] 510#510: *1 http script value: ""
2022/05/13 13:13:01 [debug] 510#510: *1 http script equal
2022/05/13 13:13:01 [debug] 510#510: *1 http script if
2022/05/13 13:13:01 [debug] 510#510: *1 http script value: "4080"
2022/05/13 13:13:01 [debug] 510#510: *1 http script set $p
2022/05/13 13:13:01 [debug] 510#510: *1 post rewrite phase: 4
2022/05/13 13:13:01 [debug] 510#510: *1 generic phase: 5
2022/05/13 13:13:01 [debug] 510#510: *1 generic phase: 6
2022/05/13 13:13:01 [debug] 510#510: *1 generic phase: 7
2022/05/13 13:13:01 [debug] 510#510: *1 access phase: 8
2022/05/13 13:13:01 [debug] 510#510: *1 access phase: 9
2022/05/13 13:13:01 [debug] 510#510: *1 access phase: 10
2022/05/13 13:13:01 [debug] 510#510: *1 post access phase: 11
2022/05/13 13:13:01 [debug] 510#510: *1 generic phase: 12
2022/05/13 13:13:01 [debug] 510#510: *1 generic phase: 13
2022/05/13 13:13:01 [debug] 510#510: *1 http script copy: "http://deconz:"
2022/05/13 13:13:01 [debug] 510#510: *1 http script var: "4080"
2022/05/13 13:13:01 [debug] 510#510: *1 http script copy: "/"
2022/05/13 13:13:01 [debug] 510#510: *1 http init upstream, client timer: 0
2022/05/13 13:13:01 [debug] 510#510: *1 epoll add event: fd:4 op:3 ev:80002005
2022/05/13 13:13:01 [debug] 510#510: *1 http map started
2022/05/13 13:13:01 [debug] 510#510: *1 http map: "" "close"
2022/05/13 13:13:01 [debug] 510#510: *1 posix_memalign: 0000556E894AFD80:4096 @16
2022/05/13 13:13:01 [debug] 510#510: *1 http script copy: "Host"
2022/05/13 13:13:01 [debug] 510#510: *1 http script var: "deconz.removed.com"
2022/05/13 13:13:01 [debug] 510#510: *1 http script copy: "X-Forwarded-For"
2022/05/13 13:13:01 [debug] 510#510: *1 http script var: "RE.MO.VE.D, 172.0.2.8"
2022/05/13 13:13:01 [debug] 510#510: *1 http script copy: ""
2022/05/13 13:13:01 [debug] 510#510: *1 http script copy: "Connection"
2022/05/13 13:13:01 [debug] 510#510: *1 http script var: "close"
2022/05/13 13:13:01 [debug] 510#510: *1 http script copy: ""
2022/05/13 13:13:01 [debug] 510#510: *1 http script copy: ""
2022/05/13 13:13:01 [debug] 510#510: *1 http proxy header: "User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/101.0.4951.54 Safari/537.36"
2022/05/13 13:13:01 [debug] 510#510: *1 http proxy header: "Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9"
2022/05/13 13:13:01 [debug] 510#510: *1 http proxy header: "Accept-Encoding: gzip"
2022/05/13 13:13:01 [debug] 510#510: *1 http proxy header: "Accept-Language: en-GB,en-US;q=0.9,en;q=0.8"
2022/05/13 13:13:01 [debug] 510#510: *1 http proxy header: "Cdn-Loop: cloudflare"
2022/05/13 13:13:01 [debug] 510#510: *1 http proxy header: "Cf-Access-Authenticated-User-Email: removed@gmail.com"
2022/05/13 13:13:01 [debug] 510#510: *1 http proxy header: "Cf-Access-Jwt-Assertion: <removed>"
2022/05/13 13:13:01 [debug] 510#510: *1 http proxy header: "Cf-Connecting-Ip: RE.MO.VE.D"
2022/05/13 13:13:01 [debug] 510#510: *1 http proxy header: "Cf-Ipcountry: GB"
2022/05/13 13:13:01 [debug] 510#510: *1 http proxy header: "Cf-Ray: 70aba625ff4688bf-LHR"
2022/05/13 13:13:01 [debug] 510#510: *1 http proxy header: "Cf-Visitor: {"scheme":"https"}"
2022/05/13 13:13:01 [debug] 510#510: *1 http proxy header: "Cf-Warp-Tag-Id: 960e65c9-a91a-4076-8545-d24fc209d2fa"
2022/05/13 13:13:01 [debug] 510#510: *1 http proxy header: "Cookie: CF_Authorization=<removed>"
2022/05/13 13:13:01 [debug] 510#510: *1 http proxy header: "Dnt: 1"
2022/05/13 13:13:01 [debug] 510#510: *1 http proxy header: "Sec-Ch-Ua: " Not A;Brand";v="99", "Chromium";v="101", "Google Chrome";v="101""
2022/05/13 13:13:01 [debug] 510#510: *1 http proxy header: "Sec-Ch-Ua-Mobile: ?0"
2022/05/13 13:13:01 [debug] 510#510: *1 http proxy header: "Sec-Ch-Ua-Platform: "macOS""
2022/05/13 13:13:01 [debug] 510#510: *1 http proxy header: "Sec-Fetch-Dest: document"
2022/05/13 13:13:01 [debug] 510#510: *1 http proxy header: "Sec-Fetch-Mode: navigate"
2022/05/13 13:13:01 [debug] 510#510: *1 http proxy header: "Sec-Fetch-Site: none"
2022/05/13 13:13:01 [debug] 510#510: *1 http proxy header: "Sec-Fetch-User: ?1"
2022/05/13 13:13:01 [debug] 510#510: *1 http proxy header: "Upgrade-Insecure-Requests: 1"
2022/05/13 13:13:01 [debug] 510#510: *1 http proxy header: "X-Forwarded-Host: deconz.removed.com"
2022/05/13 13:13:01 [debug] 510#510: *1 http proxy header: "X-Forwarded-Proto: https"
2022/05/13 13:13:01 [debug] 510#510: *1 http proxy header:
"GET / HTTP/1.1
Host: deconz.removed.com
X-Forwarded-For: RE.MO.VE.D, 172.0.2.8
Connection: close
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/101.0.4951.54 Safari/537.36
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9
Accept-Encoding: gzip
Accept-Language: en-GB,en-US;q=0.9,en;q=0.8
Cdn-Loop: cloudflare
Cf-Access-Authenticated-User-Email: removed@gmail.com
Cf-Access-Jwt-Assertion: <removed>
Cf-Connecting-Ip: RE.MO.VE.D
Cf-Ipcountry: GB
Cf-Ray: 70aba625ff4688bf-LHR
Cf-Visitor: {"scheme":"https"}
Cf-Warp-Tag-Id: 960e65c9-a91a-4076-8545-d24fc209d2fa
Cookie: CF_Authorization=<removed>
2022/05/13 13:13:01 [debug] 510#510: *1 http cleanup add: 0000556E895E5BF0
2022/05/13 13:13:01 [debug] 510#510: malloc: 0000556E895AE5E0:224
2022/05/13 13:13:01 [debug] 510#510: resolve: "deconz"
2022/05/13 13:13:01 [debug] 510#510: malloc: 0000556E8952B440:184
2022/05/13 13:13:01 [debug] 510#510: malloc: 0000556E8954F330:6
2022/05/13 13:13:01 [debug] 510#510: malloc: 0000556E8954F3B0:48
2022/05/13 13:13:01 [debug] 510#510: resolve: "deconz" A 51022
2022/05/13 13:13:01 [debug] 510#510: resolve: "deconz" AAAA 60238
2022/05/13 13:13:01 [debug] 510#510: UDP socket 39
2022/05/13 13:13:01 [debug] 510#510: connect to 127.0.0.11:53, fd:39 #2
2022/05/13 13:13:01 [debug] 510#510: epoll add event: fd:39 op:1 ev:80002001
2022/05/13 13:13:01 [debug] 510#510: send: fd:39 24 of 24
2022/05/13 13:13:01 [debug] 510#510: send: fd:39 24 of 24
2022/05/13 13:13:01 [debug] 510#510: malloc: 0000556E8952CB30:96
2022/05/13 13:13:01 [debug] 510#510: event timer add: -1: 30000:579210789
2022/05/13 13:13:01 [debug] 510#510: event timer add: -1: 5000:579185789
2022/05/13 13:13:01 [debug] 510#510: *1 http finalize request: -4, "/?" a:1, c:2
2022/05/13 13:13:01 [debug] 510#510: *1 http request count:2 blk:0
2022/05/13 13:13:01 [debug] 510#510: timer delta: 1
2022/05/13 13:13:01 [debug] 510#510: worker cycle
2022/05/13 13:13:01 [debug] 510#510: epoll timer: 5000
2022/05/13 13:13:01 [debug] 510#510: epoll: fd:4 ev:0004 d:0000556E895E6660
2022/05/13 13:13:01 [debug] 510#510: *1 http run request: "/?"
2022/05/13 13:13:01 [debug] 510#510: *1 http upstream check client, write event:1, "/"
2022/05/13 13:13:01 [debug] 510#510: timer delta: 0
2022/05/13 13:13:01 [debug] 510#510: worker cycle
2022/05/13 13:13:01 [debug] 510#510: epoll timer: 5000
2022/05/13 13:13:01 [debug] 510#510: epoll: fd:39 ev:0001 d:0000556E895E6750
2022/05/13 13:13:01 [debug] 510#510: recv: fd:39 24 of 4096
2022/05/13 13:13:01 [debug] 510#510: resolver DNS response 60238 fl:8180 1/0/0/0
2022/05/13 13:13:01 [debug] 510#510: resolver DNS response qt:28 cl:1
2022/05/13 13:13:01 [debug] 510#510: malloc: 0000556E89551D20:7
2022/05/13 13:13:01 [debug] 510#510: resolver qs:deconz
2022/05/13 13:13:01 [debug] 510#510: recv: fd:39 46 of 4096
2022/05/13 13:13:01 [debug] 510#510: resolver DNS response 51022 fl:8180 1/1/0/0
2022/05/13 13:13:01 [debug] 510#510: resolver DNS response qt:1 cl:1
2022/05/13 13:13:01 [debug] 510#510: malloc: 0000556E89551D20:7
2022/05/13 13:13:01 [debug] 510#510: resolver qs:deconz
2022/05/13 13:13:01 [debug] 510#510: resolver naddrs:1 cname:0000000000000000 ttl:600
2022/05/13 13:13:01 [debug] 510#510: *1 http upstream resolve: "/?"
2022/05/13 13:13:01 [debug] 510#510: *1 name was resolved to 172.0.2.5
2022/05/13 13:13:01 [debug] 510#510: resolve name done: 0
2022/05/13 13:13:01 [debug] 510#510: event timer del: -1: 579210789
2022/05/13 13:13:01 [debug] 510#510: resolver expire
2022/05/13 13:13:01 [debug] 510#510: event timer del: -1: 579185789
2022/05/13 13:13:01 [debug] 510#510: *1 get rr peer, try: 1
2022/05/13 13:13:01 [debug] 510#510: *1 stream socket 41
2022/05/13 13:13:01 [debug] 510#510: *1 epoll add connection: fd:41 ev:80002005
2022/05/13 13:13:01 [debug] 510#510: *1 connect to 172.0.2.5:4080, fd:41 #3
2022/05/13 13:13:01 [debug] 510#510: *1 http upstream connect: -2
2022/05/13 13:13:01 [debug] 510#510: *1 posix_memalign: 0000556E89505010:128 @16
2022/05/13 13:13:01 [debug] 510#510: *1 event timer add: 41: 60000:579240789
2022/05/13 13:13:01 [debug] 510#510: recv: fd:39 -1 of 4096
2022/05/13 13:13:01 [debug] 510#510: recv() not ready (11: Resource temporarily unavailable)
2022/05/13 13:13:01 [debug] 510#510: timer delta: 0
2022/05/13 13:13:01 [debug] 510#510: worker cycle
2022/05/13 13:13:01 [debug] 510#510: epoll timer: 60000
2022/05/13 13:13:01 [debug] 510#510: epoll: fd:41 ev:0004 d:0000556E895E6840
2022/05/13 13:13:01 [debug] 510#510: *1 http upstream request: "/?"
2022/05/13 13:13:01 [debug] 510#510: *1 http upstream send request handler
2022/05/13 13:13:01 [debug] 510#510: *1 http upstream send request
2022/05/13 13:13:01 [debug] 510#510: *1 http upstream send request body
2022/05/13 13:13:01 [debug] 510#510: *1 chain writer buf fl:1 s:2854
2022/05/13 13:13:01 [debug] 510#510: *1 chain writer in: 0000556E894B0BC8
2022/05/13 13:13:01 [debug] 510#510: *1 writev: 2854 of 2854
2022/05/13 13:13:01 [debug] 510#510: *1 chain writer out: 0000000000000000
2022/05/13 13:13:01 [debug] 510#510: *1 event timer del: 41: 579240789
2022/05/13 13:13:01 [debug] 510#510: *1 event timer add: 41: 60000:579240789
2022/05/13 13:13:01 [debug] 510#510: timer delta: 0
2022/05/13 13:13:01 [debug] 510#510: worker cycle
2022/05/13 13:13:01 [debug] 510#510: epoll timer: 60000
2022/05/13 13:13:01 [debug] 510#510: epoll: fd:41 ev:0005 d:0000556E895E6840
2022/05/13 13:13:01 [debug] 510#510: *1 http upstream request: "/?"
2022/05/13 13:13:01 [debug] 510#510: *1 http upstream process header
172.0.2.8 - - [13/May/2022:13:13:01 +0000] "GET / HTTP/1.1" 413 0 "-" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/101.0.4951.54 Safari/537.36" "RE.MO.VE.D"
2022/05/13 13:13:01 [debug] 510#510: *1 malloc: 0000556E89500DF0:4096
2022/05/13 13:13:01 [debug] 510#510: *1 posix_memalign: 0000556E895219D0:4096 @16
2022/05/13 13:13:01 [debug] 510#510: *1 recv: eof:0, avail:-1
2022/05/13 13:13:01 [debug] 510#510: *1 recv: fd:41 53 of 4096
2022/05/13 13:13:01 [debug] 510#510: *1 http proxy status 413 "413 Payload Too Large"
2022/05/13 13:13:01 [debug] 510#510: *1 http proxy header: "Content-Length: 0"
2022/05/13 13:13:01 [debug] 510#510: *1 http proxy header done
2022/05/13 13:13:01 [debug] 510#510: *1 HTTP/1.1 413 Payload Too Large
Server: nginx/1.21.6
Date: Fri, 13 May 2022 13:13:01 GMT
Content-Length: 0
Connection: keep-alive

2022/05/13 13:13:01 [debug] 510#510: *1 write new buf t:1 f:0 0000556E89521AC0, pos 0000556E89521AC0, size: 136 file: 0, size: 0
2022/05/13 13:13:01 [debug] 510#510: *1 http write filter: l:0 f:0 s:136
2022/05/13 13:13:01 [debug] 510#510: *1 http cacheable: 0
2022/05/13 13:13:01 [debug] 510#510: *1 http proxy filter init s:413 h:0 c:0 l:0
2022/05/13 13:13:01 [debug] 510#510: *1 http upstream process upstream
2022/05/13 13:13:01 [debug] 510#510: *1 pipe read upstream: 0
2022/05/13 13:13:01 [debug] 510#510: *1 pipe preread: 0
2022/05/13 13:13:01 [debug] 510#510: *1 pipe buf free s:0 t:1 f:0 0000556E89500DF0, pos 0000556E89500E25, size: 0 file: 0, size: 0
2022/05/13 13:13:01 [debug] 510#510: *1 pipe length: 0
2022/05/13 13:13:01 [debug] 510#510: *1 pipe write downstream: 1
2022/05/13 13:13:01 [debug] 510#510: *1 pipe write downstream done
2022/05/13 13:13:01 [debug] 510#510: *1 event timer: 41, old: 579240789, new: 579240789
2022/05/13 13:13:01 [debug] 510#510: *1 http upstream exit: 0000000000000000
2022/05/13 13:13:01 [debug] 510#510: *1 finalize http upstream request: 0
2022/05/13 13:13:01 [debug] 510#510: *1 finalize http proxy request
2022/05/13 13:13:01 [debug] 510#510: *1 free rr peer 1 0
2022/05/13 13:13:01 [debug] 510#510: *1 close http upstream connection: 41
2022/05/13 13:13:01 [debug] 510#510: *1 free: 0000556E89505010, unused: 48
2022/05/13 13:13:01 [debug] 510#510: *1 event timer del: 41: 579240789
2022/05/13 13:13:01 [debug] 510#510: *1 reusable connection: 0
2022/05/13 13:13:01 [debug] 510#510: *1 http upstream temp fd: -1
2022/05/13 13:13:01 [debug] 510#510: *1 http output filter "/?"
2022/05/13 13:13:01 [debug] 510#510: *1 http copy filter: "/?"
2022/05/13 13:13:01 [debug] 510#510: *1 http postpone filter "/?" 00007FFE46493B30
2022/05/13 13:13:01 [debug] 510#510: *1 write old buf t:1 f:0 0000556E89521AC0, pos 0000556E89521AC0, size: 136 file: 0, size: 0
2022/05/13 13:13:01 [debug] 510#510: *1 write new buf t:0 f:0 0000000000000000, pos 0000000000000000, size: 0 file: 0, size: 0
2022/05/13 13:13:01 [debug] 510#510: *1 http write filter: l:1 f:0 s:136
2022/05/13 13:13:01 [debug] 510#510: *1 http write filter limit 2097152
2022/05/13 13:13:01 [debug] 510#510: *1 malloc: 0000556E894BD3D0:16384
2022/05/13 13:13:01 [debug] 510#510: *1 SSL buf copy: 136
2022/05/13 13:13:01 [debug] 510#510: *1 SSL to write: 136
2022/05/13 13:13:01 [debug] 510#510: *1 SSL_write: 136
2022/05/13 13:13:01 [debug] 510#510: *1 http write filter 0000000000000000
2022/05/13 13:13:01 [debug] 510#510: *1 http copy filter: 0 "/?"
2022/05/13 13:13:01 [debug] 510#510: *1 http finalize request: 0, "/?" a:1, c:1
2022/05/13 13:13:01 [debug] 510#510: *1 set http keepalive handler
2022/05/13 13:13:01 [debug] 510#510: *1 http close request
2022/05/13 13:13:01 [debug] 510#510: *1 http log handler
2022/05/13 13:13:01 [debug] 510#510: *1 free: 0000556E89500DF0
2022/05/13 13:13:01 [debug] 510#510: *1 free: 0000556E89502520, unused: 0
2022/05/13 13:13:01 [debug] 510#510: *1 free: 0000556E895E4C10, unused: 8
2022/05/13 13:13:01 [debug] 510#510: *1 free: 0000556E894AFD80, unused: 3
2022/05/13 13:13:01 [debug] 510#510: *1 free: 0000556E895219D0, unused: 2949
2022/05/13 13:13:01 [debug] 510#510: *1 free: 0000556E895005F0
2022/05/13 13:13:01 [debug] 510#510: *1 hc free: 0000000000000000
2022/05/13 13:13:01 [debug] 510#510: *1 hc busy: 0000556E895281B0 1
2022/05/13 13:13:01 [debug] 510#510: *1 free: 0000556E8951A420
2022/05/13 13:13:01 [debug] 510#510: *1 free: 0000556E894BD3D0
2022/05/13 13:13:01 [debug] 510#510: *1 reusable connection: 1
2022/05/13 13:13:01 [debug] 510#510: *1 event timer add: 4: 65000:579245789
2022/05/13 13:13:01 [debug] 510#510: timer delta: 0
2022/05/13 13:13:01 [debug] 510#510: worker cycle
2022/05/13 13:13:01 [debug] 510#510: epoll timer: 65000

It really seems like this is a problem. Fresh install here with latest versions and same problem. Similar configuration.

I’m out of ideas myself.