Strapi backend application keeps getting `ECONNRESET`

Questions and Answers Strapi Backend
1
System Information
  • Strapi Version: “^3.6.6”
  • Operating System: Amazon Linux (deployed in ECS fargate). Dockerfile is using strapi/base
  • Database: mysql
  • Node Version: >=10.16.0 <=14.x.x
  • NPM Version: ^6.0.0
  • Yarn Version:

We are using strapi for our service but we keep encountering errors that are not replicable but often occur during low traffic. Any tips are appreciated. Thank you :bowing_man:

Whole Flow Setup

  • Frontend (FE)
    • FE AWS ALB → Apache (=mod_rewrite + mod_proxy) → Nuxtjs (FE)
  • Backend (BE) = Strapi
    • Nuxt.js (FE) → BE AWS ALB → Strapi (BE)

Errors

Message: [2022-04-12T02:56:04.741] [ERROR] default - FetchError: request to https://URL_HERE failed, reason: read ECONNRESET
   at ClientRequest.<anonymous> (/PATH_TO_FILE/index.js:1461:11)
   at ClientRequest.emit (events.js:400:28)
   at TLSSocket.socketErrorListener (_http_client.js:475:9)
   at TLSSocket.emit (events.js:400:28)
   at emitErrorNT (internal/streams/destroy.js:106:8)
   at emitErrorCloseNT (internal/streams/destroy.js:74:3)
   at processTicksAndRejections (internal/process/task_queues.js:82:21) {
 type: 'system',
 errno: 'ECONNRESET',
 code: 'ECONNRESET'

Solutions that were implemented but did not fixed the issue

  1. The same strapi’s keepAliveTimeout and headersTimeout value
    • strapi service’s load balancer idle timeout: 300 seconds
    • strapi service’s keepAliveTimeout: 301 seconds
    • strapi service’s headersTimeout: 301 seconds
  2. The strapi’s headersTimeout greater than keepAliveTimeout
    • strapi service’s load balancer idle timeout: 300 seconds
    • strapi service’s keepAliveTimeout: 301 seconds
    • strapi service’s headersTimeout: 302 seconds
  3. Disable both headersTimeout and keepAliveTimeout
    • strapi service’s load balancer idle timeout: 300 seconds
    • strapi service’s keepAliveTimeout: 0 seconds
    • strapi service’s headersTimeout: 0 seconds
2

502 are gateway failures, typically in a proxy layer where the proxy can’t talk to the upstream service. You say that you have apache with mod_proxy for your frontend but I see no proxy layer except ALB there, is that the only proxy layer?

3

Yes. We have setup this via apache.

  • Frontend (FE)
    • FE AWS ALB → Apache (=mod_rewrite + mod_proxy) → Nuxtjs (FE)

A front end application will process request and for someEndpoint requests it will be processed by the Nuxtjs application. This is configured with apache as shown below.

        SetEnv proxy-nokeepalive 1																										
        SetEnv proxy-initial-not-pooled 1																										
        ProxyPass /someEndpoint http://localhost:3000/someEndpoint																										
        ProxyPassReverse /someEndpoint http://localhost:3000/someEndpoint

and the Nuxtjs application will then communicate to our strapi backend through ALB which is described in the below flow

  • Nuxt.js (FE) → BE AWS ALB → Strapi (BE)

However, our strapi service sometimes responds the ECONNRESET error. This is happening on requests that are only communicated with strapi service and during low traffic.

4

ECONNRESET is generally a network layer issue where the connection was closed/reset. It could be happening between the ALB or between Strapi and it’s database but I would need more information to know for sure.

5

I’m trying to resolve what appears to be the same. Getting intermittent 502 failed to fetch in my Sentry error logs only 1 or 2 a day. Tried different configurations for Ram and CPU since ECS is hosting the strapi v3 app.

How did you configure strapi keep alive timeout? Can’t find any info on where to toggle that.

6

To troubeshoot the problem, you can firstly put nuxt infront of ELB and temporary remove apache.
You should be able to tune up Nuxtjs with a larger KeepAliveTimeout and headersTimeout with a hook nuxtjs config that larger than that of ELB.

In Strapi, also doing the same things in it’s bootstrap.

7

You can try to set it in /src/index.js, You can bootstrap it, with the following code.
I think turning on keepAlive is necessary. Hope this help, for any detail setting, feel free to leave me message.

bootstrap({ strapi }) { strapi.server.httpServer.keepAliveTimeout = 35000; strapi.server.httpServer.headersTimeout = 36000; strapi.server.httpServer.keepAlive = true; },

1 Like