Cache Rest API/Graphql results on to reduce load time?

I just installed strapi-middleware-cache and it reduce TTFB a lot. Are there any downside to use middleware cache? Still waiting for some advice to optimize the request.