How can I use the Entity Service API and the Query Engine API from my node program without running the Strapi server?

Questions and Answers Strapi Backend
1

I need to update Strapi tables from my node program

I have a system that updates information about companies. The system queries many external APIs and scrapes web pages to get the data. Data synced to external systems like Hubspot, Insightly, Firestore, and WordPress.

I now need to add the data to Strapi. I have tried to add the data in the following ways:

  1. Using rest and graphql to update data.
    But it creates stress on the Strapi server. Plus it is less effective as the communication is HTTP requests.
  2. I implemented the system that accesses external APIs, scrapes webpage, and updates data in external systems as a Strapi Plugin. This created even more stress on Strapi.
  3. Implemented the system that fetches and updates data as an external system and uses knex to access tables defined by Strapi.
    The use of queues and workers (BullMQ connected to Redis and workers running in docker containers) reduces the load on the system and scales a lot better. But accessing Strapi tables using knex is complex because Strapi stores repeatable fields (stored in a separate table).

So: How can I use the Entity Service API and the Query Engine API from my node program without running the Strapi server?

1 Like
2

I’ve run into this problem as well.

But I can think of one way. It’s to customize a set of RESTful APIs: custom routes, custom controllers, and in the controllers you can use the strapi object.

图片
图片1920×984 98.6 KB

3

while creating custom controllers, as @zhenzhenChange mentioned, provides access to the strapi object, your feedback about encountering scaling issues when making a number of external writes to Strapi feels a little disconcerting. Care to elaborate on the number of writes and server configurations you were working with?

Curious how this situation has evolved for you. And if you, or others, have encountered scaling issues when making continuous writes to the strapi instance? If so, are there any solutions, guides or advice you can provide?