I’ve got now working integration tests in my Strapi application. Additionally, I am using TypeScript (but did not use TypeScript in those testing projects).
To get Strapi v4 up and running with TypeScript and Integration Tests, one can look at this project: Strapi quickstart Typescript application with Jest - CodeSandbox