After finding on internet, I figured out that we need to build out app.
I was abit confused with the NODE_ENV=production, thought it’s for production already, but no, it just builds the app in production mode.
So after you have your project generated with strapi new ... , we need to add our own Dockerfile, I take it from Strapi sample production Dockerfile. Then we build our own image and run it.