Build Strapi locally and aferwards run on server

I tried to build Strapi on my local machine, then add the dist folder to GitHub and afterwards run Strapi on the server using npm install && npm start.

The api is working fine using this approach, but unfortunately I’m getting a 404 when trying to open the admin panel.

I can see a request to a file from node_modules in the logs:
Error: ENOENT: no such file or directory, open 'node_modules/@strapi/admin/dist/server/server/build/index.html'

But even on my local machine I don’t have that file, where npm start is working fine.
Am I missing something here?