Which version are you looking to upgrade from? Upgrading from v3 to v4 isn’t as straightforward as just deploying a new image.
Regardless, though, in portainer, instead of just deploying strapi/strapi, which really is just short for strapi/strapi:latest you would deploy strapi/strapi:<tag> (See available tags on Docker Hub / Strapi).