Figured it out already 
forgot to update this thread. Thanks
So yes its exactly everything you guys added above.
In my case, Iām using next js, so I just have to get the id_token from the redirect and make my application do another fetch request to https://mystrapiendpoint/api/auth/auth0/callback?id_token and that would complete the cycle and issue the jwt from strapi that my application could use!