How to allow v4 admin users to visit /api/*?

If you want to have access to the admin API, then you would require to create a plugin(admin’s extension).