Solved the issue of deleteing the rogue images by commenting out the Cloudinary config in config/plugins.js and restarting the server. It deleted everything from the media library which if in production would have been bad but thankfully only testing Strapi as a headless solution.
I still question the logic of being able to change the file name in the edit image dialogue though, especially if connected to third party cloud service.