Can I add ip whitelist for admin panel only?

If I add ip middleware it is for all routes. I want it on the /admin route only.
Is that possible?