I’m a bit late to the party, but I have been dealing with the same issue. I ended up unchecking “enforce admins” and creating a service account as the only user with admin rights. I then shared the credentials with my team. This works for now, but it is less than ideal.
As others have mentioned, it would be best if I had the ability to allow specific users to bypass branch restrictions.