Blinking in the same spot against Zahmir, the Blade Sovereign

As the title says, went into a Deadly Map Boss encounter against Zahmir. Started the fight and for the whole fight Blink was broken, it would always blink into the spot I'm currently standing in. Didn't have a window to remove/disable the gem so I died like a dog.