It is annoying. I found that this happens very often for me. I don't have a clue why. I have the SPro3 i3 64 GB. My workaround is to double click the purple button. That puts you into some clip mode. Hit escape and your out of it and my pen works.
It's quick and seems to work for me.