You might find that overtime the heat generated is causing it to stay on. I had this problem on one of my older bikes. I just gave it several large taps with a wooden mallet (or a hammer and a wooden block).
Also direct heat from a flame torch usually shifts it...
