It took a bit of fiddling to get mine in place, without having to remove anything. My swingarm has a tapped hole (not quite in the right place for my DP hugger), but the hugger is so stiff I've not bothered to fit one.
Tim - I thought you didn't like huggers?