The calipers are a tight ish fit, but you should be able to wiggle them off.
Try pushing the pads back in a bit by pushing the caliper against the disk, that may give you a little bit of room to ease the caliper off.
You always need to take the calipers off to remove the front wheel.