If you need the hairpin to start or end earlier/later in time, ie on an earlier or later beat, then rather than dragging the endpoints left and right, change their rhythmic positions: you can use a combination of moving and lengthening/shortening. Dragging behaviour for dynamics is linked to noteheads, but key commands let you move dynamics to other positions
I’d recommend double-checking the minimum gaps in Engraving Options, as there are separate settings for minimum distance from the staff vs minimum distance from other items, like down-stem notes or low/high notes outside the staff. These are different.