Smooth Tempo Warp

I have been tempo mapping some free-time (commercial release) music firstly with Tempo Detection and then Time Warp function to fine tune it.

There are some 1/4 notes (for example) that do not have a drum hit, but there is a hihat. I can clearly hear where the tempo mapping is working, but on the beats with no drum hit there is some slip.

Is it possible in some way to get Cubase to “smooth” those missing beats without having to guess or trial and error, or is there some process somebody could recommend to help ?

The waveform is pretty dense and there is no obvious visible cue for the hihat.

Thanks in advance.