I think I have solved it.
I just installed big sur and only nuendo and UAD and same issue.
I checked with some other files and this issue only happens with files recorded with waves tracks live software. It seems to somehow not be compatible with Nuendo. I ran them all through wavelab and resaved, now everything is working fine.