I wouldn’t be concerned about the dither nulling or not. I agree with Bob that testing at least down to the dither is still a huge benefit.
My main concern is to test for plugins that are inserted but didn’t render, or other unexpected issues that cause the rendered files to differ from what you are hearing on playback.
If it’s not too hard to add, i think it would be a useful feature.