Prelisten deactivates after single note in REAPER

When using Backbone (1.5.0.37) in REAPER (6.71), I have to click prelisten again every time after
I play a note (via MIDI or the pad in the GUI).

In Bitwig, prelisten stays active until I disable it which seems to be the normal behavior based on video tutorials.

Is there a way to get prelisten to say active until I deactivate it in REAPER as well?

I’m on Windows 11 Pro

(I made a video to illustrate the issue and uploaded it, but I’m not allowed to include it. Here’s the link