That’s how it has always worked for me. I never really thought about it being visible before, but it does make some sense that they are visible - otherwise how could you tell they exist?
You could convert that one instance of the Part into a non-shared copy, or just ignore the notes.