Click the pallete icon at the very top (under the Redo button).
(See the top section of this help article: Notations toolbox)
As to the mouseover text that ought to appear when you hover over icons, no, that’s not working at the moment. This is a known problem to do with changes to the underlying Qt framework.