First of all, you can open the Fader panel of the Inspector instead the 1st one. Then you get the full fader and panner, which is much more easy to click on and edit.
Or you can open Channel Settings window and keep it open. This is synced with the track Selection. Then you Jave an Acces to the full fader and panner (and more) immediately, again.