Yeah I run into that a lot as well. There was a topic on marquee selection recently, there is a (seeming) randomness there as well as to which items are included in a selection.
Would be nice if mouse selection could become more accurate/predictable.