The be an -dimensional vector on the probability simplex, that is and .
It is trivial to show that . Let us instead compare the squared 2-norm to the infinity norm. Without loss of generality, assume that is the largest element.
Overall we have .
This also provides a sufficient (and probably necessary) condition for equality: or for all .