If you don't say it, they won't know.

If you only wish silently and feel hurt, the other person can't know why. If it's someone you can safely talk to, gently put what you want into words. One honest conversation can clear up many misunderstandings.