Happiness is a good thing.
I haven’t seen any mood killer than when the person next to me is unhappy, especially if I'm the cause of his/her unhappiness. That's why I always tell people to express themselves; if your brother's action offended you, tell him. It will not only help them, it will help you as well.
Wishing you a happy life, my friend. 😁