I feel it difficult communicating for the times when...?

If you're too emotional you feel conflict and guilt, that is why you are afraid to express yourself. You have to learn how to control the emotions, then you can speak your mind freely and let it go, firmly and patiently. You should always be truthful and let the chips fall where they may. Then you get to know who are your real friends and who are just acquaintances