It's All Good

Now Yosef could not bear all those standing beside him, and he called out, "Take everyone away from me!" So no one stood with him when Yosef made himself known to his brothers. [Vayigash 45:1]

Yosef could not bear that Egyptians would stand beside him and hear his brothers being embarrassed when he would make himself known to them. [Rashi]

We can learn from the example of Yosef towards his brothers that one should never seek revenge against a person who causes him any form of distress or damage.  Rather, one should repay even a guilty offender with kindness. [Tanya ch.12]

Why should we be kind to guilty offenders?

Because whatever that person did to you ultimately stems from G-d.  The person was merely an agent from G-d, Who decreed that this thing should happen to you.

Thus, since "everything that G-d does is for the good", you must repay the person - who brought this "good" to you - with kindness.

Source: Likutei Sichos Lubavitcher Rebbe: Gutnick Chumash