And act as if it’s all your fault you have low self esteem.

Some other people like to do this to make themselves look better than you, in reality, they are insecure and possibly have a very low self esteem also.
They think they feel better and look better by belittling you.
Try to ignore them, as hard as that is.