I think this is actually the key to all the difficulties of establishing better self-esteem or personal growth - that it goes against our conditioning that we hold so dear. Whether or not that conditioning can be overcome is like the sole factor that determines if we succeed in these self-evolutionary endeavors or not...