Don’t compromise on your values, good habits, or boundaries. The first compromise leads to a second, and then a third.
If people are annoyed with your vigilance, let them be annoyed. If they’re annoyed with any positive traits such as honesty, frugality, prudence, let them be. Instead, be willing to change negative traits, like impatience, vengefulness, etc.