Mmm... nah. If it's right for you to not block anyone, then more power to you, but if you would like to block someone and are abitrarily making yourself refrain from doing so, then that's not great for your mental health and personal boundaries.
Again, if you don't wanna block anyone, that's a-OK! But don't use it as a means of proving yourself and your worth unnecessarily. :)