This depends on how critical that milestone is. Some milestone will have a larger impact on the overall project and some not as much. In general missing a milestone is definitely a failure, but in life it is important to learn from failures and see what your team can improve on to prevent this from happening again.