Proverbs 17:14

The beginning of strife is as when one letteth out water: therefore leave off contention, before it be meddled with.

Minor disputes have a way of growing to major proportions. So it is better to stop while a dispute is still insignificant.