Definitions of keep one's distance:

  • verb:   stay clear of, avoid