Definitions of high horse:

• noun:   an attitude of arrogant superiority

  Example: "Get off your high horse and admit you are wrong"