Definitions of horseback:

• noun:   the back of a horse
• noun:   a narrow ridge of hills
• adverb:   on the back of a horse

  Example: "He rode horseback to town"