Definitions of on the sly:

  • adverb:   in a furtive manner