Definitions of night rider:

• noun:   member of a secret mounted band in United States south after the Civil War; committed acts of intimidation and revenge