Definitions of regretfully:

• adverb:   with regret (used in polite formulas)

  Example: "I must regretfully decline your kind invitation"