Definitions of guiltily:

• adverb:   in the manner of someone who has committed an offense

  Example: "She blushed guiltily as she spoke"