Definitions of extemporaneously:

• adverb:   without prior preparation

  Example: "He spoke extemporaneously"