Definitions of mathematical process:

• noun:   (mathematics) calculation by mathematical methods

  Example: "The problems at the end of the chapter demonstrated the mathematical processes involved in the derivation"