Do I need to continue to pay my monthly mortgage payment during escrow?

Yes, you, the home seller, need to keep your mortgage payment(s) current throughout the course of the escrow transaction. If the payments are not kept current, the Lender(s) can and likely will assess and collect late charge(s).