Do I need a jogging stroller for the workout?

You do not need a jogging stroller. As long as the stroller has a buckle to keep baby/kiddo safe while moving, you're good to go.