The Roll-Up is a slow and deliberate movement that should be smooth instead of rushed.
Use your exhale to drive the movement deliberately, and use the inhale to regain height and control.
Try to peel yourself off the mat like a sticker, letting each vertebrae of your spine move one at a time.