Don't get confused between training for speed vs training for conditioning, there is a difference and you can lose out on actual speed gains by being impatient during your session.
Create a plan, follow the plan and be patient. Rest times are there for a reason!