Learning and improving one step at the time