Learning life one second at a time