The prime minister will stay on as a caretaker while Labour, not the country, picks Britain's seventh leader in a decade.