Upon temporary suspension of any officer other than the Governor, his office shall at once be temporarily filled by an appointment made by the Governor, with the advice and consent of the Senate. The office shall be filled by the appointee until the acquittal of the party impeached or, in case of his removal, until the vacancy is filled at the next election.