No decision of the department shall become effective during the period in which an appeal may be filed and the filing of an appeal shall stay the effect of the decision until such time as a final order is made by the board.