No person shall hereafter erect any building or structure, other than a temporary structure costing less than five hundred dollars ($500) without a permit to do so. If no other agency is charged with the duty of issuing such permits the county surveyor shall have such duty.