The term of office of the counselors in mental health shall be during the pleasure of the court, and they may at any time be removed by the court in its discretion. Such counselors shall devote their entire time and attention to the duties of their office.