The audit also shall examine the receipts and expenditures of the State Bar to ensure that the funds collected on behalf of the Conference of Delegates of California Bar
Associations as the independent successor entity to the former Conference of Delegates of the State Bar are conveyed to that entity, that the State Bar has been paid or reimbursed for the full cost of any administrative and support services provided to the successor entity, including the collection of fees or donations on its behalf, and that no mandatory fees are being used to fund the activities of the successor entity.
In selecting the accounting firm, the board shall consider the value of continuity, along with the risk that continued long-term engagements of an accounting firm may affect the independence of that firm.
inclusive. A copy of the performance audit shall be submitted by May 1, 2001, to the board, to the Chief Justice of the Supreme Court, and to the Assembly and Senate Committees on Judiciary.
Every two years thereafter, the board shall contract with the California State Auditor’s Office to conduct a performance audit of the State Bar’s operations for the respective fiscal year, commencing with January 1, 2002, to December 31, 2002, inclusive. A copy of the performance audit shall be submitted within 120 days of the close of the fiscal year for which the audit was performed to the board, to the Chief Justice of the Supreme Court, and to the Assembly and Senate Committees on Judiciary.
For the purposes of this subdivision, the California State Auditor’s Office may contract with a third party to conduct the performance
audit. This subdivision is not intended to reduce the number of audits the California State Auditor’s Office may otherwise be able to conduct.
inactive licensees.
perform existing tasks and responsibilities.
existing resources are used.
(ii) What evaluation criteria were used to determine whether Meazure Learning had experience with, and was capable of, conducting an examination similar to the State Bar examination.
(iii) Whether the State Bar appropriately evaluated and authorized any changes, including cost changes, to the executed contract.
(iv) Whether there were appropriate protections from, and evaluations of, any potential conflicts of interest that may have existed between relevant staff at the State Bar and Meazure Learning.
(B) Evaluate the bidding and contracting process that the State Bar engaged in that led to awarding the contract to Kaplan, Inc. for administration of the State Bar examination multiple choice questions, as well as the final terms of the contract for those services, and determine all of the following:
(ii) What evaluation criteria was used to determine whether Kaplan,
Inc. had experience with, and was capable of, creating relevant and appropriate questions similar to existing comparable entities like the National Conference of Bar Examiners.
(iii) Whether the terms of the contract allowed for oversight and monitoring of the question development process, and whether the State Bar appropriately utilized its oversight and monitoring to ensure that sufficient processes were engaged in to develop questions, ensure accuracy, and ensure fairness in the question development.
(iv) Why Kaplan, Inc. provided 100 multiple choice questions for the February 2025 bar exam, instead of 200.
(C) Evaluate the process that the
State Bar engaged in leading up to the administration of the February 2025 State Bar examination to ensure that the examination was conducted in a way that allowed participants to engage fairly in the examination process, and determine all of the following:
limits or problems with examination locations, and how those potential problems were addressed.
(ii) How the process for remote examination employed for the February 2025 State Bar examination differed from the processes used for remote examination during the COVID-19 pandemic, and the reasons for those differences.
(iii) The process and reasoning for determining that a makeup examination date should be offered, and the timeline for making that determination.
(iv) The process for determining what specific equipment would be permitted for test-takers, such as white boards, and the reasoning and processes utilized to make any changes to those requirements leading up to the examination date.
(D) Evaluate the events that led the State Bar to use artificial intelligence to create multiple choice questions for use on the February 2025 State Bar examination, including all of the following:
(ii) Who or what department made the decision.
(iii) The rationale for making the decision.
(iv) When executive leadership at the State Bar knew that artificial intelligence was used to create questions for the February 2025 State Bar examination.
(vi) What deficiencies in oversight by executive leadership at the Office of Admissions existed, if any, and how have any such deficiencies been remedied.
(E) (i) Itemize the State Bar costs arising from administration of the February 2025 State Bar examination, including, but not limited to, costs arising from existing contracts, legal representation, remedies provided to takers of the February 2025 State Bar examination, and any other associated costs. The costs itemized in this clause should include money already spent, money the State Bar is legally obligated to spend going forward, and other anticipated costs.
(ii) Identify how much money the State Bar claimed it would save by using the February 2025 State Bar examination format and compare that amount to the total of the costs itemized
pursuant to clause (i).
Cite this section