Each public utility shall have an office in a county of this State in which its property or some portion thereof is located and shall keep in that office all the books, accounts, papers, and records required by the commission to be kept within this State. No such books, accounts, papers, or records shall be at any time removed from the State except upon such conditions as the commission prescribes.