When the punishment of the crime shall be the confinement of the person in a penal institution, the expenses shall be paid out of the state treasury on the certificate of the Governor and warrant of the state auditor; and in all other cases the expenses shall be paid out of the county treasury in the county wherein the crime is alleged to have been committed. The expenses shall be the fees paid to the officers of the state on whose governor the requisition is made and shall not exceed 8¢ per mile for all necessary travel in returning such prisoner.