In all cases in which a change of venue is made, the sheriff of the county from which a person in custody is to be moved shall carry the person to the county to which the change of venue was directed and deliver him to the sheriff of such county, who shall then take charge of the person as in other cases. The sheriff of the county from which the person is to be moved shall carry with him and deliver to the sheriff the warrant under which the person was arrested or the commitment.