The official bonds given for county taxes by the clerks of the superior courts, chief magistrates, magistrates, sheriffs, coroners, county surveyors, county treasurers, county tax collectors, and county tax receivers shall be approved by the judge of the probate court, filed in his office, and recorded by him. The bonds of tax collectors and tax receivers for state taxes, after being likewise approved, shall be recorded by the judge of the probate court; and the original bond shall be transmitted by him to the Governor for deposit in the Comptroller General's office.