An organ had been installed in the church prior to 1896.  It was a three manual chamber organ which it appears was blown by a device driven by a gas engine. The gas engine apparently broke down and since it was going to cost £2-0-0d (£2.00) to repair they decided to dispose of it by advertising it complete with blower in the Musical Times. 

No more is mentioned of it but regularly in the accounts there appeared from then on an amount ‘to Organ Blower 6/- (30p)’.  This job was held by a number of young men over the years until an electric blower was installed in 1945.

The job must have got harder from 1906 when the organ was rebuilt and extended and a pedal organ added.  This was part of reconstruction of the chapel to provide a new pulpit and rostrum for organ and choir, together with a new baptistry covered by a lower platform. A new boiler was also installed and the whole financed by a loan of £500 secured on the title of the property.

Over the years the Church has relied on the many members who have given time and talents in practical ways in maintaining and improvement of the property.  The Annual Meeting of 1896 records an affectionate memory of Mr. William Wilshere, one of the original members and Deacons, who being a carpenter also gave his talents in this way.  The Church still has a piece of wood taken from the original porch of Tabernacle on which he had written in pencil "built by William Wilshere".

No doubt many volunteers were needed to clean and decorate the building in 1899 when the Herts Baptist Association Annual meetings were held in the church.  It was also a year when the Treasurer could congratulate the Church on a significant improvement in its financial position, despite substantial expenditure on such items as toilets in the schoolroom.

The end of the century then saw the Church in good shape with a membership roll of 96, a thriving Sunday School and Bible Class of almost 200 and a number of members and Deacons taking an active part in the civic and social life of the City.

Henry Taylor himself was very much involved in the political and educational activities in the locality and this was to be dramatically demonstrated in the the next few years.