She was the daughter of Sir William Twysden, 6th Baronet and Mary Jervis.

Mary Hales, daughter of Sir Thomas Hales, 2nd Baronet and Mary Pym, before 1724.

His second wife was Alicia Brownlow, daughter of Sir John Brownlow, 3rd Baronet and Alice Sherard, whom he married around 1703.

He married Florence Smyth, daughter of Sir John Smyth, 3rd Baronet and Elizabeth Asthy.

He married Elizabeth, the daughter of Sir John Ramsden, 3rd Baronet and half-sister of Lady Rockingham.

Charlotte was a daughter of Sir William Jerningham, 6th Baronet and Frances Dillon.

He married Mary Anne, daughter of Sir Richard Gorges-Meredyth, 1st and last Baronet.

She was the daughter of Sir Charles William Rouse-Boughton, 9th Baronet and Catherine Pearce Hall.

In 1760, he married Elizabeth Meade, daughter of Sir Richard Meade, 3rd Baronet and Catherine Prittie.

Gould married Frances, daughter of Sir John Hartopp, 3rd Baronet and grand-daughter of Charles Fleetwood.