Peirson's first wife, Sarah Page, with whom he had four children, died in 1802 at the age of 17, according to the inscription on her headstone. He was married again in 1803 to Sarah Hill, and had seven more children, naming his fourth son in honor of his revered superior officer, George Washington.
