Robert married Catherine Johnson in 1837. After Robert died fron tuberculosis, Catherine was left to raise their large family. She died two years later from complications due to a fall from her horse.