Not much is known about the Olmstead family. Family lore has it that Lucy Olmstead's parents died when she was a very young girl, and that she grew up as an "orphan and worked for other people." Her parents, Solomon Olmstead and Polly Wellman were identified in one of Lucy's marriage records, but no other information about them has been found.