Carl was the first born son of Christian Olson and Anna Gurene Thorson Olson. He died before he was a year old. They went on to have three more children, a son named also Carl Olaves Olson but called "Charles", another son David Martinius and a daughter Clara Annette. In 1874, father Christian want down with his ship on Lake Michigan. Mother Anna traveled to Wisconsin to be with other family members and later remarried to Nels Hanson.