Irving was born in the Town of Dieter (named for his grandfather Martin Van Buren Dieter). Irvy married Clara Whitish in Reserve, Sheridan Co, MT where they became farmers and ranchers. Together they had a baby daughter, Ivy Elinor Hedges who died of T. B. at eight weeks old. After the baby's death Clara moved to Yakima where she married Wesley Hansen. In 1929 Irvy moved to Oregon but never remarried. He became a carpenter and also a favorite uncle to his many nieces and nephews.