The Bush Family Burial Ground was established during the first half of the 18th century as a family cemetery for descendants of Justus Bosch and Anne Smith. During the Revolutionary Period it became a burial ground for other inhabitants of Horseneck as well.

Located on the east side of Field Point Road north of Horseneck Lane, the site is now covered by the tracks of Metro-North Railroad's New Haven Line.

Justus Bosch (1674 – 1739) of Manhattan secured a foothold in Greenwich by 1711, where he and his descendants were known by the surname Bush.

The burial ground was situated about 400 feet northwest of Bush's gristmill (built between 1716 and 1719) and about 400 feet west of the Justus Bush farmhouse at Horseneck (built before 1760 and demolished about 1869). Bush's gristmill was positioned on the north bank of Horseneck Brook near Horseneck Harbor (which was later called Bush's Harbor and is presently known as Greenwich Harbor).

The Bush Family Vault was a central feature of the cemetery. It contained fifty or more decedents. There were additional marked and unmarked burials elsewhere in the graveyard. African-Americans were reportedly buried along the outer margin of the grounds.

The last known burial was in June 1867.

An estimated seventy-five or more burials were described when the cemetery was dismantled in 1894. A few identified and many unidentified remains were removed to Section B of Putnam Cemetery that same year. Other unmarked burials may remain in place.

Local lore in the 19th century maintained that the site was once used for hiding sugar, molasses and rum smuggled from the Caribbean during the colonial era in defiance of the Molasses Act of 1733. The Bush Family Vault was believed to have been constructed originally for this purpose. Many members of the extended Bush family of Manhattan, Rye, Greenwich and Antigua were merchants and mariners from the 1710s onward.