The Town of Chazy was annexed from the Town of Champlain on March 20, 1804. The first settler in the area was Jean La Framboise about 1763, who reportedly planted the first apple trees. After the Revolution, settlers came as refugees from Canada and Nova Scotia. Chazy was named after one of Samuel de Champlain's lieutenants who was ambushed and killed in 1666 at the mouth of the river which later bore his name.