Built from 1306 during the fortification of the village by the Count of Savoy Amédée V, the castle of Yvoire had for military objective to supervise the navigation and to control the road which connected Geneva to the high valley of the Rhone and to Italy.
During several centuries, the village of Yvoire was at the heart of several strategic or religious wars between the French, Bernese, Genevois, as well as the houses of Faucigny, Dauphiné and Savoie.
In 1591, a fire ravaged the building, which only regained its current form in the 20th century, when Félix Bouvier d’Yvoire undertook several interior and exterior renovations, including the installation of the roof and the corner watchtowers in 1939.