In true Italian fashion, Gavi is filled with ancient history and legends. While the origins of the castle are difficult to establish, as they are steeped in legends, it is likely that it was built in the pre-Roman era. It has been redesigned multiple times, from a castle under various ruling families, such as the Visconti of Milan, Fregoso family, House of Sforza, and the Guasco family to its final structure, a 17th-century fortress. From the 19th century until the end of the Second World War, it was used as a prison. Today, the castle is brought back to life by historical re-enactments together with conferences and plays.