The first military building was erected in the 13th century, and the lieutenants of the County possessed it by royal concession, corresponding among other counts to the infant don Enrique de Trastamara, to Bertrand Duguesclin, to Fernando de Castro, to the Counts of Trastamara, and finally it was granted by the Catholic Monarchs, who stayed there and repaired it at the expense of the Holy Brotherhood, to the Counts of Lemos. Carlos I and Felipe II also stayed there. It had a wide enclosure, four towers, including the Keep and the Market Tower, basements, moats, counter-moats, and had several houses inside. Destroyed during the “Irmandiña Revolt” (late 15th century), it was rebuilt at the expense of the vassals of the “Cinco Pobras”. It was the seat of the Regiment and Justice of the Villa and Marquisate of Sarria and the residence of its Corregidores until the third decade of the 18th century. It stood until 1860, when, being sold by the Duke of Alba, the land was acquired, in halves, by don Manuel Batallón and the Town Hall, while the stone from the walls and towers was bought by several families of the town. Only one flank tower made of slab and granite stone remains, which was covered with mortar, reaching 15 meters in height. Its summit is reached by a staircase partly opened through a section of the wall, and it preserves shields with the arms of the Castro, Enríquez, and Osorio families. On the wall that encloses the estate, several crosses from an 18th-century “via crucis” can be seen.