The official residence of the Governor of Gibraltar since 1728, it was a convent of Franciscan Friars who took abode there in 1531. The Ball Room is formed from the nave of the old chapel of the convent. The Billiard Room is in the new wing which was erected in 1879. The Banqueting Room, built in 1864, has the shields of arms, flags and mottoes of illustrious persons connected with Gibraltar and of all the Governors since 1/04 and of others preceding the British capture. The panels of the end doors are made of the old dining tables mentioned in Drinkwater as having been made from cedar wood thrown on shore from the wrecks of Spanish vessels engaged in the Grand Attack on the Rock in September, 1782, the shot holes being clearly visible. In the patio there is a wooden statue of Eliott cut out of the bowsprit of the Spanish man-of-war “San Juan”, taken at Trafalgar. It is said that the Convent is haunted by the Grey Lady -a Franciscan Nun who was caught trying to elope with her sweetheart.

The garden is beautiful and well kept with some interesting specimens including very old Dragon Trees and rare and exotic trees. Among the trees planted by Royalty are those planted by King Edward VII; the German Emperor Wilhelm II; Prince Hirohito, Crown Prince of Japan; and Her Majesty Queen Elizabeth II.