In the literature, four kinds of stone are used in the rampart of Matsue Castle. Each building stone is called with the name “Oomizakiishi”, “Yadaishi”, “Inbeishi” and “Yomegashimaishi”. However, in practice, there are more stones named “Shimaishi” and “Moriyamaishi”. I classify these building stones of the rampart and estimate the districts of stone-suppliers. And I found the history of the building stones and repair of the Rampart have certain relationship.