Medieval Billionaires Spent Millions On Rocks Stacked Carefully

I’m thinking of the old stone castles. What you think of when you think “castle”. What did those cost to those who owned it?