The nucleus of the estate was a small farm of 100 acres (0.40 km2), called Cartleyhole, nicknamed Clarty (i.e., muddy) Hole, and was bought by Scott on the lapse of his lease (1811) of the neighbouring house of Ashestiel. He first built a small villa and named it Abbotsford, creating the name from a ford nearby where previously abbots of Melrose Abbey used to cross the river. Scott then built additions to the house and made it into a mansion, building into the walls many sculptured stones from ruined castles and abbeys of Scotland. In it he gathered a large library, a collection of ancient furniture, arms and armour, and other relics and curiosities, especially connected with Scottish history, notably the Celtic Torrs Pony-cap and Horns and the Woodwrae Stone, all now in the Museum of Scotland.
Scott had only enjoyed his residence one year when (1825) he met with that reverse of fortune which involved the estate in debt. In 1830 the library and museum were presented to him as a free gift by the creditors. wiki/Abbotsford_House