The Stone family were United Empire Loyalists who settled at Gananoque, Ontario, around 1790. Captain Joel Stone received a grant of 700 acres of land on the west side of the Gananoque River and, took possession in 1791. Within a few years he had built a home, had a grist mill and saw-mill in operation, as well as a general store. As early as 1793, Stone built a schooner, the "Leeds Trader", which was for many years in use on the river and on Lake Ontario. When war broke out in 1812, Stone took charge of the military defences of the Gananoque district.