Bayfield’s early economy was based on the sawmills located on the south shore. Within months of the town’s 1856 platting, construction of the first sawmill began. John T. Caho of Virginia had been induced by the Bayfield Land Company to begin construction of a mill at the foot of Fourth Street. The mill burned within two months, was rebuilt and later moved to Ashland, Wisconsin.