This sign, at 128 S. Butler Street, marks the spot of the first Madison dwelling, where the Pecks lived. It was a group of 4 connected cabins that served as their home, an inn, a ballroom, a post office, a voting place, and even a hospital.

Other pioneer families soon joined the Pecks, and Madison grew rapidly. In 1848, when the Village of Madison was incorporated, there were 626 residents. By the time Madison was incorporated as a city in 1856, the population was 6,864.