In 1858 Pierce House was built as "the best money could buy." Some of the materials were shipped in from Europe, and sandstone from Prairie du Chien was used. The architect, Samuel Hunter Donnel, used some of the same designs he used on the capitol building. A tunnel connected the house and the barn so that people could be safe from Indian attacks. It can be seen at 424 North Pinckney Street. Today this house is known as the Mansion Hill Inn, a bed and breakfast.