Appointed by the town in 1884 to write its first history, Rev. Albert K. Teele, James Murray Robbins, Charles Breck, and Edmund J. Baker compile residents' memories, documents, and even genealogical questionnaires mailed to every family. James Murray Robbins is the recognized Revolutionary War expert in the group, and though he dies before publication, he reviews and contributes much. Editor Teele writes, "But for all this, it is fully believed that the unwritten history lost by his death far exceeds in value what he has written."

Regarding Daniel Vose, they publish: "In company with Joseph Fenno, he bought of Mr. Smith a piece of land on the east side of Adams street, near the way leading to the public landing-place, where the pump now stands. There they erected a building serving as a dwelling-house and store. In this building they traded for fourteen years. In the mean time Mr. Fenno having been drowned, and the business increasing greatly on the hands of Mr. Vose, he was led to put up a store seventy-five feet long and forty-five feet wide, with conveniences for residence above, occupying the same ground as Associates Hall. This was burned in 1860. The old house was removed and enlarged, and now stands next to the Milton depot, memorable as the building in which the 'Suffolk Resolves' were passed Sept. 9, 1774."

They note that Dr. Amos Holbrook lived in the house both before it moved and afterwards, and that Rachel Vose's father, Jeremiah Smith (died 1790), lived there for a time while in poor health.