My Friend Chuck Quinn (CWQUINNFURNITURE.com) did some Census research for us and found out the following info:

Living in the same house which looks like it was owned by Caroline Chapin because her real estate is valued at $2500 was

Caroline Chapin  48 

David Chapin 11 attending school

Cyrus Fay - 38 yo was a Milk gatherer

Caroline Fay 35yo 

In 1860 Cyrus Fay owned 108 acres of improved land and 47 acres of unimproved land .  This is from a non census document

He had 

3 horses, 

13 milk cows 

2 working oxen 

5 swine 

150 bunches of indian corn

Farm acreage was worth $10,000

Implements $150

Livestock $750

On the same page is a 

Jasper Fay

Josiah Fay

E Forbes

Their farms were a bit smaller

TID BITS  I NOTICED  on the 1880 census

There is a Joseph A. Trowbridge (60 yo)  along with his wife May (57 yo) living on Church St. in the 1880's census.  He was a retired merchant.   That is probably where William Trowbridge Forbes got his name.  Perhaps a relative.

There is a May M Fay 18 yo lives on Parkman street and is a servant of William and Jane Sibley.  William is a wheel wright.