Andover sits in Merrimack County near the Lake Sunapee region, home to Proctor Academy, a private secondary school with a large campus along the Blackwater River. The town's rural character and school presence give it a distinct small-town identity.

Proctor Academy anchors much of the town's cultural and economic activity, while nearby Highland Lake and Ragged Mountain provide swimming, skiing, and hiking close to home. Andover's small downtown includes a handful of local businesses.

Housing in Andover ranges from historic village homes to rural properties, drawing families connected to Proctor Academy and residents seeking Lake Sunapee-area access at a more affordable price than towns closer to the lake itself.