DH birthday trip ideas

DH's (weird to say that!) birthday falls on Labor Day weekend this year. I would like to take him away somewhere. He LOVES kayaking and would love to go anywhere that there is a place he can kayak
we might go with another couple not sure yet.
we went to Lake George a few years ago and rented a cabin on the lake and he loved it, so i am looking for something/someplace similar maybe in NH, VT, Mass or Maine???

does anyone have any ideas????? i'm looking to go for 3 nights, and dont want to kill the bank account

Cape May? Or if you want to go somewhere local, do you like seafood? City Island has a bunch of really great restaurants, and I used to go windsurfing there all the time when my dad lived there . It's also right close to Orchard Beach, a horse stable, and a lot of other outdoor activities!