Mini Moon advice in Long Island

Hey Dolls,

My FH and I are getting married labor day weekend. We are planning to have a real honeymoon 2 months after the wedding, however, we wanted to have a minimoon right after the wedding.

We're having our wedding in Long island so I am hoping to find something romantic to do and stay for the weekend.

Any advice? I heard Montauk was nice but the hotels I saw on the beach we're my cup of tea. Can someone provide me with nice, romantic hotels or places to go. I prefer somewhat privacy and modern hotel.

thanks