Long Island inquiry

Currently visiting the area, and given the nature of the weather, what can I possibly experience to occupy my time here?

I have had some good food at some little places in the middle of nowhere.

Doesnt seem to be much I have found to visit that doesnt involve shopping or food.

Museums, sightseeing?