Grew up on the upper west side and in the Bronx. Didn't have a choice.
If you are a history buff you could drive uptown and see the Audubon ballroom where Malcom X got shot. Its on Broadway near 168st.
Apollo Theater on 125th.
South Street Seaport is cool.
They just towed the renovated USS Intrepid back to the West side as well.
Museum of Natural History
The Guggenheim
I can get around San Francisco just fine. NYC scares me.