If you love history, go to Sebastian's store.
I visited the Hearst Castle last year and found the Sebastian's Store (another California Historical Monument) across the HWY 1 from the castle. The building itself is 150 years ols and has been owned by the same family for 90 years. They had wonderful selection of gifts, local artists, really good coffee and homemade cookies. There is a Whaling museum and other artifacts and pictures. The Sebastian's are friendly and know a lot about San Simeon history.