I too spent most of my life in Southern California, and you would be surprised by the number of ex-patriot SoCal's here in southern Maryland. Part of me misses the lifestyle I had in San Diego, but if I were to go back, I would only find that the lifestyle I had was in the past.
Believe it or not, the jobs pay much better here in the Pax River area, and while the schools are not up to say, Poway standards, they far surpass San Diego Unified. I retired from the Navy in 2001, and I haven't been out of work a single day since I got out. My friends who elected to stay in SD cannot say that.
You can get property close to the bay reasonably, while (after a quick visit home to SD) $700K only gets you 1200 square feet in a 40 year old fixer-upper in San Diego. While my friends and I do miss SoCal, we've got no intention of going back, except for a visit (like OMBAC OTL!)
Yeah the lifestyle is a little slower, and instead of Disneyland, you have living American History all around from the Revolution and Civil War, to the present day. DC is not an overly taxing drive, and while the weather can be somewhat unpredictable, you do get the four seasons.
That being said, it is getting pricier here. 2 years ago you could build a home in Mariners Cove starting at $140K, now they start at $250K, and only six lots are left! I guess it is all of us SoCal refugee's driving the prices up!