You should switch. It sounds like you're starving your body which will cause it turn anything it can to fat.
I lifted for a few years when I was younger, but I had to give it up due to time restraints. Now, I only lift twice a week since between my long hours at work, my car club, and my worsening personal life (gotta love roommates)- I don't have a whole lot of time. I need to get back into it, start eating more of my food's food, and drop my caffeine intake.
The only way I can gain any weight at all, is to lift. Hopefully, things will calm down at home soon, I'll get some stuff finished and I'll be able to devote more time to lifting and possibly start MA training again. Of course, that just may be a "pipe dream."