From what I can see in your pics, the problem on the doors isn't ghosting, you just don't have all the molding completely sanded off.
It looks raised , ghosting usually leaves a shallow depression wherever something is removed and is caused from using a "hot" laquer based paint, Tamiya primer shouldn't cause ghosting.
I think you just need to do some more sanding , using something hard behind the paper like a sanding block. Hard to find one that small but wrapping your sandpaper around a popsicle stick should do the trick.