Ozzy, welcome to the forum, and quite honestly this sounds like poetry in my ears. Many of us work, raised families AND built models in whatever little time we can scrounge up. I learned to build through the night when I could not sleep. A model at a time, a new styrene adventure. The opening of the box, the feel of the plastic. Ah, the possibilities. Yes, it's addictive, and there should never be any reason to stop.
It's an escape all right from an ever-demanding (and meaningless) world. When you create with your hands, you are setting the world in order. I'm a big believer in this.