If the above applies to you, my encouragement to you is that you don't have to feel guilty about your decision. You may be thinking, "I don't feel any guilt at all." Good. I hope so. However, if you do feel guilt at some level I'd like to tell you that you don't need to.
Please remember that you didn't leave the church of God's creating. Instead, you departed from a man-made veil that has been foisted upon the church through the centuries. You simply removed the veil in order to see Christ more clearly. What you are yearning for is likely the positives you've read about the N.T. church.
You may go through many years of longing and wandering. This can be frustrating. However, you should not feel any guilt because of it. On the contrary, I believe that desiring something more from church life is actually honoring to God. Why is this? The answer is that you are longing for the church that God designed.
I hope you find it.