Not all systems are as revealing, but in any good system correct phasing is huge. I remember 30 years ago when I mis-wired a mid driver and heard the improvement first hand from reversing it's polarity. Years later I found out why!
Unfortunately crossovers shift phase and there is nothing we can do about it. A first order network shifts phase the least, but they don't always work well, especially with JBLs.