As volumes can differ greatly, I usuall listen with “normalise volume” on. I am now quite positive that this doesn’t work as intended at all. It’s most obvious on CDs: I know for a fact they’re mastered to have appx the same volume throughout the whole CD, yet “normalise volume” will play some songs a lot more quiet than others. It’s especially already more “quiet” songs that get dragged down extra in volume. This enhances the (perceived) volume differences instead of reducing them.
Please check on what basis you normalise volumes, and rethink what you’re doing. Because now it’s not very helpful unless you listen to techno bangers or so.