I have had similar problems for different reasons. Aside from music, I also do voiceovers. Hearing even the tiniest delay is really offputting.
However, this is not a major problem with interfaces like the Focusrite because they have internal DSP and a good mix/monitoring system.
I did try the Presonus Quantum with Cubase. That has no internal mix, and despite their boasts of zero latency, it was just impossible. Used with Studio One, it was better, and just about passable, but not comfortable like direct monitoring.
I dream of the day when this is all as easy as it was with a good old analogue multi-track! haha