I have now tried this with my RME interface (Digiface USB) and don’t see this issue with Loopbacks on or off. I tried vocals and a guitar FWIW, no difference to the signal whether Cubase monitoring on or off.
I notice the OP wasn’t on an RME card, but a Yamaha one.