locate when clic on empty space = everywhere !

Try this:

Preferences - Tool modifier - Select tool - set position -
Modifier = CTRL

I use the CTRL modifier but ALT will also work

Delta