Volume issues when paired and connected topic

Has anyone else had an issue when the SW2 is connected to your phone that everything on the phone defaults to the earpiece speaker and Google Experience Launcher won't listen on its own when you say "okay google"? I tried unpairing and repairing, clearing data on the smartwatch apps, and still have the same problem.

Anyone have any ideas?

Sent from my Nexus 5 using XDA Premium 4 mobile app