Yes, happens all the time for me. Unpairing on both ends then reconnecting seems to fix the issue but it's still annoying. I've got a Pixel 3 so the latest versions of Android and Android Auto at all times.
I think I got it figured out. In settings for phone click use phone ringer as your choice. Unpair and re-pair. Did that a week ago and so far it is working fine.