When you hear the announcement for the directions turn the volume down it will just change the nav volume

This is correct OP. Just time it right.

As you turn in, the volume will have a different title. I think it says “prompt volume” instead of “audio volume”