The reason for voice assistants not taking off is quite simple imo. You don't know what it's capabilities are beyond the well known use cases ("set up a timer for 15min") but are well aware of that it's not going to understand everything. It's limitations are obscure and you've been misunderstood in the past, why waste more time. Compared to a human who understands everything you say, you have the full confidence of using voice.