google assistant stops working

I use the google assistant and all works well, then it just will stop picking up voice commands, all the other remote functions still work, I restart my steaming devise and then it works again. This happens several times a day.