Hi Derek Torrence, welcome to the Google Pixel Watch community forum!
Yes, this has been happening to a lot of people, including myself. I am unaware of a simple fix, and would suggest sending feedback through the Pixel Watch app on your phone. The feedback reports go directly to the developers, and team responsible for the watch functions.