Visit the hardware usage page in the admin to see how your server’s resources are performing.
If your CPU is maxed out on your Owncast server viewers will see buffering, as the server can no longer keep up. If this is what you’re experiencing the first step is to resolve excessive hardware utilization.