Not quite synchronous communication sucks. The cognitive and emotional toll of hearing only some of a conversation exceeds the value of the exchange. If you can’t have a low-latency synchronous exchange (e.g. a high-quality video call), then keep it asynchronous (e.g. email).
Unless participants would be making decisions over such a call, you don’t need real-time communication anyway. Record a video or write out an agenda. Leave the would-be attendees free to do their work instead.
If that Zoom call isn’t worth recording or wouldn’t unblock anything, why have it at all?