I would check first if there are errors in the Windows application and systems event logs.
And then try with another audio driver, for example you could try with your motherboard audio card to see if it’s a problem with your audio interface low level driver.
What’s the Windows processor load during those half freezes ?
When stranges things like this do occur, the best is to exchange each sub system so that you can detect witch one is responsible of the problem.
This can be a long and difficult process and there are chances that nobody will be able to help you directly when using very recent hardware.