Do you have your minimum processor power state set to 100% in your Windows Power Management settings? Because if it's set too low, your processor will downclock to save power, and only upclock under load, which can cause audio glitching if it's very suddenly loaded. This setting is really important for realtime audio applications, in my experience.
(I now see this was already mentioned by others
