I would tend to agree. What you can do is use LatencyMon to test your newer system and see which driver/process might be hanging you up. (Ethernet & display cards are often the culprit.) Updating the suspect driver will often do the trick.
Alternatively, you might have a flaky ASIO driver. You can see if ASIO4ALL makes a difference.