Need a solution for Computer induced noise over USB

Even assuming it’s not a grounding problem, the function of a balanced connection is to eliminate noise. A good read is the wikipedia article Balanced audio - Wikipedia