You didn’t say whether you intend this for a laptop or a desktop, but if it’s got a PCIe bus then have a look at the RME AIO. I have the RayDAT and just chop and change AD/DA as I please without ever having to worry about messing with drivers – which are by a long shot, the best drivers I’ve ever had to work with!
I do think there’s an opening for a pure ADAT-to-USB interface but good luck finding one … I haven’t used the Babyface but it’s on my wishlist.