I think it's going to depend a great deal on how each is implemented. Many DACs have lacklustre USB inputs whereas S/PDIF tends to be better implemented. As you go upscale, it's not so clear, some like the LKS using an Amanero USB board.

You'd have to try them. One thing I would say is that I'd hate to be limited to a USB only DAC.