Plain and simple, plugging both left and right channels ruins the quality to the point of being unbearable

But after testing the pin-outs on the socket, it seems you have the right audio channel wired to the mono signal, which would explain the muffled sound

It would seem just the right audio channel was wired incorrectly