However, the speaker was not very good, and had constant low level feedback no matter where he used it.

This is not an issue however compared to the fact that some of the sounds the keyboard produces aren't the highest of quality even when played with sufficient external speakers