So I decided that the best way to remedy the situation was by trying to file these bumps down

Either way it works fine now, just not the best construction.

Either way, it should be easy to just file the edges down.