The only two drawbacks are the higher f-stop, which makes low light a little more challenging (but the vr system just about makes that a non-issue); and the bulkiness and weight

There is distortion, to be sure, but lens distortion is now a non-issue because of DXO and other lens correction software.

Most distortions and CA's are taken care of in software, so are pretty much a non-issue.