Couple of fixes...
1. Set up accurately on the miller and bore a new hole, make oversize bush. Easy in theory, but a few thou out on the machining is just as bad as what you start with.
2. Get a better cover.
All depends if you have access to machine tools and skill, or prefer to spend rather than restore.
Swarfy