First …. dumb questions:
Is it facing the correct direction?
Is the bearing the correct size??
Is the bearing installed correctly and fully seated?
Could the cap be warped or twisted? anything is possible, though you would need a surface plate, height gauge, dial indicator and a good angle knee to measure it out to verify.
Being you’ve localized it to that specfic cap and bearing from there you should be able to narrow it down.