I just put that piece in and I had to grind from where your piece is now around the top of the hole then stick a screw driver in the hole of the part you are trying to get in an PRY pretty hard to pop it in. I think a bolt on wing would be a good improvement on that piece.
Be sure and get the paint out before you press the bearings in also.