Mine were the same, probably because I powder coated the bracket and the washer, (or maybe it just didn't fit in the first place)
They do need to fit tight in that pocket so they don't move around. Grind whatever is needed off one side of each washer and place that side inboard or outboard on...