By benching more, you might be tightening up your pecs. Maybe try doing some lower trap / lat work to rotate your shoulders back a bit more. I have a similar problem in that I do a lot of bench, but so much back work. My arms come across my body quite a bit too, but I dont consider it a massive problem. There are other things I could work on for more improvements – perhaps the same is for you?
