Two Avatars setup correctly but animation from one is messed up on another

Hello,

So I have a model with a few animations, I configured it's avatar and checked the muscles and everything looks and works great.

I then bring in another model, I I configured it's avatar and checked the muscles and everything looks great. But when I apply the animation from the first model to it, the arms and legs are crossed, the animation just doesn't work that well on a retargeted model. This happens quite a bit.

I have no idea how to fix this.