If only left-handed fermions are affected by the weak force, would this not mean that electrons and neutrinos are affected, but their anti-particles are not. This would be one difference between matter and antimatter at QM level.

There never was nothing.