I think Caleb Flynn had post-marriage psychosis and didn't know what he was doing. And actually, how do we know that the mistress didn't kill the wife and gaslight Caleb into thinking he did it?