From what u said, u r still in a quite good status, and he is still quite a good guy.
Dont so easily get spoiled up by the local culture or enviorment.
I have the same feeling with you. sometimes I think if I had not the child, I would leave my husband. I want to leave him for many times,but I can't forget he loves me so much in China,and he is a very kind man. So,it is very difficult for me to say goodbye to him.