I am so very sorry for the situation you are in, and will offer my humble opinion and advice.
His behavior is deplorable, and it obviously goes back even farther than your relationship with him. He is a serial cheater; period………Multiple sex partners is way of life for him, and hurting and humiliating you is not an issue for him at all, he only cares about his own selfish desires……..
I am sorry, I do not see a future for you with this jerk. I recommend you get tested for STDs immediately, and blood work for your children is in order as well, since his sleeping around was going on all through their conception.
Next, get yourself a lawyer, and start the process of getting to a better place for you and those kiddos. Remember, a cheater cheats on his WHOLE family, not just the spouse.
You deserve a loving partner that will stay true to you as much as the next person, please take this to heart.
Don’t bear this heavy burden alone, reach out to God in prayer, he is listening, and can help. Also, seek council with trusted family, friends, clergy, or all three.
I realize that it is very easy for me to write this, and that it is you who has to take these very difficult steps, but it will be better in the long run for you, and your children.
Staying in a bad marriage is not healthy for anyone, and it doesn’t sound like he is anywhere near ready to change his behavior.
I wish you the very best, and will say a prayer for you all.