I am very sorry for your situation, you have my deepest sympathy. I will offer my humble opinion and advice.
I am sorry, but I suspect he has been cheating on you during your entire relationship, the red flags are there, read what you have written.
It appears that he wants a wife and family, but he also wants to play on the side. He has no respect for you, and obviously has no problem doing things that hurt you, and you all’s marriage.
If you want to stay, and make it work, the first thing that needs to happen is for him to come clean, about ALL his activities. Next, he must show REAL remorse, if he is only sorry he got caught; and not sorry for his actions, he will never be faithful. After that, you all need to find out the reasons why he cheats, and he needs to address them, and try to correct his behavior.
Remember, he has to WANT to change, he needs to see what pain and suffering his actions have caused, and he needs to know that if he wants to save his marriage, he has to change his ways.
When you see how he reacts to all this, you will know whether or not you all have a chance.
In the mean time, you may want to separate for a while, you need time to clear your head, and heal somewhat, and needs the time to ponder what his actions have done to his family.
I also highly recommend that you get tested for STDs, you may have been exposed to something.
Please don’t bear this burden alone, seek council with trusted family, friends, clergy, or all three. I suspect he is a serial-cheater, so he probably needs professional help to sort out his issues, but again, this will only work if he is truly sorry, and wants to change.
I wish you all the best, and will say a prayer for you all.