Both of my wife’s affairs started out basically the way you describe your situation. Secret conversations, texting, using apps, whatever means they use it’s harmful to your marriage because it breaks down the trust between the two of you.
Does he want to make things work? If he does, you have to make it clear to him that all the time and energy he’s putting into his AP has to go back into your marriage if things are going to work out for the two of you. Imagine how close and intimately connected you could be if he would focus on you and only you. I wish I could get my wife to stop talking to her second AP but they continue the emotional affair with boldness. She confessed and I guess she feels she can just do it openly since she wants a divorce. She says she cares for my week being but continues to hurt me in this way. The audacity of these cheaters have to make their spouses compete for their attention is unbelievable!
Anyway, what he’s doing is wrecking your marriage, so I recommend you take a stand. You don’t have to come at him screaming, crying or angry, just be assertive and straight to the point. He’s got to cut ties with her and focus on you if he wants your marriage to work.