Nope its not wrong to want to say something...your better off just breaking it off with him and moving on with your life. What did you expect really? He married the woman and most likely has a home and family with her...he doesn't want that ruined...as I say that I would like to also say thay No he doesn't deserve her or you. He lies to his wife, you can't expect any less from him yourself. Just move on.
why would you mess with someone elses husband anyway if you new he was married all that makes you is a home wrecking slut!!!!!!!!!!!!!!!!!!!!!!!!!!!!! !!!!!!!!!!!!!!!!!!!!!!!
Your lover was just using you, okay? That's what mistresses are for: to use for sex, to dump when they open their mouths to speak their mind or when they start showing their age. You buy them pretty trinkets to support their insecurity in the coupling, as long as they suck and fuck and keep their mouths shut. And you have them because a hotshot worth his shit will own a mistress. See that? OWN. Like a car, that when it gets a few miles on it, you trade it in.
Mistress rank is like a glorified hooker. Snap out of it, learn a lesson, and get your own man.