I have virtually the same story, I've only been with a couple of guys since that conversation (which was some time ago) but hubby was cool both times. It's nice to know that I can fuck someone when I get the urge although in reality my cheating was usually quite some time between guys.
I was with 32 guys before my first marriage, 4 guys during my first marriage (including preset hubby) and 5 during my 2nd (& present marriage) I think that makes 41 in total.
As long as hubby's discreet about it, I'm cool with it. I once caught an old bf showing poloroids (yes it was a few years ago ) to a couple of his friends, I was way more turned on than I was pissed!