If you have hubbies approval then by all means, knock yourself out.
But if you dont have hubbies approval Id think carefully. Im assuming the hubby knows he is infertile and if his wife becomes pregnant without his consent then big trouble could come down on your doorstep.