It sounds like you and your wife don’t talk about extra-curricular activity, which is totally your prerogative. My husband and I only see other people together so the only potential issue for us is seeing someone we’ve been with in a non-poly friendly crowd. That happens from time to time, but whatever your parameters, I totally agree that if you aren’t able to keep your composure, you probably shouldn’t be engaging in this kind of activity.