The husband agreed to a frank conversation about his wife's affairs