If I gave my client's name or other information that would identify him or allow people to guess at his identity, I would be breaking confidence. Saying that "a client" said it is not a problem. The fact that the client doesn't care that I mention it to other people makes it even less of one. The fact that I don't touch family law makes it even less relevant.

For a communication to be privileged, it needs to be made in a setting where only the attorney and client are present, it needs to pertain to the relationship between the attorney and client (i.e., why I am representing him) and it doesn't apply if the client explicitly authorizes that it be communicated. In this case, the client said it in a large company of people, so the communication isn't even covered, technically. If it were, I don't handle family law and the client is not American and so I am not qualified to handle his divorce or marriage or similar matters anyway, so the statement would not apply to our attorney-client relationship.