She could truthfully think the rebels are implicitly helping the shadow by opposing the White Tower, and therefore consider them friends of the dark or dark friends, without meaning sworn to the shadow. That's how I interpreted it. Even if she was replying to an insult, the first oath would have prevented her from speaking the words if she did not believe them, and I really don't think she believed all the rebels were sworn to the shadow.