Also, people in WoT have grown up in fear of such men. What is to Mat's credit is his ability to get past that and continue to be friendly to Rand. Mat's reaction to Rand's channeling is no more unfriendly than learning that one of your companions was wearing a suicide bomber's explosive vest, only with a plutonium component, and was playing stop-and-start with the triggering device. "Get the hell away from me!" is an entirely reasonable and not excessively unfriendly response. In that same conversation, he does attempt to tie Rand's inevitable madness to his poor behavior towards Mat, Perrin & Loial earlier in the book. THAT is the act of a friend - upon learning the worst possible thing about a friend, you say "Oh, it that why you were mean to us before? That WOULD explain it, rather than you just being an ass..."