He wasn't thinking straight. He'd just come from a traumatic instance, he wasn't exactly clear-headed. And the plot needed him to not be holding the Power, because he had to get sick when he embraced it so he would leave and have his Dragonmount epiphany. So it's a plot device more than anything, although there are some explanations for it, if a little weak.