Make sure you pin the fan - just insert something thin into the opening that's long enough to hold the fan blades in place without damaging them. If you spin the fan too hard you could damage it.

Almost certainly dust though, yeah. Cleaning it physically should help. Also take a look at how many background processes are running; if any of them are particularly intensive yet unnecessary, shutting them down might help matters as well.