Dunno how far you are, but several times the inn at Flotsom has been a blank area that then becomes rendered as an actual building. Sometimes NPCs aren't around at first, and only appear after a second or two, and sometimes a wall or character will be bland like you described and then become properly textured.

It's only happened a few times to me, so I think it is just due to some bugginess/glitches in the game. If it happens more frequently in your case, then I'm not sure what the deal could be... Though it is a very graphic intensive game from what I understand.