The "do you like it" IS the most important criterion. Others are important as well. A 'likable' author can be good or bad, but an 'unlikable' one can never be good. The problem is that 'likable' is subjective and so easily ignored by those who want to quantify everything.

The problem with most modern art in my opinion is that the critics are too obsessed with prose and metaphors and the use of artistic devices, etc. all of which are important but ignores the big picture and things that aren't so easily quantifiable. It is as people were judged as being athletic based only on the size of their muscles and track speed. If we did that every athlete would look like a body builder but wouldn't be able to dribble a ball. That is how I feel about modern art and about criticism in general.