How All Movie Review Rating Systems Are Flawed

When Terminator: Dark Fate was released, I tracked for over a week the Rotten Tomatoes ratings

The simple answer to the title: human beings created these rating systems.

The longer answer gets pretty deep. Stay with me as we weigh in..

No matter if it’s the greatest movie reviewer of all time or you’re brand new reviewer dipping a toe in the water: every ratings system you can pick to use — or create on your own — is flawed.

Let me explain what I mean by that and defend why I’m even bothering to use a rating system at all because it’s going to sound very hypocritical.

We use the five star rating system. It’s not the best, it’s not the worst, it’s one of the more familiar systems being used by reviewers. Amazon uses it for everything. People see a score in a five-star review system and understand immediately what it means.

That’s what you want. People to see a rating and say, yes, I understand if the reviewer liked or disliked.

Here’s what you don’t want to see:

Somebody help me understand what the star rating above means?!?!

I considered other rating systems.

Like the grading system (A+ = best, F = worst), but my computer programmer mind kicked in and said that wasn’t a numeric system. I worried that from a programming perspective, I’d have to convert those textual grades to a number at some point like this:

A+ = 14
A = 13
A- = 12
B+ = 11
B = 10
B- = 9
B = 8
C+ = 7
C- = 6
C = 5
D+ = 4
D = 3
D- = 2
F – 1

The grading system gives 14 comparative points which is much better than five stars which, with half stars, only gives 10.

5 stars = 10
4.5 = 9
4 = 8
3.5 =7
3 = 6
2.5 = 5
2 = 4
1.5 = 3
1 = 2
.5 = 1

The other rating system I thought about was the percentage, with 100% being the best and 0% being the worst. That doesn’t need any breakdown, as that gives 100 points of difference for comparison.

Some might be thinking, hey, that’s how Rotten Tomatoes works. They’d be wrong. That’s not how Rotten Tomatoes Tomatometer works.

The % from Rotten Tomatoes is how many gave a positive review vs. a negative one for a movie or TV show. So if the score is 35%, that doesn’t mean the average rating was 35%, it means 35% of everybody who left a review thought it was good.

Wrap your mind around that for a minute. Too very different things. If I’m using a 100% scale and give a movie 35 out of 100. That’s my review score. However, if 100 people are polled and 35 say they loved the movie, those 35 peoples scores are 100%. Now let’s take the other 65 people. Some they loved it (100%), some say they liked it (80%), some say it’s ok, but they still recommend it (70%). The average accumulation of those scores will not be 65%. That’s my point: mathematically and inherently flawed.

But when we see 35% Rotten Tomatoes, we think that is absolutely godawful. It’s a terrible score. The movie must be total crap. It’s possible, maybe even probable, that the score is higher depending on how much the people liked the movie vs. the ones that disliked.

That subjectivity is the flaw and no matter what rating system is used, the same flaws exist.

So, then what is the best rating system? Why not just skip using one and saying: recommended or not?

It’s those movies that sit in the middle, those pesky movies that teeter on the edge of recommended or not are the most vexing to rate. Do you recommend it or not? If you recommend it then you’re putting it in with the very best movies of all time that are also recommended. How do you compare one of the greatest movies with an OK movie that both entertained and have exactly the same score?

Aye, the rub.

So that brings up having more points of comparison in a review. A five star system with half stars is 10 points of comparison. A grading system is 14 points and a percent system provides 100 points. A four star system provides 8 points.

My problem when seeing a 3-star rating is whether or not that’s 3 out of 4 stars (75%) or 3 out of 5 (60%). Big difference in perspective. Not every movie reviewer shares the max rating. We don’t here, but probably should start doing that to make it clearer that we’re using a 5-star rating system, not a 4-star rating system.

At the end of the day those of us reading your review need to understand one simple thing: do you recommend seeing it or not. Yes or no. The why you chose which option is the entertainment angle of the criticism.

Let’s get to criticism. This is where people with opposing opinions sometimes confront each other. If I hate a movie you love, then how does that make you feel about me as a reviewer? Some of you might think my taste is terrible because we disagree. Some might say, hey, he just didn’t care for something I liked, others might call into question my professional standing as a movie critic.

There is an art to writing a great movie review without spoiling the movie. I’m still trying to figure out and learn this craft. It’s easier to write a good critique of a film. I do the latter here all the time, but only TV reviews appear, some of which are spoiler-laden and some are not. The spoiler-laden ones are better in my opinion because they allow me to explain every single detail why I liked or disliked something. It’s harder to do that with a shorter review. How do you criticize what you disliked without ruining the film for those who haven’t seen it yet, especially if that involves the ending?

So, for the spoiler-free reviews, the reviewer has to resort to using vague language. Listing reasons they dislike something, but not being able to fully explain what s/he disliked. Sometimes I can draw that picture in a couple hundred words or less and sometimes I can’t. This is the art of the craft and it’s much harder than it looks.

I could make an argument that a 200 word movie review that doesn’t spoil the film for those who haven’t watched is harder than writing a 5,000 word short story. I’ve done both.

What do you do when others disagree with your reviews? How do you handle that criticism?

I just read the longest ever explanations on how to handle criticism. It’s a good piece if you can get past the wordiness. It’s coming from a highly skilled famous guitar player, Steve Vai. The best part of it is how he personally handles criticism with three words: “I’ll try harder.”

Great response.

“I was doing an interview with the same magazine, and of course, they showed me this article and said, ‘What do you think about this, what he said?’, and I had already kind of practiced allowing him to have that opinion, and what I said was, ‘I’ll try harder’ – the end.

Steve Vai Explains Best Way to Handle Criticism, Recalls Reaction to ‘Very Famous Guitar Player’ Saying He Was Complete Crap | Music News @ Ultimate-Guitar.Com

If someone dislikes your next movie review, just remember to say, “I’ll try harder.” The same can be said for all movie rating systems. We need to try harder.