Results of ScreenwriterGuy’s Netflix Challenge

April 1st, 2007

NetflixReaders may remember that in honor of Netflix passing the billion-served mark, I posted a little rave for the company. I also decided to undertake an experiment to test the rumors that Netflix uses a “throttling” system, by which a customer who returns rented movies frequently has a lower priority than a customer taking less advantage of their subscription.

A little research reveals that throttling (or “smoothing” as Netflix evidently calls it themselves) is a reality in their business plan, and a class-action law suit forced them to describe it in their terms of use agreement. Still, I have been a fairly heavy user for years, in two different markets, and I haven’t seen any strong evidence that my service ever declined. Thus the experiment… If I maximize my rental number, would my return rate be affected?

These were the rules: I began on March 1st, after a week of inactivity, with three DVDs in my possession. In some aspects, I would be like a customer who had just signed up. Each day I would watch a single movie and return it in the next day’s mail. My queue was full of titles, so there was no reason for delay on Netflix’s part. The only reprieve I would give myself would be evenings in which it would not matter if I watched another title that night. (For example, on a Thursday night with a single movie in hand, it wouldn’t matter if I watched it Thursday or waited to Friday, as the disc would be processed the following Monday, either way.) The goal was to see how many movies I could watch in a single month.

The results? Did my account get “throttled?”

Maybe.

For the most part, returns were very smooth. If I put a disc in my mail on Day 1, I would get a “received” e-mail from Netflix on Day 2, followed by a “shipped” e-mail later that day. On Day 3, the new disc would show up in the mail. I was surprised by this, because the mail carrier doesn’t come to my house until 4 p.m., and yet I would get “received” e-mails the next morning at 7 a.m. I later learned that Netflix sends trucks out specially to get discs from post offices, so they might be delivered to processing plants for a 3 a.m. shift to begin working on them.

I have an account that allows three rentals out at a time. Theoretically, excluding the issue of weekends, with a 3-disc account a person could have a new movie every day.

Over the course of the month, Netflix dropped the ball three times. Once was in the second week, and twice were in the fourth. Perhaps this is evidence of throttling. Perhaps my mail carrier came even later certain days. Perhaps random luck was on my side for the first two weeks and less so for the last. Hard to say. Here is a look at the frequency with which I was able to rent, with yellow indicating discs that took two days instead of one for Netflix to receive.

Thu 1 Sherry Baby
Fri 2 The Prestige
Sat 3
Sun 4 Rescue Me s1d3
Mon 5 NO DISCS
Tue 6 West Wing s6d1
Wed 7 The Science of Sleep
Thu 8
Fri 9 The Devil’s Backbone
Sat 10 Seven Girlfriends
Sun 11 The 25th Hour
Mon 12 NO DISCS
Tue 13 Tideland
Wed 14 Cowboy Bebop: The Movie
Thu 15
Fri 16
Sat 17 Stranger than Fiction
Sun 18 A Guide to Recognizing Your Saints
Mon 19 NO DISCS
Tue 20 The Motel
Wed 21 Tenacious D: Pick of Destiny
Thu 22
Fri 23 Howl’s Moving Castle
Sat 24
Sun 25 Veronica Guerin
Mon 26 The Insider
Tue 27 Hope Springs
Wed 28 NO DISCS
Thu 29 The Closet
Fri 30 The Pursuit of Happyness
Sat 31 Happy Feet

So it’s possible that this represents some amount of throttling by Netflix. The evidence suggests it, but there isn’t enough data yet. To make a real conclusion, I would need to keep going for another month or more. But I have to tell you, I don’t want to. Finding an extra two hours every day, on top of whatever TV one must follow, plus work and blogging and (God willing) writing? It’s tough. (I know… my life is hard.)

You’ll notice that there were four days in the month on which I had no movie to watch, and three of them were Mondays. Weekends add a natural, inherent throttling to the system, probably bigger factor than anything Netflix implements artificially. Mail doesn’t run on Sunday, and Netflix doesn’t process on Saturday. That means a disc you watch Thursday or Friday isn’t replaced until Tuesday. A disc you watch Saturday or Sunday isn’t replaced until Wednesday. The biggest thing Netflix could do to add value to their service, therefore, would be to add Saturday processing. I’m positive that it’s a conscious business decision on their parts not to do so.

Ultimately, though, examining throttling seems like a pointless pursuit. The fact of the matter is that I watched 21 movies in 31 days. That works out to 93 cents a movie, throttled or no. I watched more than four movies a week. Do you usually want more than that?

 

Share

6 Responses to “Results of ScreenwriterGuy’s Netflix Challenge”

  1. MaxVonMayerling Says:

    thanks for the info! i’ve been meaning to try out netflix for a while, so maybe i will now.

    meanwhile, you get points for having two anime titles on your list, but wha’ts with burning your netflix slots on tv shows?

      

  2. wcdixonNo Gravatar Says:

    good exercise….cool blog

      

  3. StudioPicturesSuckNo Gravatar Says:

    cool experiment.

    by the way, if you don’t want to wait for summer to “watch movies now” (digital delivery) on netflix, you can use this link to skip the wait: http://tinyurl.com/266jfo

      

  4. ZOZ Says:

    Cool post — when I do subscribe to Netflix – I will do it through this site — just to pay you back for all the time you took with that experiment and post.

    I am actually more curious on the titles you rented:

    1. what did you think of The Prestige — I friggin’ loved that film. Would like to hear your thoughts.

    2. how was Tideland? haven’t seen it yet – but a big Gilliam fan – and I also cleared some music for that film.

      

  5. screenwriterguyNo Gravatar Says:

    Definitely liked The Prestige, although there were one too many hints, so I had the main mystery solved too early to enjoy everything fully. But then there was that other mystery that WASN’T based in logic, and I definitely didn’t put that together.

    Honestly, I didn’t make it through Tideland. Partly I was tired. Partly it was dark and gross, and it dragged. Any one scene of the little girl talking to her doll heads is genius as a clip show component, but strung together as a movie I didn’t care for it.

      

  6. onicaNo Gravatar Says:

    I really enjoyed Howl’s moving castle, but I’ve liked all of his stuff. I’m jealous, though – time to watch a full movie /and/ regular TV (I suppose it depends on how much you watch anyway). I haven’t watched a movie in weeks, but that’s the fault of school-and-child. Interesting experiment, though. Maybe they are more about throttling people who watch 2-3 movies per day instead of only one, or who watch one per day but only watch new releases, in which case your “short wait” may be a “long wait.”

      

Leave a Reply