Results of ScreenwriterGuy’s Netflix Challenge
April 1st, 2007 by screenwriterguy
Readers may remember that in honor of Netflix passing the billion-served mark, I posted a little rave for the company. I also decided to undertake an experiment to test the rumors that Netflix uses a “throttling” system, by which a customer who returns rented movies frequently has a lower priority than a customer taking less advantage of their subscription.
A little research reveals that throttling (or “smoothing” as Netflix evidently calls it themselves) is a reality in their business plan, and a class-action law suit forced them to describe it in their terms of use agreement. Still, I have been a fairly heavy user for years, in two different markets, and I haven’t seen any strong evidence that my service ever declined. Thus the experiment… If I maximize my rental number, would my return rate be affected?
These were the rules: I began on March 1st, after a week of inactivity, with three DVDs in my possession. In some aspects, I would be like a customer who had just signed up. Each day I would watch a single movie and return it in the next day’s mail. My queue was full of titles, so there was no reason for delay on Netflix’s part. The only reprieve I would give myself would be evenings in which it would not matter if I watched another title that night. (For example, on a Thursday night with a single movie in hand, it wouldn’t matter if I watched it Thursday or waited to Friday, as the disc would be processed the following Monday, either way.) The goal was to see how many movies I could watch in a single month.
The results? Did my account get “throttled?”
Maybe.
For the most part, returns were very smooth. If I put a disc in my mail on Day 1, I would get a “received” e-mail from Netflix on Day 2, followed by a “shipped” e-mail later that day. On Day 3, the new disc would show up in the mail. I was surprised by this, because the mail carrier doesn’t come to my house until 4 p.m., and yet I would get “received” e-mails the next morning at 7 a.m. I later learned that Netflix sends trucks out specially to get discs from post offices, so they might be delivered to processing plants for a 3 a.m. shift to begin working on them.
I have an account that allows three rentals out at a time. Theoretically, excluding the issue of weekends, with a 3-disc account a person could have a new movie every day.
Over the course of the month, Netflix dropped the ball three times. Once was in the second week, and twice were in the fourth. Perhaps this is evidence of throttling. Perhaps my mail carrier came even later certain days. Perhaps random luck was on my side for the first two weeks and less so for the last. Hard to say. Here is a look at the frequency with which I was able to rent, with yellow indicating discs that took two days instead of one for Netflix to receive.
|
Thu |
1 |
Sherry Baby |
|
Fri |
2 |
The Prestige |
|
Sat |
3 |
– |
|
Sun |
4 |
Rescue Me s1d3 |
|
Mon |
5 |
NO DISCS |
|
Tue |
6 |
West Wing s6d1 |
|
Wed |
7 |
The Science of Sleep |
|
Thu |
8 |
– |
|
Fri |
9 |
The Devil’s Backbone |
|
Sat |
10 |
Seven Girlfriends |
|
Sun |
11 |
The 25th Hour |
|
Mon |
12 |
NO DISCS |
|
Tue |
13 |
Tideland |
|
Wed |
14 |
Cowboy Bebop: The Movie |
|
Thu |
15 |
– |
|
Fri |
16 |
– |
|
Sat |
17 |
Stranger than Fiction |
|
Sun |
18 |
A Guide to Recognizing Your Saints |
|
Mon |
19 |
NO DISCS |
|
Tue |
20 |
The Motel |
|
Wed |
21 |
Tenacious D: Pick of Destiny |
|
Thu |
22 |
– |
|
Fri |
23 |
Howl’s Moving Castle |
|
Sat |
24 |
– |
|
Sun |
25 |
Veronica Guerin |
|
Mon |
26 |
The Insider |
|
Tue |
27 |
Hope Springs |
|
Wed |
28 |
NO DISCS |
|
Thu |
29 |
The Closet |
|
Fri |
30 |
The Pursuit of Happyness |
|
Sat |
31 |
Happy Feet |
So it’s possible that this represents some amount of throttling by Netflix. The evidence suggests it, but there isn’t enough data yet. To make a real conclusion, I would need to keep going for another month or more. But I have to tell you, I don’t want to. Finding an extra two hours every day, on top of whatever TV one must follow, plus work and blogging and (God willing) writing? It’s tough. (I know… my life is hard.)
You’ll notice that there were four days in the month on which I had no movie to watch, and three of them were Mondays. Weekends add a natural, inherent throttling to the system, probably bigger factor than anything Netflix implements artificially. Mail doesn’t run on Sunday, and Netflix doesn’t process on Saturday. That means a disc you watch Thursday or Friday isn’t replaced until Tuesday. A disc you watch Saturday or Sunday isn’t replaced until Wednesday. The biggest thing Netflix could do to add value to their service, therefore, would be to add Saturday processing. I’m positive that it’s a conscious business decision on their parts not to do so.
Ultimately, though, examining throttling seems like a pointless pursuit. The fact of the matter is that I watched 21 movies in 31 days. That works out to 93 cents a movie, throttled or no. I watched more than four movies a week. Do you usually want more than that?
Similar Posts:
Posted in Entertainment Industry |








Apr 2nd 2007 at 5:59 am
thanks for the info! i’ve been meaning to try out netflix for a while, so maybe i will now.
meanwhile, you get points for having two anime titles on your list, but wha’ts with burning your netflix slots on tv shows?
Apr 2nd 2007 at 6:05 am
good exercise….cool blog
Apr 2nd 2007 at 6:41 am
cool experiment.
by the way, if you don’t want to wait for summer to “watch movies now” (digital delivery) on netflix, you can use this link to skip the wait: http://tinyurl.com/266jfo
Apr 2nd 2007 at 11:09 am
Cool post — when I do subscribe to Netflix - I will do it through this site — just to pay you back for all the time you took with that experiment and post.
I am actually more curious on the titles you rented:
1. what did you think of The Prestige — I friggin’ loved that film. Would like to hear your thoughts.
2. how was Tideland? haven’t seen it yet - but a big Gilliam fan - and I also cleared some music for that film.
Apr 3rd 2007 at 6:48 pm
Definitely liked The Prestige, although there were one too many hints, so I had the main mystery solved too early to enjoy everything fully. But then there was that other mystery that WASN’T based in logic, and I definitely didn’t put that together.
Honestly, I didn’t make it through Tideland. Partly I was tired. Partly it was dark and gross, and it dragged. Any one scene of the little girl talking to her doll heads is genius as a clip show component, but strung together as a movie I didn’t care for it.
May 5th 2007 at 5:51 pm
I really enjoyed Howl’s moving castle, but I’ve liked all of his stuff. I’m jealous, though - time to watch a full movie /and/ regular TV (I suppose it depends on how much you watch anyway). I haven’t watched a movie in weeks, but that’s the fault of school-and-child. Interesting experiment, though. Maybe they are more about throttling people who watch 2-3 movies per day instead of only one, or who watch one per day but only watch new releases, in which case your “short wait” may be a “long wait.”