'That's how websites work': OkCupid boasts about Facebook-style experiments on users

Co-founder Christian Rudder: “OkCupid doesn’t really know what it’s doing. Neither does any other website. Experiments are how you sort all this out.”

Facebook accidentally sparked a media firestorm when it revealed it had been tweaking users’ News Feeds in psychological experiments, and now it seems dating website OkCupid wants in on the act, announcing in a tongue-in-cheek blog post: “We Experiment on Human Beings!

As you might have guessed from that quotation, the site isn’t shy about its experiments, with co-founder Christian Rudder detailing various schemes including removing all users’ profile pictures for a day and deliberately matching ‘non compatible’ couples just to see what would happen.

“OkCupid doesn’t really know what it’s doing,” writes Rudder. “Neither does any other website. It’s not like people have been building these things for very long, or you can go look up a blueprint or something. Most ideas are bad. Even good ideas could be better. Experiments are how you sort all this out.”

Rudder makes it clear where he stands on the debate over user experimentation, telling readers: “Guess what, everybody: if you use the Internet, you’re the subject of hundreds of experiments at any given time, on every site. That’s how websites work.”

Reactions to Rudder's post have been divided, with some users outraged that OkCupid actively lied to users (especially in deliberately creating ‘bad couples’) while others have pointed out that this sort of experimentation is actually OkCupid’s whole selling point: they actively promise that their algorithms will mine your interests to match you with a perfect partner – it’s the reason their logo is a chemistry beaker.

The first experiment removed users' profile pictures and total number of conversations plummeted as a result.

Rudder details three experiments in the long blog post, the first of which removed users profile pictures as part of a ‘Love is Blind’ holiday. The result was that people responded to messages 44 per cent more often and that contact details were exchanged more quickly. However, when pictures were restored these chats “melted away”.

"The goodness was gone, in fact worse than gone," writes Rudder. "It was like we’d turned on the bright lights at the bar at midnight."

The second experiment looked at how users scored one another for “looks” and “personality”, finding that even if they hadn’t written a single word about themselves in their profile, users “personality” would still be scored roughly the same as if they'd taken the time to list interests and hobbies.

Rudder’s conclusion? “Essentially, the [profile] text is less than 10% of what people think of you. So, your picture is worth that fabled thousand words, but your actual words are worth…almost nothing.”

Rudder gave the example of the 'driftwood lady' who had a 99% score on 'personality' despite having no text in her dating profile.  

In the third and final experiment (which has proved the most controversial - as it involves actively lying to the users) couples were told that they were a good match even when OkCupid’s own algorithms suggested they weren’t.

“By all our internal measures, the “match percentage” we calculate for users is very good at predicting relationships,” writes Rudder. “But in the back of our minds, there’s always been the possibility: maybe it works just because we tell people it does. Maybe people just like each other because they think they’re supposed to?”

In the end they found it was a little bit of both: when users were told they were a good match they acted as if they were, exchanging more messages in chat (OkCupid counts a total of four messages as a “real conversation”) but the best result was to spark conversation was to tell good matches that they were good matches. In other words, writes Rudder, “OkCupid definitely works, but that’s not the whole story.”

A graph showing the results of the third experiment - the percentage is of exchanging four messages.

So what will the users think? OkCupid’s defence that ‘everyone experiments on people online’ is not a justification, especially when the information being tweaked is so personal. But compared to Facebook's research, which was undertaken mainly for the benefit of Facebook, OkCupid’s experiments actually helps users by creating better matches – it's what those who sign up are paying for.

Life and Style
ebookNow available in paperback
ebooks
ebookA delicious collection of 50 meaty main courses
Latest stories from i100
Have you tried new the Independent Digital Edition apps?
Independent Dating
and  

By clicking 'Search' you
are agreeing to our
Terms of Use.

ES Rentals

    iJobs Job Widget
    iJobs Gadgets & Tech

    Recruitment Genius: Software Developer

    £27500 - £35000 per annum: Recruitment Genius: This is an exciting opportunity...

    Recruitment Genius: IT Support Analyst

    £35000 - £45000 per annum: Recruitment Genius: They are the go-to company for ...

    Guru Careers: Graduate Software Developer / Junior Developer

    £20 - 28k + Benefits: Guru Careers: We are seeking a Graduate Software Develop...

    Recruitment Genius: Digital Web Designer

    Negotiable: Recruitment Genius: A Digital Web Designer is required to join a f...

    Day In a Page

    Why the cost of parenting has become so expensive

    Why the cost of parenting has become so expensive

    Today's pre-school child costs £35,000, according to Aviva. And that's but the tip of an iceberg, says DJ Taylor
    Fifa corruption: The 161-page dossier that exposes the organisation's dark heart

    The 161-page dossier that exposes Fifa's dark heart

    How did a group of corrupt officials turn football’s governing body into what was, in essence, a criminal enterprise? Chris Green and David Connett reveal all
    Mediterranean migrant crisis: 'If Europe thinks bombing boats will stop smuggling, it will not. We will defend ourselves,' says Tripoli PM

    Exclusive interview with Tripoli PM Khalifa al-Ghweil

    'If Europe thinks bombing boats will stop smuggling, it will not. We will defend ourselves'
    Raymond Chandler's Los Angeles: How the author foretold the Californian water crisis

    Raymond Chandler's Los Angeles

    How the author foretold the Californian water crisis
    Chinese artist who posted funny image of President Xi Jinping facing five years in prison as authorities crackdown on dissent in the arts

    Art attack

    Chinese artist who posted funny image of President Xi Jinping facing five years in prison
    Marc Jacobs is putting Cher in the limelight as the face of his latest campaign

    Cher is the new face of Marc Jacobs

    Alexander Fury explains why designers are turning to august stars to front their lines
    Parents of six-year-old who beat leukaemia plan to climb Ben Nevis for cancer charity

    'I'm climbing Ben Nevis for my daughter'

    Karen Attwood's young daughter Yasmin beat cancer. Now her family is about to take on a new challenge - scaling Ben Nevis to help other children
    10 best wedding gift ideas

    It's that time of year again... 10 best wedding gift ideas

    Forget that fancy toaster, we've gone off-list to find memorable gifts that will last a lifetime
    Paul Scholes column: With the Premier League over for another year, here are my end of season awards

    Paul Scholes column

    With the Premier League over for another year, here are my end of season awards
    Heysel disaster 30th anniversary: Liverpool have seen too much tragedy to forget fateful day in Belgium

    Liverpool have seen too much tragedy to forget Heysel

    Thirty years ago, 39 fans waiting to watch a European Cup final died as a result of a fatal cocktail of circumstances. Ian Herbert looks at how a club dealt with this tragedy
    Amir Khan vs Chris Algieri: Khan’s audition for Floyd Mayweather may turn into a no-win situation, says Frank Warren

    Khan’s audition for Mayweather may turn into a no-win situation

    The Bolton fighter could be damned if he dazzles and damned if he doesn’t against Algieri, the man last seen being decked six times by Pacquiao, says Frank Warren
    Blundering Tony Blair quits as Middle East peace envoy – only Israel will miss him

    Blundering Blair quits as Middle East peace envoy – only Israel will miss him

    For Arabs – and for Britons who lost their loved ones in his shambolic war in Iraq – his appointment was an insult, says Robert Fisk
    Fifa corruption arrests: All hail the Feds for riding to football's rescue

    Fifa corruption arrests

    All hail the Feds for riding to football's rescue, says Ian Herbert
    Isis in Syria: The Kurdish enclave still resisting the tyranny of President Assad and militant fighters

    The Kurdish enclave still resisting the tyranny of Assad and Isis

    In Syrian Kurdish cantons along the Turkish border, the progressive aims of the 2011 uprising are being enacted despite the war. Patrick Cockburn returns to Amuda
    How I survived Cambodia's Killing Fields: Acclaimed surgeon SreyRam Kuy celebrates her mother's determination to escape the US

    How I survived Cambodia's Killing Fields

    Acclaimed surgeon SreyRam Kuy celebrates her mother's determination to escape to the US