'That's how websites work': OkCupid boasts about Facebook-style experiments on users

Co-founder Christian Rudder: “OkCupid doesn’t really know what it’s doing. Neither does any other website. Experiments are how you sort all this out.”

Facebook accidentally sparked a media firestorm when it revealed it had been tweaking users’ News Feeds in psychological experiments, and now it seems dating website OkCupid wants in on the act, announcing in a tongue-in-cheek blog post: “We Experiment on Human Beings!

As you might have guessed from that quotation, the site isn’t shy about its experiments, with co-founder Christian Rudder detailing various schemes including removing all users’ profile pictures for a day and deliberately matching ‘non compatible’ couples just to see what would happen.

“OkCupid doesn’t really know what it’s doing,” writes Rudder. “Neither does any other website. It’s not like people have been building these things for very long, or you can go look up a blueprint or something. Most ideas are bad. Even good ideas could be better. Experiments are how you sort all this out.”

Rudder makes it clear where he stands on the debate over user experimentation, telling readers: “Guess what, everybody: if you use the Internet, you’re the subject of hundreds of experiments at any given time, on every site. That’s how websites work.”

Reactions to Rudder's post have been divided, with some users outraged that OkCupid actively lied to users (especially in deliberately creating ‘bad couples’) while others have pointed out that this sort of experimentation is actually OkCupid’s whole selling point: they actively promise that their algorithms will mine your interests to match you with a perfect partner – it’s the reason their logo is a chemistry beaker.

The first experiment removed users' profile pictures and total number of conversations plummeted as a result.

Rudder details three experiments in the long blog post, the first of which removed users profile pictures as part of a ‘Love is Blind’ holiday. The result was that people responded to messages 44 per cent more often and that contact details were exchanged more quickly. However, when pictures were restored these chats “melted away”.

"The goodness was gone, in fact worse than gone," writes Rudder. "It was like we’d turned on the bright lights at the bar at midnight."

The second experiment looked at how users scored one another for “looks” and “personality”, finding that even if they hadn’t written a single word about themselves in their profile, users “personality” would still be scored roughly the same as if they'd taken the time to list interests and hobbies.

Rudder’s conclusion? “Essentially, the [profile] text is less than 10% of what people think of you. So, your picture is worth that fabled thousand words, but your actual words are worth…almost nothing.”

Rudder gave the example of the 'driftwood lady' who had a 99% score on 'personality' despite having no text in her dating profile.  

In the third and final experiment (which has proved the most controversial - as it involves actively lying to the users) couples were told that they were a good match even when OkCupid’s own algorithms suggested they weren’t.

“By all our internal measures, the “match percentage” we calculate for users is very good at predicting relationships,” writes Rudder. “But in the back of our minds, there’s always been the possibility: maybe it works just because we tell people it does. Maybe people just like each other because they think they’re supposed to?”

In the end they found it was a little bit of both: when users were told they were a good match they acted as if they were, exchanging more messages in chat (OkCupid counts a total of four messages as a “real conversation”) but the best result was to spark conversation was to tell good matches that they were good matches. In other words, writes Rudder, “OkCupid definitely works, but that’s not the whole story.”

A graph showing the results of the third experiment - the percentage is of exchanging four messages.

So what will the users think? OkCupid’s defence that ‘everyone experiments on people online’ is not a justification, especially when the information being tweaked is so personal. But compared to Facebook's research, which was undertaken mainly for the benefit of Facebook, OkCupid’s experiments actually helps users by creating better matches – it's what those who sign up are paying for.

Life and Style
ebookNow available in paperback
ebooks
ebookA delicious collection of 50 meaty main courses
Latest stories from i100
Have you tried new the Independent Digital Edition apps?
SPONSORED FEATURES
Independent Dating
and  

By clicking 'Search' you
are agreeing to our
Terms of Use.

ES Rentals

    iJobs Job Widget
    iJobs Gadgets & Tech

    Recruitment Genius: Technical Author / Multimedia Writer

    Negotiable: Recruitment Genius: This recognized leader in providing software s...

    Recruitment Genius: IT Sales Consultant

    £35000 - £40000 per annum: Recruitment Genius: This IT support company has a n...

    Recruitment Genius: Senior IT Project Manager

    £55000 - £70000 per annum: Recruitment Genius: This is a fantastic opportunity...

    Recruitment Genius: iOS Developer - Objective-C

    £38000 - £45000 per annum: Recruitment Genius: Design and build advanced appli...

    Day In a Page

    Isis profits from destruction of antiquities by selling relics to dealers - and then blowing up the buildings they come from to conceal the evidence of looting

    How Isis profits from destruction of antiquities

    Robert Fisk on the terrorist group's manipulation of the market to increase the price of artefacts
    Labour leadership: Andy Burnham urges Jeremy Corbyn voters to think again in last-minute plea

    'If we lose touch we’ll end up with two decades of the Tories'

    In an exclusive interview, Andy Burnham urges Jeremy Corbyn voters to think again in last-minute plea
    Tunisia fears its Arab Spring could be reversed as the new regime becomes as intolerant of dissent as its predecessor

    The Arab Spring reversed

    Tunisian protesters fear that a new law will whitewash corrupt businessmen and officials, but they are finding that the new regime is becoming as intolerant of dissent as its predecessor
    King Arthur: Legendary figure was real and lived most of his life in Strathclyde, academic claims

    Academic claims King Arthur was real - and reveals where he lived

    Dr Andrew Breeze says the legendary figure did exist – but was a general, not a king
    Who is Oliver Bonas and how has he captured middle-class hearts?

    Who is Oliver Bonas?

    It's the first high-street store to pay its staff the living wage, and it saw out the recession in style
    Earth has 'lost more than half its trees' since humans first started cutting them down

    Axe-wielding Man fells half the world’s trees – leaving us just 422 each

    However, the number of trees may be eight times higher than previously thought
    60 years of Scalextric: Model cars are now stuffed with as much tech as real ones

    60 years of Scalextric

    Model cars are now stuffed with as much tech as real ones
    Theme parks continue to draw in thrill-seekers despite the risks - so why are we so addicted?

    Why are we addicted to theme parks?

    Now that Banksy has unveiled his own dystopian version, Christopher Beanland considers the ups and downs of our endless quest for amusement
    Tourism in Iran: The country will soon be opening up again after years of isolation

    Iran is opening up again to tourists

    After years of isolation, Iran is reopening its embassies abroad. Soon, there'll be the chance for the adventurous to holiday there
    10 best PS4 games

    10 best PS4 games

    Can’t wait for the new round of blockbusters due out this autumn? We played through last year’s offering
    Transfer window: Ten things we learnt

    Ten things we learnt from the transfer window

    Record-breaking spending shows FFP restraint no longer applies
    Migrant crisis: UN official Philippe Douste-Blazy reveals the harrowing sights he encountered among refugees arriving on Lampedusa

    ‘Can we really just turn away?’

    Dead bodies, men drowning, women miscarrying – a senior UN figure on the horrors he has witnessed among migrants arriving on Lampedusa, and urges politicians not to underestimate our caring nature
    Nine of Syria and Iraq's 10 world heritage sites are in danger as Isis ravages centuries of history

    Nine of Syria and Iraq's 10 world heritage sites are in danger...

    ... and not just because of Isis vandalism
    Girl on a Plane: An exclusive extract of the novelisation inspired by the 1970 Palestinian fighters hijack

    Girl on a Plane

    An exclusive extract of the novelisation inspired by the 1970 Palestinian fighters hijack
    Why Frederick Forsyth's spying days could spell disaster for today's journalists

    Why Frederick Forsyth's spying days could spell disaster for today's journalists

    The author of 'The Day of the Jackal' has revealed he spied for MI6 while a foreign correspondent