'That's how websites work': OkCupid boasts about Facebook-style experiments on users

Co-founder Christian Rudder: “OkCupid doesn’t really know what it’s doing. Neither does any other website. Experiments are how you sort all this out.”

Facebook accidentally sparked a media firestorm when it revealed it had been tweaking users’ News Feeds in psychological experiments, and now it seems dating website OkCupid wants in on the act, announcing in a tongue-in-cheek blog post: “We Experiment on Human Beings!

As you might have guessed from that quotation, the site isn’t shy about its experiments, with co-founder Christian Rudder detailing various schemes including removing all users’ profile pictures for a day and deliberately matching ‘non compatible’ couples just to see what would happen.

“OkCupid doesn’t really know what it’s doing,” writes Rudder. “Neither does any other website. It’s not like people have been building these things for very long, or you can go look up a blueprint or something. Most ideas are bad. Even good ideas could be better. Experiments are how you sort all this out.”

Rudder makes it clear where he stands on the debate over user experimentation, telling readers: “Guess what, everybody: if you use the Internet, you’re the subject of hundreds of experiments at any given time, on every site. That’s how websites work.”

Reactions to Rudder's post have been divided, with some users outraged that OkCupid actively lied to users (especially in deliberately creating ‘bad couples’) while others have pointed out that this sort of experimentation is actually OkCupid’s whole selling point: they actively promise that their algorithms will mine your interests to match you with a perfect partner – it’s the reason their logo is a chemistry beaker.

The first experiment removed users' profile pictures and total number of conversations plummeted as a result.

Rudder details three experiments in the long blog post, the first of which removed users profile pictures as part of a ‘Love is Blind’ holiday. The result was that people responded to messages 44 per cent more often and that contact details were exchanged more quickly. However, when pictures were restored these chats “melted away”.

"The goodness was gone, in fact worse than gone," writes Rudder. "It was like we’d turned on the bright lights at the bar at midnight."

The second experiment looked at how users scored one another for “looks” and “personality”, finding that even if they hadn’t written a single word about themselves in their profile, users “personality” would still be scored roughly the same as if they'd taken the time to list interests and hobbies.

Rudder’s conclusion? “Essentially, the [profile] text is less than 10% of what people think of you. So, your picture is worth that fabled thousand words, but your actual words are worth…almost nothing.”

Rudder gave the example of the 'driftwood lady' who had a 99% score on 'personality' despite having no text in her dating profile.  

In the third and final experiment (which has proved the most controversial - as it involves actively lying to the users) couples were told that they were a good match even when OkCupid’s own algorithms suggested they weren’t.

“By all our internal measures, the “match percentage” we calculate for users is very good at predicting relationships,” writes Rudder. “But in the back of our minds, there’s always been the possibility: maybe it works just because we tell people it does. Maybe people just like each other because they think they’re supposed to?”

In the end they found it was a little bit of both: when users were told they were a good match they acted as if they were, exchanging more messages in chat (OkCupid counts a total of four messages as a “real conversation”) but the best result was to spark conversation was to tell good matches that they were good matches. In other words, writes Rudder, “OkCupid definitely works, but that’s not the whole story.”

A graph showing the results of the third experiment - the percentage is of exchanging four messages.

So what will the users think? OkCupid’s defence that ‘everyone experiments on people online’ is not a justification, especially when the information being tweaked is so personal. But compared to Facebook's research, which was undertaken mainly for the benefit of Facebook, OkCupid’s experiments actually helps users by creating better matches – it's what those who sign up are paying for.

Arts and Entertainment
Joe Cocker performing on the Stravinski hall stage during the Montreux Jazz Festival, in Montreux, Switzerland in 2002
musicHe 'turned my song into an anthem', says former Beatle
News
Clarke Carlisle
sport
Sport
footballStoke City vs Chelsea match report
Arts and Entertainment
theatreThe US stars who've taken to UK panto, from Hasselhoff to Hall
PROMOTED VIDEO
Life and Style
ebookNow available in paperback
Life and Style
ebooksA superb mix of recipes serving up the freshest of local produce in a delicious range of styles
Life and Style
Approaching sale shopping in a smart way means that you’ll get the most out of your money
life + styleSales shopping tips and tricks from the experts
News
newsIt was due to be auctioned off for charity
News
Coca-Cola has become one of the largest companies in the world to push staff towards switching off their voicemails, in a move intended to streamline operations and boost productivity
peopleCoca-Cola staff urged to switch it off to boost productivity
Environment
Sir David Attenborough
environment... as well as a plant and a spider
Voices
'That's the legal bit done. Now on to the ceremony!'
voicesThe fight for marriage equality isn't over yet, says Siobhan Fenton
Latest stories from i100
Have you tried new the Independent Digital Edition apps?
Independent Dating
and  

By clicking 'Search' you
are agreeing to our
Terms of Use.

ES Rentals

    iJobs Job Widget
    iJobs Gadgets & Tech

    Ashdown Group: IT Support Technician - 12 Month Fixed Term - Shrewsbury

    £17000 - £20000 per annum: Ashdown Group: IT Helpdesk Support Technician - 12 ...

    Recruitment Genius: Technical Support Analyst / Helpdesk Support Analyst

    £16000 - £19000 per annum: Recruitment Genius: Our client is the UK's leading ...

    SThree: TRAINEE RECRUITMENT CONSULTANT - IT - LONDON

    £20000 - £30000 per annum + OTE £50k: SThree: SThree are a global FTSE 250 bus...

    SThree: Trainee Recruitment Consultant - LONDON

    £20000 - £25000 per annum + OTE £40,000 + Car + Pension: SThree: SThree are a ...

    Day In a Page

    Isis in Iraq: Yazidi girls killing themselves to escape rape and imprisonment by militants

    'Jilan killed herself in the bathroom. She cut her wrists and hanged herself'

    Yazidi girls killing themselves to escape rape and imprisonment
    Ed Balls interview: 'If I think about the deficit when I'm playing the piano, it all goes wrong'

    Ed Balls interview

    'If I think about the deficit when I'm playing the piano, it all goes wrong'
    He's behind you, dude!

    US stars in UK panto

    From David Hasselhoff to Jerry Hall
    Grace Dent's Christmas Quiz: What are you – a festive curmudgeon or top of the tree?

    Grace Dent's Christmas Quiz

    What are you – a festive curmudgeon or top of the tree?
    Nasa planning to build cloud cities in airships above Venus

    Nasa planning to build cloud cities in airships above Venus

    Planet’s surface is inhospitable to humans but 30 miles above it is almost perfect
    Surrounded by high-rise flats is a little house filled with Lebanon’s history - clocks, rifles, frogmen’s uniforms and colonial helmets

    Clocks, rifles, swords, frogmen’s uniforms

    Surrounded by high-rise flats is a little house filled with Lebanon’s history
    Return to Gaza: Four months on, the wounds left by Israel's bombardment have not yet healed

    Four months after the bombardment, Gaza’s wounds are yet to heal

    Kim Sengupta is reunited with a man whose plight mirrors the suffering of the Palestinian people
    Gastric surgery: Is it really the answer to the UK's obesity epidemic?

    Is gastric surgery really the answer to the UK's obesity epidemic?

    Critics argue that it’s crazy to operate on healthy people just to stop them eating
    Homeless Veterans appeal: Christmas charity auction Part 2 - now LIVE

    Homeless Veterans appeal: Christmas charity auction

    Bid on original art, or trips of a lifetime to Africa or the 'Corrie' set, and help Homeless Veterans
    Pantomime rings the changes to welcome autistic theatre-goers

    Autism-friendly theatre

    Pantomime leads the pack in quest to welcome all
    The week Hollywood got scared and had to grow up a bit

    The week Hollywood got scared and had to grow up a bit

    Sony suffered a chorus of disapproval after it withdrew 'The Interview', but it's not too late for it to take a stand, says Joan Smith
    From Widow Twankey to Mother Goose, how do the men who play panto dames get themselves ready for the performance of a lifetime?

    Panto dames: before and after

    From Widow Twankey to Mother Goose, how do the men who play panto dames get themselves ready for the performance of a lifetime?
    Thirties murder mystery novel is surprise runaway Christmas hit

    Thirties murder mystery novel is surprise runaway Christmas hit

    Booksellers say readers are turning away from dark modern thrillers and back to the golden age of crime writing
    Anne-Marie Huby: 'Charities deserve the best,' says founder of JustGiving

    Anne-Marie Huby: 'Charities deserve the best'

    Ten million of us have used the JustGiving website to donate to good causes. Its co-founder says that being dynamic is as important as being kind
    The botanist who hunts for giant trees at Kew Gardens

    The man who hunts giants

    A Kew Gardens botanist has found 25 new large tree species - and he's sure there are more out there