'That's how websites work': OkCupid boasts about Facebook-style experiments on users

Co-founder Christian Rudder: “OkCupid doesn’t really know what it’s doing. Neither does any other website. Experiments are how you sort all this out.”

Facebook accidentally sparked a media firestorm when it revealed it had been tweaking users’ News Feeds in psychological experiments, and now it seems dating website OkCupid wants in on the act, announcing in a tongue-in-cheek blog post: “We Experiment on Human Beings!

As you might have guessed from that quotation, the site isn’t shy about its experiments, with co-founder Christian Rudder detailing various schemes including removing all users’ profile pictures for a day and deliberately matching ‘non compatible’ couples just to see what would happen.

“OkCupid doesn’t really know what it’s doing,” writes Rudder. “Neither does any other website. It’s not like people have been building these things for very long, or you can go look up a blueprint or something. Most ideas are bad. Even good ideas could be better. Experiments are how you sort all this out.”

Rudder makes it clear where he stands on the debate over user experimentation, telling readers: “Guess what, everybody: if you use the Internet, you’re the subject of hundreds of experiments at any given time, on every site. That’s how websites work.”

Reactions to Rudder's post have been divided, with some users outraged that OkCupid actively lied to users (especially in deliberately creating ‘bad couples’) while others have pointed out that this sort of experimentation is actually OkCupid’s whole selling point: they actively promise that their algorithms will mine your interests to match you with a perfect partner – it’s the reason their logo is a chemistry beaker.

The first experiment removed users' profile pictures and total number of conversations plummeted as a result.

Rudder details three experiments in the long blog post, the first of which removed users profile pictures as part of a ‘Love is Blind’ holiday. The result was that people responded to messages 44 per cent more often and that contact details were exchanged more quickly. However, when pictures were restored these chats “melted away”.

"The goodness was gone, in fact worse than gone," writes Rudder. "It was like we’d turned on the bright lights at the bar at midnight."

The second experiment looked at how users scored one another for “looks” and “personality”, finding that even if they hadn’t written a single word about themselves in their profile, users “personality” would still be scored roughly the same as if they'd taken the time to list interests and hobbies.

Rudder’s conclusion? “Essentially, the [profile] text is less than 10% of what people think of you. So, your picture is worth that fabled thousand words, but your actual words are worth…almost nothing.”

Rudder gave the example of the 'driftwood lady' who had a 99% score on 'personality' despite having no text in her dating profile.  

In the third and final experiment (which has proved the most controversial - as it involves actively lying to the users) couples were told that they were a good match even when OkCupid’s own algorithms suggested they weren’t.

“By all our internal measures, the “match percentage” we calculate for users is very good at predicting relationships,” writes Rudder. “But in the back of our minds, there’s always been the possibility: maybe it works just because we tell people it does. Maybe people just like each other because they think they’re supposed to?”

In the end they found it was a little bit of both: when users were told they were a good match they acted as if they were, exchanging more messages in chat (OkCupid counts a total of four messages as a “real conversation”) but the best result was to spark conversation was to tell good matches that they were good matches. In other words, writes Rudder, “OkCupid definitely works, but that’s not the whole story.”

A graph showing the results of the third experiment - the percentage is of exchanging four messages.

So what will the users think? OkCupid’s defence that ‘everyone experiments on people online’ is not a justification, especially when the information being tweaked is so personal. But compared to Facebook's research, which was undertaken mainly for the benefit of Facebook, OkCupid’s experiments actually helps users by creating better matches – it's what those who sign up are paying for.

PROMOTED VIDEO
Life and Style
ebookNow available in paperback
ebooks
ebookPart of The Independent’s new eBook series The Great Composers
News
Top Gun actor Val Kilmer lost his small claims court battle in Van Nuys with the landlord of his Malibu mansion to get back his deposit after wallpapering over the kitchen cabinets
people
News
Comedian Ted Robbins collapsed on stage during a performance of Phoenix Nights Live at Manchester Arena (Rex)
people
News
The actress Geraldine McEwan was perhaps best known for playing Agatha Christie's detective, Miss Marple (Rex)
peopleShe won a Bafta in 1991 for her role in Oranges Are Not The Only Fruit
News
newsPatrick Cockburn was able to update his agenda-setting 'The Rise of Islamic State' while under attack in Baghdad
News
Robert Fraser, aka Groovy Bob
peopleA new show honours Robert Fraser, one of the era's forgotten players
Life and Style
Torsten Sherwood's Noook is a simple construction toy for creating mini-architecture
tech
Sport
David Silva celebrates with Sergio Aguero after equalising against Chelsea
footballChelsea 1 Manchester City 1
Latest stories from i100
Have you tried new the Independent Digital Edition apps?
Independent Dating
and  

By clicking 'Search' you
are agreeing to our
Terms of Use.

ES Rentals

    iJobs Job Widget
    iJobs Gadgets & Tech

    Recruitment Genius: Web Design Apprentice

    £6240 per annum: Recruitment Genius: This company is a well established websit...

    Recruitment Genius: Senior .Net Application Developer

    £40000 - £60000 per annum: Recruitment Genius: This is a fantastic opportunity...

    Recruitment Genius: .Net / SQL Developer

    £25000 - £35000 per annum: Recruitment Genius: A skilled .NET developer with e...

    Recruitment Genius: IT Technical Support Engineer - PC/Mac

    £25000 - £30000 per annum: Recruitment Genius: This IT support company are cur...

    Day In a Page

    As in 1942, Germany must show restraint over Greece

    As in 1942, Germany must show restraint over Greece

    Mussolini tried to warn his ally of the danger of bringing the country to its knees. So should we, says Patrick Cockburn
    Britain's widening poverty gap should be causing outrage at the start of the election campaign

    The short stroll that should be our walk of shame

    Courting the global elite has failed to benefit Britain, as the vast disparity in wealth on display in the capital shows
    Homeless Veterans appeal: The rise of the working poor: when having a job cannot prevent poverty

    Homeless Veterans appeal

    The rise of the working poor: when having a job cannot prevent poverty
    Prince Charles the saviour of the nation? A new book highlights concerns about how political he will be when he eventually becomes king

    Prince Charles the saviour of the nation?

    A new book highlights concerns about how political he will be when he eventually becomes king
    How books can defeat Isis: Patrick Cockburn was able to update his agenda-setting 'The Rise of Islamic State' while under attack in Baghdad

    How books can defeat Isis

    Patrick Cockburn was able to update his agenda-setting 'The Rise of Islamic State' while under attack in Baghdad
    Judith Hackitt: The myths of elf 'n' safety

    Judith Hackitt: The myths of elf 'n' safety

    She may be in charge of minimising our risks of injury, but the chair of the Health and Safety Executive still wants children to be able to hurt themselves
    The open loathing between Barack Obama and Benjamin Netanyahu just got worse

    The open loathing between Obama and Netanyahu just got worse

    The Israeli PM's relationship with the Obama has always been chilly, but going over the President's head on Iran will do him no favours, says Rupert Cornwell
    French chefs get 'le huff' as nation slips down global cuisine rankings

    French chefs get 'le huff' as nation slips down global cuisine rankings

    Fury at British best restaurants survey sees French magazine produce a rival list
    Star choreographer Matthew Bourne gives young carers a chance to perform at Sadler's Wells

    Young carers to make dance debut

    What happened when superstar choreographer Matthew Bourne encouraged 27 teenage carers to think about themselves for once?
    Design Council's 70th anniversary: Four of the most intriguing prototypes from Ones to Watch

    Design Council's 70th anniversary

    Four of the most intriguing prototypes from Ones to Watch
    Dame Harriet Walter: The actress on learning what it is to age, plastic surgery, and her unease at being honoured by the establishment

    Dame Harriet Walter interview

    The actress on learning what it is to age, plastic surgery, and her unease at being honoured by the establishment
    Art should not be a slave to the ideas driving it

    Art should not be a slave to the ideas driving it

    Critics of Tom Stoppard's new play seem to agree that cerebral can never trump character, says DJ Taylor
    Bill Granger recipes: Our chef's winter salads will make you feel energised through February

    Bill Granger's winter salads

    Salads aren't just a bit on the side, says our chef - their crunch, colour and natural goodness are perfect for a midwinter pick-me-up
    England vs Wales: Cool head George Ford ready to put out dragon fire

    George Ford: Cool head ready to put out dragon fire

    No 10’s calmness under pressure will be key for England in Cardiff
    Michael Calvin: Time for Old Firm to put aside bigotry and forge new links

    Michael Calvin's Last Word

    Time for Old Firm to put aside bigotry and forge new links