'That's how websites work': OkCupid boasts about Facebook-style experiments on users

Co-founder Christian Rudder: “OkCupid doesn’t really know what it’s doing. Neither does any other website. Experiments are how you sort all this out.”

Facebook accidentally sparked a media firestorm when it revealed it had been tweaking users’ News Feeds in psychological experiments, and now it seems dating website OkCupid wants in on the act, announcing in a tongue-in-cheek blog post: “We Experiment on Human Beings!

As you might have guessed from that quotation, the site isn’t shy about its experiments, with co-founder Christian Rudder detailing various schemes including removing all users’ profile pictures for a day and deliberately matching ‘non compatible’ couples just to see what would happen.

“OkCupid doesn’t really know what it’s doing,” writes Rudder. “Neither does any other website. It’s not like people have been building these things for very long, or you can go look up a blueprint or something. Most ideas are bad. Even good ideas could be better. Experiments are how you sort all this out.”

Rudder makes it clear where he stands on the debate over user experimentation, telling readers: “Guess what, everybody: if you use the Internet, you’re the subject of hundreds of experiments at any given time, on every site. That’s how websites work.”

Reactions to Rudder's post have been divided, with some users outraged that OkCupid actively lied to users (especially in deliberately creating ‘bad couples’) while others have pointed out that this sort of experimentation is actually OkCupid’s whole selling point: they actively promise that their algorithms will mine your interests to match you with a perfect partner – it’s the reason their logo is a chemistry beaker.

The first experiment removed users' profile pictures and total number of conversations plummeted as a result.

Rudder details three experiments in the long blog post, the first of which removed users profile pictures as part of a ‘Love is Blind’ holiday. The result was that people responded to messages 44 per cent more often and that contact details were exchanged more quickly. However, when pictures were restored these chats “melted away”.

"The goodness was gone, in fact worse than gone," writes Rudder. "It was like we’d turned on the bright lights at the bar at midnight."

The second experiment looked at how users scored one another for “looks” and “personality”, finding that even if they hadn’t written a single word about themselves in their profile, users “personality” would still be scored roughly the same as if they'd taken the time to list interests and hobbies.

Rudder’s conclusion? “Essentially, the [profile] text is less than 10% of what people think of you. So, your picture is worth that fabled thousand words, but your actual words are worth…almost nothing.”

Rudder gave the example of the 'driftwood lady' who had a 99% score on 'personality' despite having no text in her dating profile.  

In the third and final experiment (which has proved the most controversial - as it involves actively lying to the users) couples were told that they were a good match even when OkCupid’s own algorithms suggested they weren’t.

“By all our internal measures, the “match percentage” we calculate for users is very good at predicting relationships,” writes Rudder. “But in the back of our minds, there’s always been the possibility: maybe it works just because we tell people it does. Maybe people just like each other because they think they’re supposed to?”

In the end they found it was a little bit of both: when users were told they were a good match they acted as if they were, exchanging more messages in chat (OkCupid counts a total of four messages as a “real conversation”) but the best result was to spark conversation was to tell good matches that they were good matches. In other words, writes Rudder, “OkCupid definitely works, but that’s not the whole story.”

A graph showing the results of the third experiment - the percentage is of exchanging four messages.

So what will the users think? OkCupid’s defence that ‘everyone experiments on people online’ is not a justification, especially when the information being tweaked is so personal. But compared to Facebook's research, which was undertaken mainly for the benefit of Facebook, OkCupid’s experiments actually helps users by creating better matches – it's what those who sign up are paying for.

News
peoplePaper attempts to defend itself
Voices
voicesWe desperately need men to be feminists too
Life and Style
food + drink
Arts and Entertainment
British actor Idris Elba is also a DJ and rapper who played Ibiza last summer
film
PROMOTED VIDEO
Life and Style
ebooksA superb mix of recipes serving up the freshest of local produce in a delicious range of styles
Life and Style
ebooksFrom the lifespan of a slug to the distance to the Sun: answers to 500 questions from readers
Latest stories from i100
Have you tried new the Independent Digital Edition apps?
Independent Dating
and  

By clicking 'Search' you
are agreeing to our
Terms of Use.

ES Rentals

    iJobs Job Widget
    iJobs Gadgets & Tech

    IT Systems Manager

    £40000 - £45000 per annum + pension, healthcare,25 days: Ashdown Group: An est...

    Data Analyst / Marketing Database Analyst

    £24000 per annum: Ashdown Group: An established and growing IT Consultancy fir...

    Trainee Helpdesk Analyst / 1st Line Application Support Analyst

    £18000 per annum: Ashdown Group: An established and growing IT Consultancy fir...

    Project Manager (retail, upgrades, rollouts)

    £40000 - £45000 Per Annum + benefits: Clearwater People Solutions Ltd: Project...

    Day In a Page

    Syria air strikes: ‘Peace President’ Obama had to take stronger action against Isis after beheadings

    Robert Fisk on Syria air strikes

    ‘Peace President’ Obama had to take stronger action against Isis after beheadings
    Will Lindsay Lohan's West End debut be a turnaround moment for her career?

    Lindsay Lohan's West End debut

    Will this be a turnaround moment for her career?
    'The Crocodile Under the Bed': Judith Kerr's follow-up to 'The Tiger Who Came to Tea'

    The follow-up to 'The Tiger Who Came to Tea'

    Judith Kerr on what inspired her latest animal intruder - 'The Crocodile Under the Bed' - which has taken 46 years to get into print
    BBC Television Centre: A nostalgic wander through the sets, studios and ghosts of programmes past

    BBC Television Centre

    A nostalgic wander through the sets, studios and ghosts of programmes past
    Secret politics of the weekly shop

    The politics of the weekly shop

    New app reveals political leanings of food companies
    Beam me up, Scottie!

    Beam me up, Scottie!

    Celebrity Trekkies from Alex Salmond to Barack Obama
    Beware Wet Paint: The ICA's latest ambitious exhibition

    Beware Wet Paint

    The ICA's latest ambitious exhibition
    Pink Floyd have produced some of rock's greatest ever album covers

    Pink Floyd have produced some of rock's greatest ever album covers

    Can 'The Endless River' carry on the tradition?
    Sanctuary for the suicidal

    Sanctuary for the suicidal

    One mother's story of how London charity Maytree helped her son with his depression
    A roller-coaster tale from the 'voice of a generation'

    Not That Kind of Girl:

    A roller-coaster tale from 'voice of a generation' Lena Dunham
    London is not bedlam or a cradle of vice. In fact it, as much as anywhere, deserves independence

    London is not bedlam or a cradle of vice

    In fact it, as much as anywhere, deserves independence
    Vivienne Westwood 'didn’t want' relationship with Malcolm McLaren

    Vivienne Westwood 'didn’t want' relationship with McLaren

    Designer 'felt pressured' into going out with Sex Pistols manager
    Jourdan Dunn: Model mother

    Model mother

    Jordan Dunn became one of the best-paid models in the world
    Apple still coolest brand – despite U2 PR disaster

    Apple still the coolest brand

    Despite PR disaster of free U2 album
    Scottish referendum: The Yes vote was the love that dared speak its name, but it was not to be

    Despite the result, this is the end of the status quo

    Boyd Tonkin on the fall-out from the Scottish referendum