'That's how websites work': OkCupid boasts about Facebook-style experiments on users

Co-founder Christian Rudder: “OkCupid doesn’t really know what it’s doing. Neither does any other website. Experiments are how you sort all this out.”

Facebook accidentally sparked a media firestorm when it revealed it had been tweaking users’ News Feeds in psychological experiments, and now it seems dating website OkCupid wants in on the act, announcing in a tongue-in-cheek blog post: “We Experiment on Human Beings!

As you might have guessed from that quotation, the site isn’t shy about its experiments, with co-founder Christian Rudder detailing various schemes including removing all users’ profile pictures for a day and deliberately matching ‘non compatible’ couples just to see what would happen.

“OkCupid doesn’t really know what it’s doing,” writes Rudder. “Neither does any other website. It’s not like people have been building these things for very long, or you can go look up a blueprint or something. Most ideas are bad. Even good ideas could be better. Experiments are how you sort all this out.”

Rudder makes it clear where he stands on the debate over user experimentation, telling readers: “Guess what, everybody: if you use the Internet, you’re the subject of hundreds of experiments at any given time, on every site. That’s how websites work.”

Reactions to Rudder's post have been divided, with some users outraged that OkCupid actively lied to users (especially in deliberately creating ‘bad couples’) while others have pointed out that this sort of experimentation is actually OkCupid’s whole selling point: they actively promise that their algorithms will mine your interests to match you with a perfect partner – it’s the reason their logo is a chemistry beaker.

The first experiment removed users' profile pictures and total number of conversations plummeted as a result.

Rudder details three experiments in the long blog post, the first of which removed users profile pictures as part of a ‘Love is Blind’ holiday. The result was that people responded to messages 44 per cent more often and that contact details were exchanged more quickly. However, when pictures were restored these chats “melted away”.

"The goodness was gone, in fact worse than gone," writes Rudder. "It was like we’d turned on the bright lights at the bar at midnight."

The second experiment looked at how users scored one another for “looks” and “personality”, finding that even if they hadn’t written a single word about themselves in their profile, users “personality” would still be scored roughly the same as if they'd taken the time to list interests and hobbies.

Rudder’s conclusion? “Essentially, the [profile] text is less than 10% of what people think of you. So, your picture is worth that fabled thousand words, but your actual words are worth…almost nothing.”

Rudder gave the example of the 'driftwood lady' who had a 99% score on 'personality' despite having no text in her dating profile.  

In the third and final experiment (which has proved the most controversial - as it involves actively lying to the users) couples were told that they were a good match even when OkCupid’s own algorithms suggested they weren’t.

“By all our internal measures, the “match percentage” we calculate for users is very good at predicting relationships,” writes Rudder. “But in the back of our minds, there’s always been the possibility: maybe it works just because we tell people it does. Maybe people just like each other because they think they’re supposed to?”

In the end they found it was a little bit of both: when users were told they were a good match they acted as if they were, exchanging more messages in chat (OkCupid counts a total of four messages as a “real conversation”) but the best result was to spark conversation was to tell good matches that they were good matches. In other words, writes Rudder, “OkCupid definitely works, but that’s not the whole story.”

A graph showing the results of the third experiment - the percentage is of exchanging four messages.

So what will the users think? OkCupid’s defence that ‘everyone experiments on people online’ is not a justification, especially when the information being tweaked is so personal. But compared to Facebook's research, which was undertaken mainly for the benefit of Facebook, OkCupid’s experiments actually helps users by creating better matches – it's what those who sign up are paying for.

Life and Style
ebookNow available in paperback
ebooks
ebookPart of The Independent’s new eBook series The Great Composers
Latest stories from i100
Have you tried new the Independent Digital Edition apps?
Independent Dating
and  

By clicking 'Search' you
are agreeing to our
Terms of Use.

ES Rentals

    iJobs Job Widget
    iJobs Gadgets & Tech

    Ashdown Group: Head of IT - Hertfordshire - £90,000

    £70000 - £90000 per annum + bonus + car allowance + benefits: Ashdown Group: H...

    Ashdown Group: Application Support Analyst - SQL Server, T-SQL

    £28000 - £32000 per annum + Excellent benefits: Ashdown Group: Application Sup...

    Ashdown Group: Systems Analyst / Data Analyst (SQL Server, T-SQL, data)

    £28000 - £32000 per annum + Excellent benefits: Ashdown Group: Systems Analyst...

    Ashdown Group: European Recruitment Manager - Cheshire - up to £48,000

    £40000 - £48000 per annum + bonus and benefits: Ashdown Group: European Recrui...

    Day In a Page

    Major medical journal Lancet under attack for 'extremist hate propaganda' over its coverage of the Israeli-Palestinian conflict

    Lancet accused of 'anti-Israel hate propaganda' over coverage of Gaza conflict

    Threat to free speech as publishers of renowned medical journal are accused of inciting hatred and violence
    General Election 2015: Tories and Lib Dems throw their star names west to grab votes

    All noisy on the Lib Dems' western front

    The party has deployed its big guns in Cornwall to save its seats there. Simon Usborne heads to the heart of the battle
    How Etsy became a crafty little earner: The online market has been floated for £1.2bn, but can craft and capitalism coexist?

    How Etsy became a crafty little earner

    The online market has been floated for £1.2bn, but can craft and capitalism coexist?
    Guy Ritchie is the latest filmmaker to tackle King Arthur - one of our most versatile heroes

    King Arthur is inspiring Guy Ritchie

    Raluca Radulescu explains why his many permutations - from folk hero to chick-lit hunk - never cease to fascinate
    Apple Watch: Will it live up to expectations for the man or woman on the street?

    Apple Watch: Will it live up to expectations?

    The Apple Watch has apparently sold millions even before its launch tomorrow
    Don't fear the artichoke: it's a good cook's staple, with more choice than you'd think

    Don't fear the artichoke

    Artichokes are scary - they've got spikes and hairy bits, and British cooks tend to give them a wide berth. But they're an essential and delicious part of Italian cuisine
    11 best men's socks

    11 best men's socks

    Make a statement with your accessories, starting from the bottom up
    Paul Scholes column: Eden Hazard would be my Player of the Year – but I wonder if he has that appetite for goals of Messi or Ronaldo

    Paul Scholes column

    Hazard would be my Player of the Year – but I wonder if he has that appetite for goals of Messi or Ronaldo
    Frank Warren: Tyson Fury will be closely watching Wladimir Klitschko... when he wins it'll be time to do a deal

    Frank Warren's Ringside

    Tyson Fury will be closely watching Wladimir Klitschko... when he wins it'll be time to do a deal
    London Marathon 2015: Kenya's brothers in arms Wilson Kipsang and Dennis Kimetto ready to take on world

    Kenya's brothers in arms take on world

    Last year Wilson Kipsang had his marathon record taken off him by training partner and friend Dennis Kimetto. They talk about facing off in the London Marathon
    Natalie Bennett interview: I've lost track of the last time I saw my Dad but it's not because I refuse to fly

    Natalie Bennett interview: I've lost track of the last time I saw my Dad

    Green leader prefers to stay clear of her 'painful' family memories but is more open about 'utterly unreasonable' personal attacks
    Syria conflict: Khorasan return with a fresh influx of fighters awaiting the order to start 'shooting the birds'

    Khorasan is back in Syria

    America said these al-Qaeda militants were bombed out of the country last year - but Kim Sengupta hears a different story
    General Election 2015: Is William Cash the man to woo Warwickshire North for Ukip?

    On the campaign trail with Ukip

    Is William Cash the man to woo Warwickshire North?
    Four rival Robin Hood movies get Hollywood go-head - and Friar Tuck will become a superhero

    Expect a rush on men's tights

    Studios line up four Robin Hoods productions
    Peter Kay's Car Share: BBC show is the comedian's first TV sitcom in a decade

    In the driving seat: Peter Kay

    Car Share is the comedian's first TV sitcom in a decade. The programme's co-creator Paul Coleman reveals the challenges of getting the show on the road