Google hones search edge to stay sharp

The head of Google's search evaluation team shakes his head dismissively at the idea of anyone thinking the firm's winning Internet-sifting formula is completed.

Far from it.

Software engineers reverently refine Google's search algorithm so consistently that it often ends a day a tad different from when it started.

Scott Huffman's team tested "many more than" 6,000 changes to its search engine in 2010, with 500 of them passing the grade to become permanent.

"We have changed engines on a flying plane so many times it has become second nature to us," Google fellow Amit Singhal said, referring to how Internet firms modify services while they are live online.

"Alongside changing the engines, the plane has become quieter, the ride got more comfortable, and we even changed your seat while you were sleeping," he continued. "We just do it in small steps that go unnoticed."

Singhal said Google's search is tweaked, on average, twice in a working day.

"On the one hand, we want to be moving quickly and we want to make great changes," Huffman told AFP. "On the other hand, we don't want people to come to Google and say they don't recognize it."

Google in February took the unusual step of spotlighting an improvement to its secret search formula in the United States.

The move was part of an ongoing duel between the search titan and low-quality websites that feature only content copied from elsewhere on the Internet or use techniques to trick their way high in results.

"The feedback has been tremendously positive from users," Singhal told AFP in an interview at Google's headquarters in Mountain View, California.

"Overwhelmingly, the change raised ranks of high-quality sites and dropped ranks of low-quality sites."

Huffman's team is responsible for insuring that ideas for improving Google search results do just that.

"People are not just expecting a search engine to return every document that has most of the words typed in a query box," Huffman said. "They want the context understood; there are a lot of nuances hidden within that."

For example, someone searching with the word "Japan" is likely interested in real-time news about the tsunami tragedy there as well as other information about the nation.

One of Huffman's favorite "broken queries" from a couple of years ago was the term "Thai restaurant."

General Web searches kept giving top rank to a Thai restaurant in the upstate New York city of Schenectady.

"I used to go complain to the ranking people," Huffman recalled with a laugh. "I'm in Mountain View. It might be a great Thai restaurant, but I'm not going to Schenectady to get Pad Thai. It just isn't going to happen."

Google began letting users set locations so the search engine could factor proximity into results when appropriate.

Proposed changes to Google's formula are first tested on a separate set of computers that imitate real-world search.

Those deemed worthy are next sent to evaluators around the world who act as online searchers and rate the relevance of results in various languages and regions.

Google then does live testing, with promising algorithm enhancements carefully blended into results served up by the main search engine.

"At any given time, some percentage of our users is actually seeing experiments," Huffman said.

"It is interesting because users don't know what is happening," he continued. "Of course, we don't put things out there that are terrible; we have filters to know when something is bad."

Plenty of improvements are ahead, particularly regarding the ability to understand and derive inferences from the world's many languages, according to Huffman.

He bristles at any suggestion by Google critics that results are tampered with to favor advertisers or achieve other business ends.

"If you think of the scale of what we are talking about, it is almost absurd to say we could rig results," Huffman said, noting that Google handles more than a billion searches daily.

For five and a half years he has run weekly meetings at which changes to Google's search algorithm are decided. Revenue implications of changes have never been brought up at those meetings, according to Huffman.

"Not only do we not make decisions that way, we don't even look at those numbers," Huffman said.

Google believes that delivering the most relevant search results to people as fast as possible is best for the California company's bottom line and, by extension, steers away from useless "spam" websites and "content farms."

"If we care about our users - don't care about money - everything else just falls in line," Singhal said. "A healthy Web and happy users are key to our future."

Singhal pictured a day when search engines understand users so well that they predict what people wanted to know and cue them with messages on smartphones.

"That is the ultimate dream," Singhal said. "We are nowhere close to that yet."

Life and Style
ebookNow available in paperback
ebooks
ebookPart of The Independent’s new eBook series The Great Composers
Latest stories from i100
Have you tried new the Independent Digital Edition apps?
Independent Dating
and  

By clicking 'Search' you
are agreeing to our
Terms of Use.

ES Rentals

    iJobs Job Widget
    iJobs Gadgets & Tech

    Ashdown Group: Head of IT - Hertfordshire - £90,000

    £70000 - £90000 per annum + bonus + car allowance + benefits: Ashdown Group: H...

    Ashdown Group: Application Support Analyst - SQL Server, T-SQL

    £28000 - £32000 per annum + Excellent benefits: Ashdown Group: Application Sup...

    Ashdown Group: Systems Analyst / Data Analyst (SQL Server, T-SQL, data)

    £28000 - £32000 per annum + Excellent benefits: Ashdown Group: Systems Analyst...

    Ashdown Group: European Recruitment Manager - Cheshire - up to £48,000

    £40000 - £48000 per annum + bonus and benefits: Ashdown Group: European Recrui...

    Day In a Page

    General Election 2015: Chuka Umunna on the benefits of immigration, humility – and his leader Ed Miliband

    Chuka Umunna: A virus of racism runs through Ukip

    The shadow business secretary on the benefits of immigration, humility – and his leader Ed Miliband
    Yemen crisis: This exotic war will soon become Europe's problem

    Yemen's exotic war will soon affect Europe

    Terrorism and boatloads of desperate migrants will be the outcome of the Saudi air campaign, says Patrick Cockburn
    Marginal Streets project aims to document voters in the run-up to the General Election

    Marginal Streets project documents voters

    Independent photographers Joseph Fox and Orlando Gili are uploading two portraits of constituents to their website for each day of the campaign
    Game of Thrones: Visit the real-life kingdom of Westeros to see where violent history ends and telly tourism begins

    The real-life kingdom of Westeros

    Is there something a little uncomfortable about Game of Thrones shooting in Northern Ireland?
    How to survive a social-media mauling, by the tough women of Twitter

    How to survive a Twitter mauling

    Mary Beard, Caroline Criado-Perez, Louise Mensch, Bunny La Roche and Courtney Barrasford reveal how to trounce the trolls
    Gallipoli centenary: At dawn, the young remember the young who perished in one of the First World War's bloodiest battles

    At dawn, the young remember the young

    A century ago, soldiers of the Empire – many no more than boys – spilt on to Gallipoli’s beaches. On this 100th Anzac Day, there are personal, poetic tributes to their sacrifice
    Dissent is slowly building against the billions spent on presidential campaigns – even among politicians themselves

    Follow the money as never before

    Dissent is slowly building against the billions spent on presidential campaigns – even among politicians themselves, reports Rupert Cornwell
    Samuel West interview: The actor and director on austerity, unionisation, and not mentioning his famous parents

    Samuel West interview

    The actor and director on austerity, unionisation, and not mentioning his famous parents
    General Election 2015: Imagine if the leading political parties were fashion labels

    Imagine if the leading political parties were fashion labels

    Fashion editor, Alexander Fury, on what the leaders' appearances tell us about them
    Phumzile Mlambo-Ngcuka: Home can be the unsafest place for women

    Phumzile Mlambo-Ngcuka: Home can be the unsafest place for women

    The architect of the HeForShe movement and head of UN Women on the world's failure to combat domestic violence
    Public relations as 'art'? Surely not

    Confessions of a former PR man

    The 'art' of public relations is being celebrated by the V&A museum, triggering some happy memories for DJ Taylor
    Bill Granger recipes: Our chef succumbs to his sugar cravings with super-luxurious sweet treats

    Bill Granger's luxurious sweet treats

    Our chef loves to stop for 30 minutes to catch up on the day's gossip, while nibbling on something sweet
    London Marathon 2015: Paula Radcliffe and the mother of all goodbyes

    The mother of all goodbyes

    Paula Radcliffe's farewell to the London Marathon will be a family affair
    Everton vs Manchester United: Steven Naismith demands 'better' if Toffees are to upset the odds against United

    Steven Naismith: 'We know we must do better'

    The Everton forward explains the reasons behind club's decline this season
    Arsenal vs Chelsea: Praise to Arsene Wenger for having the courage of his convictions

    Michael Calvin's Last Word

    Praise to Wenger for having the courage of his convictions