Home  Products Web Search Comparison Studies
WEB SEARCH: COMPARISON STUDIES
Relona conducted a detailed study to compare the performance of Google and Yahoo on a random sample of queries from a leading engine's search logs. When analyzing the results from the study, we specifically looked for queries where the difference in performance between Yahoo and Google was significant enough to persuade users to switch engines. Users don’t change their choice of search-engine based on small differences in average relevance - they switch engines when they encounter a query where another engine's results are significantly more accurate than their current engine.
We found that for every query where Yahoo was significantly more accurate than Google, there were nine times as many queries where Google was significantly more accurate than Yahoo. This means that Google has a 9x advantage over Yahoo in persuading users to switch.
Though Google appears to enjoy an insurmountable lead, the comparison study also found that Yahoo can overtake Google in accuracy by implementing Relona's algorithm. When Yahoo is enhanced with Relona’s technology, Yahoo is as accurate as Google.
The study was a three-way comparison of Yahoo, Google and Relona:
• PART-A: Yahoo versus Google,
• PART-B: (Yahoo+Relona) versus Google, and
• PART-C: Yahoo versus (Yahoo+Relona).
Note: "Yahoo+Relona" refers to the performance of Yahoo's search-engine when it is enhanced with Relona's search algorithm.
PART A: YAHOO versus GOOGLE
The study examined 512 random queries and measured how Google compared with Yahoo.
• In 35 queries Google was significantly more relevant than Yahoo.
• Yahoo was significantly more relevant than Google in just 4 queries.
The ratio 35 ÷ 4 is 9 (approximately). This means that Google has a 9x advantage over Yahoo.
PART B: (YAHOO+RELONA) versus GOOGLE
The study examined 512 random queries and measured how Google compared with Yahoo enhanced by Relona’s algorithms.
• In 14 queries Yahoo+Relona (Yahoo enhanced with Relona) was significantly more relevant than Google.
• Google was significantly more relevant than Yahoo+Relona in 12 queries.
When Yahoo is enhanced with Relona's technology, it is more accurate than Google.
PART C: (YAHOO+RELONA) versus YAHOO
The study examined 512 random queries and measured how Yahoo compared with Yahoo enhanced by Relona’s algorithms.
• In 27 queries Yahoo+Relona (Yahoo enhanced with Relona) was significantly more relevant than Yahoo.
• Yahoo was significantly more relevant than Yahoo+Relona in a mere 2 queries.
The results indicate that Relona's intent-analysis technology is a risk-free way to improve Yahoo's results.
OTHER STUDIES
Relona has also conducted a number of other studies comparing MSN-Live, Google, Yahoo and Relona. A study was conducted Dr. Giridhar Kumaran (then an independent consultant, now a research scientist at MS-LiveLabs). Another study was conducted by J. Vesterberg (who was in Google's search quality team) and by Phil Bradley, a well-known search expert. Contact us to request access to these studies.
FURTHER READING
Demonstrations: A partial demo of Relona's technology is available online. Contact us to get the full demo.
FAQ: Answers to common questions about Relona Web Search.
|
WEB SEARCH