February 10, 2018
In a new test shared today by Loup Ventures, Apple's HomePod was put through its paces in categories including Siri, sound quality, and ease of use. For Siri, Loup Ventures' Gene Munster reported that while the AI assistant understood 99.4 percent of queries asked of it, it answered only 52.3 percent of them correctly. Loup Ventures tested three separate HomePods and asked 782 queries total.
Compared to previous tests of rival speakers, HomePod is "at the bottom of the totem pole" in the AI assistant performance category. Google Home answered 81 percent correctly, Amazon's Alexa answered 64 percent correctly, and Microsoft's Cortana answered 57 percent correctly.
Siri on HomePod Correctly Answered 52.3% of Queries in New AI Test
Munster broke this information down further, stating that Siri is good for "local" and "commerce" queries, like asking about nearby coffee shops or assisting in buying new shoes. In this area, Siri beats Alexa and Cortana but still falls behind Google Assistant on Google Home.
Despite the low percentage of correctly answering the 782 total queries asked of it, Munster said Siri's overall performance rose above expectations "given the limited scope of HomePod's music focus."
Siri on HomePod Correctly Answered 52.3% of Queries in New AI Test
The researchers explained that over time HomePod and Siri should grow to match, or surpass, rival assistants by simply adding query domains like calendar, email, calling, and navigation.
  • Some domains like navigation, calendar, email, and calling are simply not supported. These questions were met with, “I can’t ___ on HomePod.” Also, in any case that iPhone-based Siri would bring up Google search results, HomePod would reply, “I can’t get the answer to that on HomePod,” which forces you to use your phone or give up on the question altogether. Removing navigation, calling, email, and calendar-related queries from our question set yields a 67% correct response, a jump from overall of 52.3% correct.
  • This means added support for these domains would bring HomePod performance above that of Alexa (64%) and Cortana (57%), though still shy of Google Home (81%). We know Siri has the ability to correctly answer a whole range of queries that HomePod cannot, evidenced by our note here. Apple’s limiting of HomePod’s domains should change over time, at which point we expect the speaker to be vastly more useful and integrated with your other Apple devices.
As discovered in the research, where HomePod excelled was its "superior" listening skills. The HomePod allows users to speak at a normal volume, even when music from the speaker is particularly loud, and Siri will pick up on the voice and hear the user. "This was HomePod's most stellar feature," according to Munster.
Loup Ventures also favored HomePod's sound quality, saying that "it sounds incredible." Like other reviews and impressions of the device, Munster's enjoyment of the HomePod's audio quality was countered with the speaker's lackluster Siri performance, which he thinks will be changing fairly soon.
  • Don’t be fooled by HomePod’s sound quality-focused first step into smart speakers; Apple has a grander vision than delivering a better sounding Echo. While not present in the first version of HomePod (i.e. you can’t even make a phone call with HomePod), we believe Apple’s goal is to make Siri a ubiquitous, ambient presence that connects and controls all your connected devices and services – and to make a leap forward in the transition to voice-first computing.
Visit Loup Ventures to read more of the information gathered from the HomePod "smart speaker gauntlet," including the publication's prediction for demand and market share of HomePod through the rest of 2018.
Top news around the world
Coronavirus Disease

Coronavirus disease (COVID-19) is an infectious disease caused by a newly discovered coronavirus.

Most people infected with the COVID-19 virus will experience mild to moderate respiratory illness and recover without requiring special treatment. Older people, and those with underlying medical problems like cardiovascular disease, diabetes, chronic respiratory disease, and cancer are more likely to develop serious illness.

Around the World

Celebrity News

> Latest News in Media

Watch It
Mario Lopez, Tiffani Thiessen react to Dustin Diamond’s cancer diagnosis | Page Six Celebrity News
January 15, 2021
x4Hz209X0eg
Why 'Bling Empire' stars were skeptical to join the Netflix reality series | Page Six Celebrity News
January 15, 2021
3oHt4Cqr1J0
Bella Thorne defends Armie Hammer against allegations | Page Six Celebrity News
January 15, 2021
W0-pu9wJVkE
Meet Queen Elizabeth II's Hunky Grandnephew Arthur Chatto
January 16, 2021
Rrd3p6_aAkQ
Archie Lyndhurst's Cause of Death at Age 19 Revealed
January 16, 2021
mf_pqB3oQYc
Prince Harry Is "Heartbroken" Over Royal Family Estrangement
January 16, 2021
sDhziu0ihGA
Andrew Zimmern Says Prisoners Need Better Food, Even Capitol Rioters | TMZ
January 16, 2021
sbz0nx1qST0
L.A. County Supervisor Enraged Clinics Throw Unused Vaccines in the Trash | TMZ
January 14, 2021
Upzfh-nEbq0
Drake Returns To Working Out, Looks Great! | TMZ TV
January 14, 2021
JlKeaD2mjoA
Kevin Feige on 'WandaVision' And The Future of The Marvel Cinematic Universe on Disney Plus
January 17, 2021
9AzttR4LaWg
'Promising Young Woman' Ending Analyzed By Carey Mulligan And Emerald Fennell
January 17, 2021
Rhj2RmWVup4
Golden Globes 2021: Best Drama Series
January 13, 2021
TrTjbEY6VQU
TV Schedule
Late Night Show
Watch the latest shows of U.S. top comedians

Sports

Latest sport results, news, videos, interviews and comments
Find us on Instagram
at @feedimo to stay up to date with the latest.
Featured Video You Might Like
zWJ3MxW_HWA L1eLanNeZKg i1XRgbyUtOo -g9Qziqbif8 0vmRhiLHE2U JFCZUoa6MYE UfN5PCF5EUo 2PV55f3-UAg W3y9zuI_F64 -7qCxIccihU pQ9gcOoH9R8 g5MRDEXRk4k
Copyright © 2020 Feedimo. All Rights Reserved.