February 10, 2018
In a new test shared today by Loup Ventures, Apple's HomePod was put through its paces in categories including Siri, sound quality, and ease of use. For Siri, Loup Ventures' Gene Munster reported that while the AI assistant understood 99.4 percent of queries asked of it, it answered only 52.3 percent of them correctly. Loup Ventures tested three separate HomePods and asked 782 queries total.
Compared to previous tests of rival speakers, HomePod is "at the bottom of the totem pole" in the AI assistant performance category. Google Home answered 81 percent correctly, Amazon's Alexa answered 64 percent correctly, and Microsoft's Cortana answered 57 percent correctly.
Siri on HomePod Correctly Answered 52.3% of Queries in New AI Test
Munster broke this information down further, stating that Siri is good for "local" and "commerce" queries, like asking about nearby coffee shops or assisting in buying new shoes. In this area, Siri beats Alexa and Cortana but still falls behind Google Assistant on Google Home.
Despite the low percentage of correctly answering the 782 total queries asked of it, Munster said Siri's overall performance rose above expectations "given the limited scope of HomePod's music focus."
Siri on HomePod Correctly Answered 52.3% of Queries in New AI Test
The researchers explained that over time HomePod and Siri should grow to match, or surpass, rival assistants by simply adding query domains like calendar, email, calling, and navigation.
  • Some domains like navigation, calendar, email, and calling are simply not supported. These questions were met with, “I can’t ___ on HomePod.” Also, in any case that iPhone-based Siri would bring up Google search results, HomePod would reply, “I can’t get the answer to that on HomePod,” which forces you to use your phone or give up on the question altogether. Removing navigation, calling, email, and calendar-related queries from our question set yields a 67% correct response, a jump from overall of 52.3% correct.
  • This means added support for these domains would bring HomePod performance above that of Alexa (64%) and Cortana (57%), though still shy of Google Home (81%). We know Siri has the ability to correctly answer a whole range of queries that HomePod cannot, evidenced by our note here. Apple’s limiting of HomePod’s domains should change over time, at which point we expect the speaker to be vastly more useful and integrated with your other Apple devices.
As discovered in the research, where HomePod excelled was its "superior" listening skills. The HomePod allows users to speak at a normal volume, even when music from the speaker is particularly loud, and Siri will pick up on the voice and hear the user. "This was HomePod's most stellar feature," according to Munster.
Loup Ventures also favored HomePod's sound quality, saying that "it sounds incredible." Like other reviews and impressions of the device, Munster's enjoyment of the HomePod's audio quality was countered with the speaker's lackluster Siri performance, which he thinks will be changing fairly soon.
  • Don’t be fooled by HomePod’s sound quality-focused first step into smart speakers; Apple has a grander vision than delivering a better sounding Echo. While not present in the first version of HomePod (i.e. you can’t even make a phone call with HomePod), we believe Apple’s goal is to make Siri a ubiquitous, ambient presence that connects and controls all your connected devices and services – and to make a leap forward in the transition to voice-first computing.
Visit Loup Ventures to read more of the information gathered from the HomePod "smart speaker gauntlet," including the publication's prediction for demand and market share of HomePod through the rest of 2018.
Latest News
Top news around the world
Academy Awards

‘Oppenheimer’ Reigns at Oscars With Seven Wins, Including Best Picture and Director

Get the latest news about the 2024 Oscars, including nominations, winners, predictions and red carpet fashion at 96th Academy Awards

Around the World

Celebrity News

> Latest News in Media

Watch It
Ruby Franke’s Husband REVEALS Alleged Rules He Had to Follow at Home | E! News
March 28, 2024
_mU-3lE2QwI
#KenanThompson speaks out following the #QuietonSet documentary. (🎥: Tamron Hall Show) #shorts
March 28, 2024
8AGP-Gfw_Ek
King Charles Shares "Great Sadness" at Missing Royal Appearance | E! News
March 28, 2024
lyizFqf1kQY
Martha Reeves Walk of Fame Ceremony
March 27, 2024
QzyezumEPtQ
Eminem, 50 Cent & Snoop Dogg Present Dr. Dre with a Star on the Walk of Fame
March 19, 2024
4bNLs1hxVp8
Opening Remarks for the Variety Summit October 20th, 2023 Jay Penske
March 18, 2024
c6Z707iLq8E
Montell Jordan Dishes On Young MC Wedding, 'This Is How Date Night' Plans | TMZ
March 28, 2024
G3SMExj-qio
Davina Potratz Says TV Not Helping 'Selling Sunset' Relationship Woes | TMZ
March 28, 2024
D4piy4GNm4k
Logan Paul Rips Graham Bensinger Over Documentary, You Promised Apple TV+ | TMZ Live
March 28, 2024
NiSDpZhZklQ
Prince William pinned royal medal to Spice Girl Mel B’s boobs #shorts
March 28, 2024
O1cQ0UW9pco
Jennifer Garner shares ‘hard’ part of raising her and Ben Affleck’s kids
March 28, 2024
3Q7mZaVUdgc
50 Cent's ex Daphne Joy named as an alleged sex worker in Sean ‘Diddy’ Combs lawsuit #shorts
March 28, 2024
yhLFI8DG9rM
TV Schedule
Late Night Show
Watch the latest shows of U.S. top comedians

Sports

Latest sport results, news, videos, interviews and comments
Latest Events
28
Mar
CHAMPIONS LEAGUE: Playoffs - Women
PSG W - Hacken W
28
Mar
CHAMPIONS LEAGUE: Playoffs - Women
Barcelona W - SK Brann W
27
Mar
CHAMPIONS LEAGUE: Playoffs - Women
Chelsea W - Ajax W
27
Mar
CHAMPIONS LEAGUE: Playoffs - Women
Lyon W - SL Benfica W
17
Mar
SPAIN: La Liga
Atletico Madrid - Barcelona
17
Mar
ENGLAND: FA Cup
Manchester United - Liverpool
17
Mar
ITALY: Serie A
Inter Milan - Napoli
17
Mar
GERMANY: Bundesliga
Borussia Dortmund - Eintracht Frankfurt
17
Mar
ENGLAND: FA Cup
Chelsea - Leicester City
17
Mar
ITALY: Serie A
Roma - Sassuolo
17
Mar
ITALY: Serie A
Verona - AC Milan
17
Mar
ITALY: Serie A
Juventus - Genoa
16
Mar
GERMANY: Bundesliga
Darmstadt - Bayern Munich
16
Mar
ENGLAND: FA Cup
Manchester City - Newcastle United
16
Mar
ENGLAND: Premier League
Fulham - Tottenham Hotspur
16
Mar
SPAIN: La Liga
Osasuna - Real Madrid
13
Mar
CHAMPIONS LEAGUE: 1/8 Final
Atletico Madrid - Inter Milan
12
Mar
CHAMPIONS LEAGUE: 1/8 Final
Barcelona - Napoli
12
Mar
CHAMPIONS LEAGUE: 1/8 Final
Arsenal - Porto
Find us on Instagram
at @feedimo to stay up to date with the latest.
Featured Video You Might Like
zWJ3MxW_HWA L1eLanNeZKg i1XRgbyUtOo -g9Qziqbif8 0vmRhiLHE2U JFCZUoa6MYE UfN5PCF5EUo 2PV55f3-UAg W3y9zuI_F64 -7qCxIccihU pQ9gcOoH9R8 g5MRDEXRk4k
Copyright © 2020 Feedimo. All Rights Reserved.