Newtab do no harm
Guardrail metrics for the New Tab. Includes user experience and revenue-related metrics for Search, Pocket and AdMarketplace Sponsored Tiles.
Metrics
newtab_gt4_searches
**Any Newtab Searches **
Client performed any Newtab Handoff searches during the experiment
Analysis Period: weekly, overall
Data Source: newtab_clients_daily
Statistics: binomial
Definition:
COALESCE(CASE WHEN SUM(searches) > 4 THEN 1 ELSE 0 END, 0)
newtab_any_searches
**Any Newtab Searches **
Client performed any Newtab Handoff searches during the experiment
Analysis Period: weekly, overall
Data Source: newtab_clients_daily
Statistics: binomial
Definition:
COALESCE(LOGICAL_OR(searches > 0), FALSE)
newtab_engagement
**Newtab Engagement **
Whether or not the client had a newtab search OR a pocket click OR a tile click.
Analysis Period: weekly, overall
Data Source: newtab_clients_daily
Statistics: binomial
Definition:
COALESCE(MAX(CASE WHEN visits_with_non_impression_engagement > 0 THEN 1 ELSE 0 END), 0)
newtab_homepage_enabled
**Newtab Homepage Enabled **
Whether or not the homepage is set to display the default New Tab page.
Analysis Period: weekly, overall
Data Source: newtab_clients_daily
Statistics: binomial
Definition:
COALESCE(MAX(IF(newtab_homepage_category = 'enabled', 1, 0)), 0)
newtab_ad_click_rate
**Newtab Ad Click Rate **
New Tab ad clicks divided by New Tab searches with ads
Analysis Period: weekly, overall
Data Source: newtab_clients_daily
Statistics: deciles, bootstrap_mean
Definition:
SAFE_DIVIDE(COALESCE(SUM(tagged_search_ad_clicks), 0), COALESCE(SUM(tagged_search_ad_impressions), 0))
newtab_engaged_visits
**Newtab Engaged Visit Count **
Count of New Tab visits with any engagement
Analysis Period: weekly, overall
Data Source: newtab_clients_daily
Statistics: deciles, bootstrap_mean
Definition:
COALESCE(SUM(visits_with_non_impression_engagement), 0)
newtab_visits
**Newtab Visit Count **
Count of New Tab visits
Analysis Period: weekly, overall
Data Source: newtab_clients_daily
Statistics: deciles, bootstrap_mean
Definition:
COALESCE(SUM(newtab_visit_count), 0)
Data Sources
newtab_clients_daily- New Tab Clients Daily
New Tab visit aggregated to client-day level
Definition: