Skip to content

Newtab do no harm

Guardrail metrics for the New Tab. Includes user experience and revenue-related metrics for Search, Pocket and AdMarketplace Sponsored Tiles.

Source | Edit

Metrics

newtab_gt4_searches

**Any Newtab Searches **

Client performed any Newtab Handoff searches during the experiment

Analysis Period: weekly, overall

Data Source: newtab_clients_daily

Statistics: binomial

Definition:
COALESCE(CASE WHEN SUM(searches) > 4 THEN 1 ELSE 0 END, 0)

newtab_any_searches

**Any Newtab Searches **

Client performed any Newtab Handoff searches during the experiment

Analysis Period: weekly, overall

Data Source: newtab_clients_daily

Statistics: binomial

Definition:
COALESCE(LOGICAL_OR(searches > 0), FALSE)

newtab_engagement

**Newtab Engagement **

Whether or not the client had a newtab search OR a pocket click OR a tile click.

Analysis Period: weekly, overall

Data Source: newtab_clients_daily

Statistics: binomial

Definition:
COALESCE(MAX(CASE WHEN visits_with_non_impression_engagement > 0 THEN 1 ELSE 0 END), 0)

newtab_homepage_enabled

**Newtab Homepage Enabled **

Whether or not the homepage is set to display the default New Tab page.

Analysis Period: weekly, overall

Data Source: newtab_clients_daily

Statistics: binomial

Definition:
COALESCE(MAX(IF(newtab_homepage_category = 'enabled', 1, 0)), 0)

newtab_ad_click_rate

**Newtab Ad Click Rate **

New Tab ad clicks divided by New Tab searches with ads

Analysis Period: weekly, overall

Data Source: newtab_clients_daily

Statistics: deciles, bootstrap_mean

Definition:
SAFE_DIVIDE(COALESCE(SUM(tagged_search_ad_clicks), 0),  COALESCE(SUM(tagged_search_ad_impressions), 0))

newtab_engaged_visits

**Newtab Engaged Visit Count **

Count of New Tab visits with any engagement

Analysis Period: weekly, overall

Data Source: newtab_clients_daily

Statistics: deciles, bootstrap_mean

Definition:
COALESCE(SUM(visits_with_non_impression_engagement), 0)

newtab_visits

**Newtab Visit Count **

Count of New Tab visits

Analysis Period: weekly, overall

Data Source: newtab_clients_daily

Statistics: deciles, bootstrap_mean

Definition:
COALESCE(SUM(newtab_visit_count), 0)

Data Sources

newtab_clients_daily- New Tab Clients Daily

New Tab visit aggregated to client-day level

Definition: