Skip to content

New Tab - Do No Harm

Guardrail metrics for the New Tab. Includes user experience and revenue-related metrics for Search, content and AdMarketplace Sponsored Tiles.

Source | Edit

Metrics

Sponsored Content Click Through Rate

Rate of Clicks per impression for Sponsored Content

Analysis Period: weekly, overall

Data Source: ``

Statistics: population_ratio

Definition: 
None

Sponsored Tile Click Through Rate

Rate of Clicks per Impression Sponsored Tiles (aka Sponsored Topsites on New Tab) across all positions.

Analysis Period: weekly, overall

Data Source: ``

Statistics: population_ratio

Definition: 
None

organic_content_impressions

Organic Content Impressions

Count of impressions on Organic content.

Analysis Period: weekly, overall

Data Source: newtab_clients_daily

Statistics: linear_model_mean, sum

Definition: 
COALESCE(SUM(organic_content_impression_count), 0)

organic_content_clicks

Organic Content Clicks

Count of clicks on Organic content.

Analysis Period: weekly, overall

Data Source: newtab_clients_daily

Statistics: linear_model_mean, sum

Definition: 
COALESCE(SUM(organic_content_click_count), 0)

Sponsored Content Impressions

Count of impressions of Sponsored Content.

Analysis Period: weekly, overall

Data Source: newtab_clients_daily

Statistics: linear_model_mean, sum

Definition: 
COALESCE(SUM(sponsored_content_impression_count), 0)

Sponsored Content Clicks

Count of clicks on Sponsored content.

Analysis Period: weekly, overall

Data Source: newtab_clients_daily

Statistics: linear_model_mean, sum

Definition: 
COALESCE(SUM(sponsored_content_click_count), 0)

newtab_organic_topsite_impressions_v2

Newtab Organic Tile Impressions

Count of New Tab organic tile impressions across all positions.

Analysis Period: weekly, overall

Data Source: newtab_clients_daily

Statistics: linear_model_mean, sum

Definition: 
COALESCE(SUM(organic_topsite_impression_count), 0)

newtab_organic_topsite_clicks_v2

Newtab Organic Tile Clicks

Count of New Tab organic tile clicks across all positions.

Analysis Period: weekly, overall

Data Source: newtab_clients_daily

Statistics: linear_model_mean, sum

Definition: 
COALESCE(SUM(organic_topsite_click_count), 0)

Sponsored Tile Impressions

Count of impressions of Sponsored Tiles (aka Sponsored Topsites on New Tab) across all positions.

Analysis Period: weekly, overall

Data Source: newtab_clients_daily

Statistics: linear_model_mean, sum

Definition: 
COALESCE(SUM(sponsored_topsite_impression_count), 0)

Sponsored Tile Clicks

Count of clicks of Sponsored Tiles (aka Sponsored Topsites on New Tab) across all positions.

Analysis Period: weekly, overall

Data Source: newtab_clients_daily

Statistics: linear_model_mean, sum

Definition: 
COALESCE(SUM(sponsored_topsite_click_count), 0)

newtab_gt4_searches

Greater Than 4 Newtab Searches

Client performed at least 5 Newtab Handoff searches during the experiment

Analysis Period: weekly, overall

Data Source: newtab_clients_daily

Statistics: binomial

Definition: 
COALESCE(CASE WHEN SUM(search_interaction_count) > 4 THEN 1 ELSE 0 END, 0)

newtab_any_searches

Any Newtab Searches

Client performed any Newtab Handoff searches during the experiment

Analysis Period: weekly, overall

Data Source: newtab_clients_daily

Statistics: binomial

Definition: 
COALESCE(LOGICAL_OR(search_interaction_count > 0), FALSE)

newtab_engagement

Newtab Engagement

Whether or not the client had a newtab search OR a content click OR a tile click.

Analysis Period: weekly, overall

Data Source: newtab_clients_daily

Statistics: binomial

Definition: 
COALESCE(MAX(CASE WHEN any_engagement_visits > 0 THEN 1 ELSE 0 END), 0)

newtab_homepage_enabled

Newtab Homepage Enabled

Whether or not the homepage is set to display the default New Tab page.

Analysis Period: weekly, overall

Data Source: newtab_clients_daily

Statistics: binomial

Definition: 
COALESCE(MAX(IF(homepage_category = 'enabled', 1, 0)), 0)

newtab_ad_click_rate

Newtab Ad Click Rate

New Tab ad clicks divided by New Tab searches with ads

Analysis Period: weekly, overall

Data Source: newtab_clients_daily

Statistics: deciles, bootstrap_mean

Definition: 
SAFE_DIVIDE(COALESCE(SUM(search_ad_click_count), 0),  COALESCE(SUM(search_ad_impression_count), 0))

newtab_engaged_visits

Newtab Engaged Visit Count

Count of New Tab visits with any engagement

Analysis Period: weekly, overall

Data Source: newtab_clients_daily

Statistics: deciles, bootstrap_mean

Definition: 
COALESCE(SUM(any_engagement_visits), 0)

newtab_visits

Newtab Visit Count

Count of New Tab visits

Analysis Period: weekly, overall

Data Source: newtab_clients_daily

Statistics: deciles, bootstrap_mean

Definition: 
COALESCE(SUM(all_visits), 0)

Data Sources

newtab_clients_daily- New Tab Clients Daily

New Tab visit aggregated to client-day level

Definition: