Firefox Suggest
Introduction
Firefox Suggest is a monetizable feature
in the Firefox urlbar. Suggest provides real-time recommendations as users type in the urlbar. The recommendations include URLs from the user's browsing history, open tabs and bookmarks, as well as URLs for sponsored and non-sponsored content from third party partners like Ad Marketplace and Wikipedia.
Firefox Suggestions compete directly with Search Engine Suggestions for user attention and clicks in the urlbar. A holistic analysis of the urlbar should include data from all the sources providing recommendations to the urlbar, including Firefox Suggestions, Search Engine Suggestions, auto-fill, etc.
This section will include information about Firefox Suggest data. See Search Datasets for documentation on Search Engine Data.
Data Collection
Firefox Suggestions may be served to the urlbar from Firefox itself, or by a Mozilla-owned service called Merino. When users opt in to sharing their search query data, Firefox sends the search queries to Merino, and Merino responds with recommendations.
In addition to the search queries, we collect Category 1 and 2 telemetry data from Firefox about how users are interacting with Suggest.
Interactions data (Cat 1 and 2)
Interactions data related to Firefox Suggest is collected in the following ways.
-
Interactions with Firefox Suggestions in the urlbar (i.e., clicks, impressions, blocks, clicks on help links) are collected using the standard (legacy) Telemetry system as Scalars and Events. Full documentation of the probes is here. The Scalars are available in Clients Daily.
-
Interactions with Firefox Suggestions in the urlbar (i.e., clicks, impressions, blocks) are collected using Custom Contextual Services Pings. The Custom Contextual Services Pings contain additional information not available in the standard Scalars and Events, such as the advertiser that provided the recommendation, if any. This data has a much shorter retention period than the data collecting in (1) above. It also does not contain the Firefox Desktop Client ID, and is not join-able by design to any datasets outside of Contextual Services. Full documentation of the probes is here.
-
Preference Settings are collected using the standard (legacy) Telemetry system in the Environment. Full documentation of the probes is here. The Preferences are available in Clients Daily. Choices users made on opt-in modals (which propagate to Preferences) are also recorded in the Environment.
-
Exposure Events for experiments are recorded using the standard Nimbus system. Full documentation of the probes is here.
Search queries and Merino
-
Search queries sent to Merino by Firefox are logged by Merino. Full documentation of the probes is here. For more information about the much shorter retention periods, security and access controls on this data, see the Search Terms Data Access Policy (Mozilla internal only).
-
Merino responses as seen from Firefox. We collect data about Merino's response times and response types in Firefox using the standard (legacy) Telemetry system as Histograms. Full documentation of the probes is here.
-
Service and operational data on Merino We also collect data about Merino as a service from Merino directly. Full documentation of the data is here.
Big Query Tables and Looker Explores
Note: gotchas with historical Suggest revenue data are outlined here.
Access-restriction(s) | Big Query Table | Looker Explore | Description |
---|---|---|---|
All Mozillians | telemetry.suggest_clients_daily | Firefox Desktop > Suggest Clients Daily | Workhorse dataset for Suggest, includes desktop data. All new Suggest metrics are added to this table. Does not include advertiser data. |
Contextual Services | contextual_services.event_aggregates | Contextual Services > Event Aggregates | Dataset with Sponsored Tiles and Suggest analyses by advertiser. No longer maintained. Instead use the derived event_aggregates_[product] datasets. |
Contextual Services | contextual_services.event_aggregates_suggest | Contextual Services > Event Aggregates Suggest | Workhorse dataset for Suggest analyses by advertiser. |
Contextual Services | contextual_services_derived.adm_forecasting | Contextual Services > AdM Forecasting | Dataset with required components for Sponsored Tiles and Suggest revenue forecasts. |
Contextual Services, Revenue | contextual_services.event_aggregates x revenue.revenue_data | Revenue > AdM Revenue with Telemetry | Revenue information combined with usage metrics. This dataset is useful for CPC analyses. |