Static Data

Static tables, often useful for data-enriching joins This directory contains definitions for derived tables in the static dataset.

In particular, we have two tables based on a one-time export of Firefox Accounts extracted from Amplitude and imported to BigQuery.

Tables can be defined as a CSV named data.csv and the table will be created by the ./bqetl static publish command. An optional schema.json and description.txt can be defined in the same directory. If schema.json is not defined, column names are inferred from the first line of the CSV and are assumed to be strings. description.txt defines the table description in BigQuery.

These should be published to all active projects used for production ETL and analysis:

# Generate data.csv for country_names
bqetl generate country_code_lookup

./bqetl static publish --project-id mozdata
./bqetl static publish --project-id moz-fx-data-shared-prod

Source Directory

country_codes_v1

static.country_codes_v1

Schema

Column	Description	Type	Nullable
name		String	Yes
code		String	Yes
region_name		String	Yes
subregion_name		String	Yes
intermediate_region_name		String	Yes
pocket_available_on_newtab		Boolean	Yes
mozilla_vpn_available		Boolean	Yes

Source Directory

---

country_names_v1

static.country_names_v1

Schema

Column	Description	Type	Nullable
name		String	Yes
code		String	Yes

Source Directory

---

data_incidents_v1

Notes for data incidents

static.data_incidents_v1

This table is connected to a spreadsheet that contains notes about data incidents. The notes are displayed on Looker dashboards.

• Owners:

  - ascholtz@mozilla.com

Schema

Column	Description	Type	Nullable
start_date		Date	Yes
end_date		Date	Yes
incident		String	Yes
description		String	Yes
bug		String	Yes
product		String	Yes
version		String	Yes

Source Directory | Metadata File

---

fxa_amplitude_export_users_daily

Static - Fxa Amplitude Export Users Daily

static.fxa_amplitude_export_users_daily

[DESCRIPTION_MISSING]

• Owners:

  - data-platform-infra-wg@mozilla.com

Schema

Column	Description	Type	Nullable
submission_date		Date	Yes
generated_time		Datetime	Yes
user_id		String	Yes
country		String	Yes
seen_in_tier1_country		Boolean	Yes

Source Directory | Metadata File

---

fxa_amplitude_export_users_last_seen

Static - Fxa Amplitude Export Users Last Seen

static.fxa_amplitude_export_users_last_seen

[DESCRIPTION_MISSING]

• Owners:

  - data-platform-infra-wg@mozilla.com

Schema

Column	Description	Type	Nullable
submission_date		Date	Yes
date_last_seen		Date	Yes
date_last_seen_in_tier1_country		Date	Yes
user_id		String	Yes
country		String	Yes

Source Directory | Metadata File

---

iana_tls_cipher_suites

static.iana_tls_cipher_suites

Schema

Column	Description	Type	Nullable
value		String	Yes
description		String	Yes
dtls_ok		Boolean	Yes
recommended		Boolean	Yes
reference		String	Yes

Source Directory

---

monitoring_distinct_docids_notes_v1

Notes for monitoring distinct docids

static.monitoring_distinct_docids_notes_v1

This table is connected to a spreadsheet that contains notes about incidents with distinct docids. The notes are displayed on Looker dashboards.

• Owners:

  - ascholtz@mozilla.com

Schema

Column	Description	Type	Nullable
start_date		Date	Yes
end_date		Date	Yes
document_namespace		String	Yes
document_type		String	Yes
notes		String	Yes
bug		String	Yes

Source Directory | Metadata File

---

monitoring_missing_columns_notes_v1

Notes for monitoring missing columns

static.monitoring_missing_columns_notes_v1

This table is connected to a spreadsheet that contains notes about missing columns. The notes are displayed on Looker dashboards.

• Owners:

  - ascholtz@mozilla.com

Schema

Column	Description	Type	Nullable
start_date		Date	Yes
end_date		Date	Yes
document_namespace		String	Yes
document_type		String	Yes
document_version		String	Yes
path		String	Yes
notes		String	Yes
bug		String	Yes

Source Directory | Metadata File

---

monitoring_missing_document_namespaces_notes_v1

Notes for monitoring missing document namespaces

static.monitoring_missing_document_namespaces_notes_v1

This table is connected to a spreadsheet that contains notes about missing namespaces. The notes are displayed on Looker dashboards.

• Owners:

  - ascholtz@mozilla.com

Schema

Column	Description	Type	Nullable
start_date		Date	Yes
end_date		Date	Yes
document_namespace		String	Yes
document_type		String	Yes
document_version		String	Yes
notes		String	Yes
bug		String	Yes

Source Directory | Metadata File

---

monitoring_schema_errors_notes_v1

Notes for monitoring schema errors

static.monitoring_schema_errors_notes_v1

This table is connected to a spreadsheet that contains notes about schema errors. The notes are displayed on Looker dashboards.

• Owners:

  - ascholtz@mozilla.com

Schema

Column	Description	Type	Nullable
start_date		Date	Yes
end_date		Date	Yes
document_namespace		String	Yes
document_type		String	Yes
path		String	Yes
notes		String	Yes
bug		String	Yes

Source Directory | Metadata File

---

normal_distribution

static.normal_distribution

Schema

Column	Description	Type	Nullable
score		Numeric	Yes
value		Numeric	Yes

Source Directory

---

normalized_os_name

static.normalized_os_name

Schema

Column	Description	Type	Nullable
os_name		String	Yes
normalized_os_name		String	Yes

Source Directory

---

normalized_os_version

static.normalized_os_version

Schema

Column	Description	Type	Nullable
os_name		String	Yes
os_version_regexp		String	Yes
normalized_os_name		String	Yes
normalized_os_version		String	Yes
release_date		String	Yes

Source Directory

---

third_party_standardized_country_names

static.third_party_standardized_country_names

Schema

Column	Description	Type	Nullable
raw_country		String	Yes
standardized_country		String	Yes

Source Directory

---