Skip to content

GCP Ingestion

GCP Ingestion is a monorepo for documentation and implementation of the Mozilla telemetry ingestion system deployed to Google Cloud Platform (GCP).

The components are:

The design behind the system along with various trade offs are documented in the architecture section.

This project requires Java 11. To manage multiple local JDKs, consider jenv and the jenv enable-plugin maven command. Also consider reading through Apache Beam's wiki article on IntelliJ IDEA setup for some ideas on configuring an IDE environment.

Feel free to ask us in #data-help on Slack or #telemetry on chat.mozilla.org if you have specific questions.