Metric Update Procedure
Please follow the steps below to update the ETE Looker Dashboards. The dashboards are typically updated on Monday mornings (North America ET/PT) to ensure the values are available for team check-in meetings. The process of updating the dashboards can take up to an hour, this is due to network latency from parsing files stored on GCS.
Prerequisites
Before updating the test metrics, ensure that:
- Your development environment is setup with proper permissions (see the Developer Setup).
- You are on the latest version of the
main
branch - Your
config.ini
file in the root directory is up-to-date
1. Scrape for New Raw Test Data
To retrieve the latest test and coverage results for local parsing, execute the following command from the ecosystem-test-scripts root directory:
make run_circleci_scraper
Notes:
- Set the
days_of_data
option in the config.ini file to the appropriate number of days. This is typically8
days since the update cadence is weekly on Mondays.
2. Push updates to BigQuery
To push data to BigQuery with the latest test results and test coverages, execute the following command from the ecosystem-test-scripts root directory:
make run_metric_reporter
Notes:
- Coverage results are produced only for Autopush-rs unit tests and Merino-py unit and integration tests.