Skip to content

[DO NOT merge] - DENG-7414 Set retention on client_level tables for FxA tables #6824

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 3 commits into
base: main
Choose a base branch
from
Draft

[DO NOT merge] - DENG-7414 Set retention on client_level tables for FxA tables #6824

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
58fffb0
DENG-7414_Set retention on FxA client level tables
alekhyamoz Jan 16, 2025
fc3ea5c
Fix CI issue
alekhyamoz Jan 16, 2025
c1bdc3e
Remove file
alekhyamoz Jan 16, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 3 additions & 2 deletions sql/moz-fx-data-shared-prod/accounts_backend_derived/users_services_daily_v1/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,15 +5,16 @@ owners:
- [email protected]
labels:
incremental: true
owner1: [email protected]
owner1: [email protected]
table_type: client_level
scheduling:
dag_name: bqetl_accounts_derived
bigquery:
time_partitioning:
type: day
field: submission_date
require_partition_filter: true
expiration_days: null
expiration_days: 775
clustering:
fields: [service, country]
references: {}
5 changes: 3 additions & 2 deletions ...oz-fx-data-shared-prod/accounts_backend_derived/users_services_last_seen_v1/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,15 +5,16 @@ owners:
- [email protected]
labels:
incremental: true
owner1: [email protected]
owner1: [email protected]
table_type: client_level
scheduling:
dag_name: bqetl_accounts_derived
bigquery:
time_partitioning:
type: day
field: submission_date
require_partition_filter: true
expiration_days: null
expiration_days: 775
clustering:
fields: [service, country]
references: {}
Expand Down
1 change: 1 addition & 0 deletions sql/moz-fx-data-shared-prod/firefox_accounts_derived/fxa_amplitude_export_v1/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,7 @@ bigquery:
type: day
field: submission_date_pacific
require_partition_filter: false
expiration_days: 775
clustering:
fields:
- user_id
2 changes: 1 addition & 1 deletion sql/moz-fx-data-shared-prod/firefox_accounts_derived/fxa_delete_events_v1/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -17,6 +17,6 @@ bigquery:
type: day
field: submission_timestamp
require_partition_filter: false
expiration_days: null
expiration_days: 775
clustering: null
references: {}
1 change: 1 addition & 0 deletions sql/moz-fx-data-shared-prod/firefox_accounts_derived/fxa_delete_events_v2/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -17,3 +17,4 @@ bigquery:
type: day
field: submission_timestamp
require_partition_filter: false
expiration_days: 775
1 change: 1 addition & 0 deletions ...-data-shared-prod/firefox_accounts_derived/fxa_log_device_command_events_v1/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,7 @@ bigquery:
type: day
field: timestamp
require_partition_filter: false
expiration_days: 775
clustering:
fields:
- command
1 change: 1 addition & 0 deletions ...-data-shared-prod/firefox_accounts_derived/fxa_log_device_command_events_v2/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,7 @@ bigquery:
type: day
field: timestamp
require_partition_filter: false
expiration_days: 775
clustering:
fields:
- command
1 change: 1 addition & 0 deletions sql/moz-fx-data-shared-prod/firefox_accounts_derived/fxa_users_daily_v1/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,7 @@ bigquery:
type: day
field: submission_date
require_partition_filter: false
expiration_days: 775
clustering:
fields:
- user_id
1 change: 1 addition & 0 deletions sql/moz-fx-data-shared-prod/firefox_accounts_derived/fxa_users_daily_v2/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,7 @@ bigquery:
type: day
field: submission_date
require_partition_filter: true
expiration_days: 775
clustering:
fields:
- registered
Expand Down
2 changes: 1 addition & 1 deletion sql/moz-fx-data-shared-prod/firefox_accounts_derived/fxa_users_last_seen_v1/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ bigquery:
type: day
field: submission_date
require_partition_filter: true
expiration_days: null
expiration_days: 775
clustering:
fields:
- user_id
Expand Down
2 changes: 1 addition & 1 deletion sql/moz-fx-data-shared-prod/firefox_accounts_derived/fxa_users_last_seen_v2/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -25,4 +25,4 @@ bigquery:
type: day
field: submission_date
require_partition_filter: true
expiration_days: null
expiration_days: 775
1 change: 1 addition & 0 deletions ...oz-fx-data-shared-prod/firefox_accounts_derived/fxa_users_services_daily_v1/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,7 @@ bigquery:
type: day
field: submission_date
require_partition_filter: false
expiration_days: 775
clustering:
fields:
- service
Expand Down
2 changes: 1 addition & 1 deletion ...oz-fx-data-shared-prod/firefox_accounts_derived/fxa_users_services_daily_v2/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ bigquery:
type: day
field: submission_date
require_partition_filter: false

expiration_days: 775
clustering:
fields:
- service
Expand Down
1 change: 1 addition & 0 deletions ...ta-shared-prod/firefox_accounts_derived/fxa_users_services_devices_daily_v1/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -42,6 +42,7 @@ bigquery:
type: day
field: timestamp
require_partition_filter: true
expiration_days: 775
clustering:
fields:
- service
Expand Down
2 changes: 1 addition & 1 deletion ...x-data-shared-prod/firefox_accounts_derived/fxa_users_services_last_seen_v1/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ bigquery:
type: day
field: submission_date
require_partition_filter: false
expiration_days: null
expiration_days: 775
clustering:
fields:
- service
Expand Down
1 change: 1 addition & 0 deletions ...x-data-shared-prod/firefox_accounts_derived/fxa_users_services_last_seen_v2/metadata.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,7 @@ bigquery:
type: day
field: submission_date
require_partition_filter: false
expiration_days: 775
clustering:
fields:
- service
Expand Down
22 changes: 0 additions & 22 deletions sql_generators/events_daily/templates/events_daily_v1/metadata.yaml
View file
Open in desktop

This file was deleted.