Skip to content
This repository was archived by the owner on May 17, 2024. It is now read-only.

Run diffs in paralllel #426

Closed
dlawin opened this issue Mar 1, 2023 · 2 comments · Fixed by #776
Closed

Run diffs in paralllel #426

dlawin opened this issue Mar 1, 2023 · 2 comments · Fixed by #776
Assignees
@sungchun12
Labels
--dbt Issues/features related to the dbt integration enhancement New feature or request performance stale_immune Immunity to stale bot

Comments

@dlawin
Copy link
Contributor

dlawin commented Mar 1, 2023 •
edited
Loading

Is your feature request related to a problem? Please describe.
Currently --dbt diffs run sequentially when there are multiple models in the last dbt run. This can cause long running diffs to slow down the overall total diff run time.

Describe the solution you'd like
Run the diffs for each model in parallel. Output as they finish.
@dlawin dlawin added enhancement New feature or request --dbt Issues/features related to the dbt integration performance labels Mar 1, 2023
@github-actions
Copy link
Contributor

This issue has been marked as stale because it has been open for 60 days with no activity. If you would like the issue to remain open, please comment on the issue or else it will be closed in 7 days.

@github-actions github-actions bot added the stale Issues/PRs that have gone stale label May 10, 2023
@github-actions
Copy link
Contributor

Although we are closing this issue as stale, it's not gone forever. Issues can be reopened if there is renewed community interest. Just add a comment and it will be reopened for triage.

@dlawin dlawin reopened this Nov 17, 2023
@dlawin dlawin removed the stale Issues/PRs that have gone stale label Nov 17, 2023
@dlawin dlawin assigned dlawin and sungchun12 and unassigned dlawin Nov 17, 2023
@dlawin dlawin mentioned this issue Nov 17, 2023
Merged
@dlawin dlawin linked a pull request Nov 17, 2023 that will close this issue
Make local dbt data diffs concurrent #776
Merged
@dlawin dlawin added stale_immune Immunity to stale bot and removed triage labels Nov 17, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@sungchun12 sungchun12

Labels
--dbt Issues/features related to the dbt integration enhancement New feature or request performance stale_immune Immunity to stale bot
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Make local dbt data diffs concurrent datafold/data-diff
2 participants
@dlawin @sungchun12