Skip to content

Refactor ParquetExec::try_from_files in preparation for making it parallel #896

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
andygrove opened this issue Aug 16, 2021 · 1 comment
Closed

Refactor ParquetExec::try_from_files in preparation for making it parallel #896

andygrove opened this issue Aug 16, 2021 · 1 comment
Labels
enhancement New feature or request

Comments

@andygrove
Copy link
Member

Is your feature request related to a problem or challenge? Please describe what you are trying to do.
The logic in ParquetExec::try_from_files is not written in a way that makes it easy to parallize.

Describe the solution you'd like
Refactor logic to make it easier to apply threading in a separate PR.

Describe alternatives you've considered
N/A

Additional context
N/A
@andygrove andygrove added the enhancement New feature or request label Aug 16, 2021
@andygrove andygrove mentioned this issue Aug 16, 2021
Closed
@yjshen yjshen mentioned this issue Aug 25, 2021
Closed
7 tasks
@andygrove
Copy link
Member Author

Replaced by #944

unkloud pushed a commit to unkloud/datafusion that referenced this issue Mar 23, 2025
@viirya
fix: CometTakeOrderedAndProjectExec native scan node should use child…
bfbb0be 
… operator's output (apache#896)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
1 participant
@andygrove