quarto render in parallel across multiple cores?

[paulgribble]

Is it possible (or can it be made possible) to execute quarto render in a project directory with many many files so that it makes use of multiple cores? (e.g. in the same way one can use the -j flag with the make command to simultaneously run independent targets?) thanks,

[cscheid]

Not right now, but it's in our medium-term plans (I would guess later than next month, but not later than the next decade).

[eitsupi]

Parallelization with make may fail in the process because intermediate files may be created with the same name.
See #731

[cscheid]

Yes, we are aware of that issue. To add a bit more information for why this is a real challenge:

1. we need to refactor our TypeScript codebase to not block on rendering each part (laborious, but not particularly hard)
2. we need to carefully catalog and track filesystem dependencies and side-effects of our toolchain, at least Jupyter, Knitr, Pandoc, LaTeX (laborious and hard)
3. some of our generated files have implied dependencies (eg listings pages need the items to be rendered ahead of time). This will probably mean writing a custom scheduler (laborious, but not particularly hard)

[venpopov]

any updates on this?

[jamesowers-cohere]

Is there a place where we can track issues related to this? Currently having to roll my own wrapper for quarto to handle dependency specification, and parallelisation, so it would be great to see what work is being done on this such that I can make a contribution to your project.

[cscheid]

#6518