how to set the python kernel for quarto

[biscotty666]

Description

I'm having trouble with quarto running python code. Specifically, it is not finding the correct kernel. I can import my environment modules in a qmd document in rstudio without a problem, yet when I run quarto preview, it says that it cannot find the modules. So it is using a different kernel.

The twist here is that I use nix, and so I don't use a typical venv environment, and there is no /usr/bin/python on the system. Rstudio sees the kernel, and things work as expected, but for some reason quarto does not.

Any help would be much appreciated. In general, I will be using pre-rendered ipynb documents, but it would be nice to get this working.

[mcanouil]

Please read the documentation before asking questions. Thank you.

https://quarto.org/docs/computations/python.html#kernel-selection

Additionally, there are other discussions about kernel discovery issue.

Finally, the troubleshooting guide: https://quarto.org/docs/troubleshooting/#advanced

---

The twist here is that I use nix,

The Quarto CLI packaged by Nix doesn't use the proper dependencies. There is no guarantees it works properly and as designed/expected by the Quarto team.
Unless proven the issue is Quarto CLI and not the wrongly packaged version provided for Nix users, there is no support.

[biscotty666]

quarto check

[✓] Checking Python 3 installation....OK
      Version: 3.12.9
      Path: /nix/store/d03530jzrd6i26593w5v82iv6gbra8qn-python3-3.12.9-env/bin/python3.12
      Jupyter: 5.7.2
      Kernels: haskell, python3

which is the wrong kernel, as I knew. This is what I need to change. As to those other sections, I'm not using jupyter, and they all seem jupyter-specific. Point three is not a terminal command, at least not one the works for me, and everything in the advanced troubleshooting seems to assume I do, or at least I cannot translate it to a non-jupyter context. I'm not trying to be difficult. If I just knew how quarto selects it's kernel.

[mcanouil]

What do you mean "wrong kernel"?
The output shows you the different kernels that Quarto sees. It sees two kernels and only two.

Meaning there is an issue with your setup, if there are more.
If it's in an environment, you need to activate the environment first.
Did you install your kernel in the activated environment? nix/store/d03530jzrd6i26593w5v82iv6gbra8qn-python3-3.12.9-env/bin/python3.12

I think you are mistaken. You are using Jupyter with a specific kernel.
Jupyter is not Jupyter Lab, it's a tool to work with Jupyter Notebook.
There is no way you can use a Jupyter kernel without using Jupyter.

[biscotty666]

❯ which python
/nix/store/2f2ymldccm86nqxlyhv76f5kjfy1h265-python3-3.12.9-env/bin/python

is the right kernel, the one that quarto sees is the wrong one.

The nix store contains many python versions, one for each development shell I have on my system. That's the way it is set up. It's not like FHS.

To elaborate, through environment variables, each dev shell selects the correct kernel. Perhaps I could set a Jupyter environment variable, though...hmmm

[mcanouil]

I don't know how your environments are activated but I believe the issue is there.

You could use QUARTO_PYTHON environment variable to force Quarto to use whatever version you want.
This is also documented on the same page by the way: https://quarto.org/docs/computations/python.html#installation

And check your PATH. I bet you have multiple paths to Python binary in it (which is bad).

Quarto will select a version of Python using the Python Launcher on Windows or system PATH on MacOS and Linux. You can override the version of Python used by Quarto by setting the QUARTO_PYTHON environment variable.

[biscotty666]

QUARTO_PYTHON

was indeed the answer I needed. Thank you.

[cderv]

@biscotty666 I believe Quarto will look for python3 binary. So this one
/nix/store/2f2ymldccm86nqxlyhv76f5kjfy1h265-python3-3.12.9-env/bin/python won't be found by default by Quarton and this one is /nix/store/d03530jzrd6i26593w5v82iv6gbra8qn-python3-3.12.9-env/bin/python3.12 possibly because your python3 found in PATH points to it. Check which python3

QUARTO_PYTHON is a good solution if you want manual configuration. If you want automatic detection

• Either use venv for Quarto Project
• Or be sure to get the right python3 binary found in PATH.

So for your current situation, I would check your PATH and which python versions are available.

[biscotty666]

I appreciate you concern, which is certainly important on most Linux systems. Nix is different, though, and setting the environment variable is the best solution for my system, the one I was looking for initially.

I don't actually have a "base Python" on my system. If I open a terminal and type which python, it says not found. I don't have R or rstudio installed either. Each project has it's own version of all the packages necessary, they live in /nix/store/... and are available when working in the project's directories, but not outside of them. This is why venvs and docker-style containers are not necessary on a nix-enabled system. When entering the shell (loaded automatically when entering the project's directory), a whole mess of variables are set to point to the right targets in /nix/store. In this case, all I needed to do was to add the environment variable in the file that defines the development shell (environment variables are unset when leaving the directories). But they all live in nix/store, and my hunch is that Quarto just chose the first one it found.

[cderv]

Oh good to know ! Thanks for explaining !