matlab-shell-run-code-section has ha problem with UTF8/latin1

[ouboub]

Please consider the following trivial .m file called example.m

%% 
fprintf('* Paso 2: Calculamos la región de aceptación $R_A$.\n\n')

What works

1. I open matlab indenpendent from emacs, and fire this command in the command line. Everything works
2. I open emacs start matlab, matlab-shell the command example.m, everything works
3. I run in the shell
   fprintf('* Paso 2: Calculamos la región deaceptación $R_A$.\n\n')
   the non ASCII symbols are not displayed!
4. I run in the file matlab-shell-run-code-section
   and again, the ASCII symbols are not displayed.
5. matlab-shell-save-and-go on hte other hand works

Uwe

[JohnC32]

Hi I'll look at this over the coming weekend. Thanks John

…

On Mon, Apr 14, 2025 at 1:10 PM Uwe Brauer ***@***.***> wrote: Please consider the following trivial .m file called example.m %% fprintf('* Paso 2: Calculamos la región de aceptación $R_A$.\n\n') What works 1. I open matlab indenpendent from emacs, and fire this command in the command line. Everything works 2. I open emacs start matlab, matlab-shell the command example.m, everything works 3. I run in the shell `fprintf('* Paso 2: Calculamos la región deaceptación $R_A$.\n\n')` the non ASCII symbols are not displayed! 4. I run in the file matlab-shell-run-code-section and again, the ASCII symbols are not displayed. Uwe — Reply to this email directly, view it on GitHub <#25>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AEJNJMRGJUSJKTCAECKZ3U32ZPTW3AVCNFSM6AAAAAB3DP6G26VHI2DSMVQWIX3LMV43ASLTON2WKOZSHE4TGNRWGY2DINQ> . You are receiving this because you are subscribed to this thread.Message ID: ***@***.***> *ouboub* created an issue (mathworks/Emacs-MATLAB-Mode#25) <#25> Please consider the following trivial .m file called example.m %% fprintf('* Paso 2: Calculamos la región de aceptación $R_A$.\n\n') What works 1. I open matlab indenpendent from emacs, and fire this command in the command line. Everything works 2. I open emacs start matlab, matlab-shell the command example.m, everything works 3. I run in the shell `fprintf('* Paso 2: Calculamos la región deaceptación $R_A$.\n\n')` the non ASCII symbols are not displayed! 4. I run in the file matlab-shell-run-code-section and again, the ASCII symbols are not displayed. Uwe — Reply to this email directly, view it on GitHub <#25>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AEJNJMRGJUSJKTCAECKZ3U32ZPTW3AVCNFSM6AAAAAB3DP6G26VHI2DSMVQWIX3LMV43ASLTON2WKOZSHE4TGNRWGY2DINQ> . You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>

[JohnC32]

I took a look and not sure what is wrong. I can reproduce on Linux with Emacs 29.4. If I send M-:

(process-send-string (get-buffer-process "*MATLAB*") "asdf你好，世界")

I see the unicode characters are dropped and only the four characters "asdf" appears in the *MATLAB* buffer. I checked the coding of the MATLAB buffer, M-:

(process-coding-system (get-buffer-process "*MATLAB*"))

and it's the expected (utf-8-unix . utf-8-unix)

Perhaps someone more familar with how utf-8 is handled could help?

[ouboub]

I took a look and not sure what is wrong. I can reproduce on Linux with Emacs 29.4. If I send M-:

(process-send-string (get-buffer-process "MATLAB") "asdf你好，世界")
I see the unicode characters are dropped and only the four characters "asdf" appears in the *MATLAB* buffer. I checked the coding of the MATLAB buffer, M-:

(process-coding-system (get-buffer-process "MATLAB"))
and it's the expected (utf-8-unix . utf-8-unix)

Perhaps someone more familar with how utf-8 is handled could help?

Just to mention. This is not UTF-8 specific. If you choose, say, latin-1 (iso-9959-1) then the non ASCII chars are
deleted

[ouboub]

I took a look and not sure what is wrong. I can reproduce on Linux with Emacs 29.4. If I send M-:
(process-send-string (get-buffer-process "MATLAB") "asdf你好，世界")
I see the unicode characters are dropped and only the four characters "asdf" appears in the *MATLAB* buffer. I checked the coding of the MATLAB buffer, M-:
(process-coding-system (get-buffer-process "MATLAB"))
and it's the expected (utf-8-unix . utf-8-unix)
Perhaps someone more familar with how utf-8 is handled could help?

Just to mention. This is not UTF-8 specific. If you choose, say, latin-1 (iso-9959-1) then the non ASCII chars are deleted

I think I will ask on the Emacs devel list.

[ouboub]

I took a look and not sure what is wrong. I can reproduce on Linux with Emacs 29.4. If I send M-:

(process-send-string (get-buffer-process "MATLAB") "asdf你好，世界")

when I do this from the file (buffer) test.m

I receive eval: Buffer test.m has no process

I see the unicode characters are dropped and only the four characters "asdf" appears in the *MATLAB* buffer. I checked the coding of the MATLAB buffer, M-:

(process-coding-system (get-buffer-process "MATLAB"))

I obtain

eval: Wrong type argument: processp, nil

so I need to solve this before writing to the devel list

and it's the expected (utf-8-unix . utf-8-unix)

Perhaps someone more familar with how utf-8 is handled could help?

[JohnC32]

It looks like you are missing the * characters in the buffer name. In Emacs, we name the buffer *MATLAB*. This should work (perhaps there was a copy-and-paste error from my original comment):

(process-send-string (get-buffer-process "*MATLAB*") "asdf你好，世界")

Which emacs mailing list are good for these types of questions?

[ouboub]

Thanks indeed when I eval

(process-send-string (get-buffer-process "*MATLAB*") "asdf你好，世界")

does not return error, and indeed returns in the matlab-shell-buffer

asdf

While

(process-coding-system (get-buffer-process "*MATLAB*"))

Returns (utf-8-unix . utf-8-unix)

The best mailing list to ask in opinion is the emacs-devel list
emacs-devel@gnu.org

can be reached via email or as a newsgroup

[JohnC32]

Eric noticed that this may not be an Emacs issue. If you run in a terminal on Linux

matlab -nodesktop
>> disp("

and after the disp(" attempt to paste a unicode character, MATLAB will not accept it.

[ouboub]

>> "JC" == John Ciolfi ***@***.***> writes: JohnC32 left a comment (mathworks/Emacs-MATLAB-Mode#25) Eric noticed that this may not be an Emacs issue. If you run in a terminal on Linux matlab -nodesktop >> disp(" and after the `disp("` attempt to paste a unicode character, MATLAB will not accept it.

Aha, I tried out a Spanish and a German keyboard. And indeed when I try to type a unicode character MATLAB refuses it. So what shell we do? You two are «closer to the source». Shall we rise this topic somewhere within Mathworks?

…

-- I strongly condemn Hamas heinous despicable pogroms/atrocities on Israel I strongly condemn Putin's war of aggression against Ukraine. I support to deliver weapons to Ukraine's military. I support the EU and NATO membership of Ukraine.

[JohnC32]

I've asked developers within MathWorks about this (the internal tracking id is g3674608).

[ouboub]

>> "JC" == John Ciolfi ***@***.***> writes: JohnC32 left a comment (mathworks/Emacs-MATLAB-Mode#25) I've asked developers within MathWorks about this (the internal tracking id is g3674608).

Thanks!

…

-- I strongly condemn Hamas heinous despicable pogroms/atrocities on Israel I strongly condemn Putin's war of aggression against Ukraine. I support to deliver weapons to Ukraine's military. I support the EU and NATO membership of Ukraine.

[JohnC32]

The underlying system libraries used by MATLAB don't support pasting of unicode characters, thus it will be a bit before this issue is fixed.