Does not search Chinese, Japanese characters

[Aspire1Inspire2]

• I have searched open and closed issues for duplicates
• I am submitting a bug report for existing functionality that does not work as intended
• I have read https://github.com/signalapp/Signal-Android/wiki/Submitting-useful-bug-reports
• This isn't a feature request or a discussion topic

---

Bug description

The new signal search feature does not search Asian Characters. It only search sentence.

Steps to reproduce

• Have some complete sentences made of Asian Characters.
• search for individual character
• search returns no result.

Actual result:

• search for the whole sentence
• search return matching result.
• search return no result for characters or combination of characters

Expected result:
Search should return result for any combination of asian characters. If user searches "word1 word2" in asian characters, it is better to match any conversation where both word1 and word2 appears.

Device info

I beleieve this issue is general for all signal apps because it is built to search only roman words determined by spaces, periods, commas, etc.

Link to debug log

NA, since it is inherent limitation of the search feature implementation.

[Aspire1Inspire2]

With the latest update, it still doesn't search asian characters, only the first characters combination in a sentence. It still recognize whatever between commas or periods as a single word. Asian characters are not formed this way.

[Aspire1Inspire2]

Issue still persist.

[Aspire1Inspire2]

Issue still persist.

[Aspire1Inspire2]

Issue still persist to this date.

[MewX]

And, English inside Chinese sentences can't be searched.

E.g. 啦啦啦abc啦啦啦
You won't find "abc" in search history.

[o3661606]

Does it related to the FTS (full-text search) engine of sqlite?

[Aspire1Inspire2]

Does it related to the FTS (full-text search) engine of sqlite?

Not sure what signal uses as backend database or how the search works, I have never read any source code.

But it seems to me that signal only search word defined/delimited by spaces. Asian language does not delimit word by space, but by human Brian.

[stale]

Is this still relevant? If so, what is blocking it? Is there anything you can do to help move it forward?

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.

[MewX]

Yes, it is still relevant. I have the same feeling that the blocker is current token parsing logic for non-space-split languages.

[stale]

Is this still relevant? If so, what is blocking it? Is there anything you can do to help move it forward?

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.

[nathancchu]

It's still relevant and not fixed yet