Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CI] EsqlSpecIT test {rerank.Reranker using another sort order SYNC} failing #126363

Closed
elasticsearchmachine opened this issue Apr 5, 2025 · 3 comments · Fixed by #126500
Closed
Assignees
Labels
:Analytics/ES|QL AKA ESQL needs:risk Requires assignment of a risk label (low, medium, blocker) Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) >test-failure Triaged test failures from CI

Comments

@elasticsearchmachine
Copy link
Collaborator

elasticsearchmachine commented Apr 5, 2025

Build Scans:

Reproduction Line:

./gradlew ":x-pack:plugin:esql:qa:server:multi-node:javaRestTest" --tests "org.elasticsearch.xpack.esql.qa.multi_node.EsqlSpecIT" -Dtests.method="test {rerank.Reranker using another sort order SYNC}" -Dtests.seed=158FF6085345BBBA -Dtests.locale=af-Latn-ZA -Dtests.timezone=IET -Druntime.java=24

Applicable branches:
main

Reproduces locally?:
N/A

Failure History:
See dashboard

Failure Message:

java.lang.AssertionError: 
Data mismatch:
row 0 column 3:a list containing
row 0 column 3:0: expected <0.02222> but was <0.02273>
row 1 column 3:a list containing
row 1 column 3:0: expected <0.01515> but was <0.01493>
Actual:
book_no:keyword | title:text                                            | author:text                                 | _score:double
4536            | War and Peace (Signet Classics)                       | [John Hockenberry, Leo Tolstoy, Pat Conroy] | 0.02273      
2776            | The Devil and Other Stories (Oxford World's Classics) | Leo Tolstoy                                 | 0.01493      
5327            | War and Peace                                         | Leo Tolstoy                                 | 0.03846      

Expected:
book_no:keyword | title:text                                            | author:text                                 | _score:double
4536            | War and Peace (Signet Classics)                       | [John Hockenberry, 
[truncated]

Issue Reasons:

  • [main] 7 failures in test test {rerank.Reranker using another sort order SYNC} (4.0% fail rate in 173 executions)
  • [main] 2 failures in step part-3 (3.9% fail rate in 51 executions)
  • [main] 2 failures in pipeline elasticsearch-periodic-platform-support (50.0% fail rate in 4 executions)
  • [main] 2 failures in pipeline elasticsearch-periodic (50.0% fail rate in 4 executions)
  • [main] 2 failures in pipeline elasticsearch-pull-request (4.3% fail rate in 46 executions)

Note:
This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

@elasticsearchmachine elasticsearchmachine added :Analytics/ES|QL AKA ESQL >test-failure Triaged test failures from CI labels Apr 5, 2025
@elasticsearchmachine
Copy link
Collaborator Author

This has been muted on branch main

Mute Reasons:

  • [main] 5 failures in test test {rerank.Reranker using another sort order SYNC} (3.5% fail rate in 141 executions)
  • [main] 2 failures in step part-3 (3.9% fail rate in 51 executions)
  • [main] 2 failures in pipeline elasticsearch-pull-request (4.3% fail rate in 46 executions)

Build Scans:

elasticsearchmachine added a commit that referenced this issue Apr 5, 2025
@elasticsearchmachine
Copy link
Collaborator Author

Pinging @elastic/es-analytical-engine (Team:Analytics)

@elasticsearchmachine elasticsearchmachine added Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) needs:risk Requires assignment of a risk label (low, medium, blocker) labels Apr 5, 2025
@afoucret afoucret self-assigned this Apr 7, 2025
@dnhatn
Copy link
Member

dnhatn commented Apr 7, 2025

Fixed in #126415

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Analytics/ES|QL AKA ESQL needs:risk Requires assignment of a risk label (low, medium, blocker) Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) >test-failure Triaged test failures from CI
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants