Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CI] EsqlSpecIT test {rerank.Reranker using a single field SYNC} failing #126370

Closed
elasticsearchmachine opened this issue Apr 5, 2025 · 3 comments
Assignees
Labels
:Analytics/ES|QL AKA ESQL needs:risk Requires assignment of a risk label (low, medium, blocker) Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) >test-failure Triaged test failures from CI

Comments

@elasticsearchmachine
Copy link
Collaborator

elasticsearchmachine commented Apr 5, 2025

Build Scans:

Reproduction Line:

./gradlew ":x-pack:plugin:esql:qa:server:multi-node:javaRestTest" --tests "org.elasticsearch.xpack.esql.qa.multi_node.EsqlSpecIT" -Dtests.method="test {rerank.Reranker using another sort order SYNC}" -Dtests.seed=158FF6085345BBBA -Dtests.locale=af-Latn-ZA -Dtests.timezone=IET -Druntime.java=24

Applicable branches:
main

Reproduces locally?:
N/A

Failure History:
See dashboard

Failure Message:

java.lang.AssertionError: 
Data mismatch:
row 0 column 3:a list containing
row 0 column 3:0: expected <0.02222> but was <0.02273>
row 1 column 3:a list containing
row 1 column 3:0: expected <0.01515> but was <0.01493>
Actual:
book_no:keyword | title:text                                            | author:text                                 | _score:double
4536            | War and Peace (Signet Classics)                       | [John Hockenberry, Leo Tolstoy, Pat Conroy] | 0.02273      
2776            | The Devil and Other Stories (Oxford World's Classics) | Leo Tolstoy                                 | 0.01493      
5327            | War and Peace                                         | Leo Tolstoy                                 | 0.03846      

Expected:
book_no:keyword | title:text                                            | author:text                                 | _score:double
4536            | War and Peace (Signet Classics)                       | [John Hockenberry, 
[truncated]

Issue Reasons:

  • [main] 2 consecutive failures in test test {rerank.Reranker using a single field SYNC}
  • [main] 6 failures in test test {rerank.Reranker using a single field SYNC} (4.9% fail rate in 123 executions)
  • [main] 2 failures in step part-3 (12.5% fail rate in 16 executions)
  • [main] 2 failures in pipeline elasticsearch-periodic (50.0% fail rate in 4 executions)
  • [main] 2 failures in pipeline elasticsearch-pull-request (12.5% fail rate in 16 executions)

Note:
This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

@elasticsearchmachine elasticsearchmachine added :Analytics/ES|QL AKA ESQL >test-failure Triaged test failures from CI labels Apr 5, 2025
elasticsearchmachine added a commit that referenced this issue Apr 5, 2025
@elasticsearchmachine
Copy link
Collaborator Author

This has been muted on branch main

Mute Reasons:

  • [main] 5 failures in test test {rerank.Reranker using a single field SYNC} (4.1% fail rate in 122 executions)
  • [main] 2 failures in step part-3 (12.5% fail rate in 16 executions)
  • [main] 2 failures in pipeline elasticsearch-periodic (50.0% fail rate in 4 executions)
  • [main] 2 failures in pipeline elasticsearch-pull-request (12.5% fail rate in 16 executions)

Build Scans:

@elasticsearchmachine elasticsearchmachine added Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) needs:risk Requires assignment of a risk label (low, medium, blocker) labels Apr 5, 2025
@elasticsearchmachine
Copy link
Collaborator Author

Pinging @elastic/es-analytical-engine (Team:Analytics)

@afoucret afoucret self-assigned this Apr 7, 2025
@dnhatn
Copy link
Member

dnhatn commented Apr 7, 2025

Fixed in #126415

@dnhatn dnhatn closed this as completed Apr 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Analytics/ES|QL AKA ESQL needs:risk Requires assignment of a risk label (low, medium, blocker) Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) >test-failure Triaged test failures from CI
Projects
None yet
Development

No branches or pull requests

3 participants