Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CI] EsqlSpecIT test {rerank.Reranker using another sort order ASYNC} failing #126362

Closed
elasticsearchmachine opened this issue Apr 5, 2025 · 3 comments · Fixed by #126500
Closed
Assignees
Labels
:Analytics/ES|QL AKA ESQL needs:risk Requires assignment of a risk label (low, medium, blocker) Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) >test-failure Triaged test failures from CI

Comments

@elasticsearchmachine
Copy link
Collaborator

Build Scans:

Reproduction Line:

./gradlew ":x-pack:plugin:esql:qa:server:multi-node:javaRestTest" --tests "org.elasticsearch.xpack.esql.qa.multi_node.EsqlSpecIT" -Dtests.method="test {rerank.Reranker add the _score column when missing ASYNC}" -Dtests.seed=E9A81693DD813AD4 -Dtests.locale=mn-Cyrl-MN -Dtests.timezone=US/Hawaii -Druntime.java=24

Applicable branches:
main

Reproduces locally?:
N/A

Failure History:
See dashboard

Failure Message:

java.lang.AssertionError: 
Data mismatch:
row 1 column 3:a list containing
row 1 column 3:0: expected <0.02222> but was <0.02273>
row 3 column 3:a list containing
row 3 column 3:0: expected <0.01515> but was <0.01493>
Actual:
book_no:keyword | title:text                                            | author:text                                 | _score:double
5327            | War and Peace                                         | Leo Tolstoy                                 | 0.03846      
4536            | War and Peace (Signet Classics)                       | [John Hockenberry, Leo Tolstoy, Pat Conroy] | 0.02273      
9032            | War and Peace: A Novel (6 Volumes)                    | Tolstoy Leo                                 | 0.02083      
2776            | The Devil and Other Stories (Oxford World's Classics) | Leo Tolstoy                                 | 0.01493      

Expected:
book_no:keyword | title:text                                            | author:text        
[truncated]

Issue Reasons:

  • [main] 8 failures in test test {rerank.Reranker using another sort order ASYNC} (6.3% fail rate in 126 executions)
  • [main] 2 failures in step part-3 (5.6% fail rate in 36 executions)
  • [main] 2 failures in pipeline elasticsearch-periodic (66.7% fail rate in 3 executions)
  • [main] 2 failures in pipeline elasticsearch-pull-request (5.9% fail rate in 34 executions)

Note:
This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

@elasticsearchmachine elasticsearchmachine added :Analytics/ES|QL AKA ESQL >test-failure Triaged test failures from CI labels Apr 5, 2025
elasticsearchmachine added a commit that referenced this issue Apr 5, 2025
@elasticsearchmachine
Copy link
Collaborator Author

This has been muted on branch main

Mute Reasons:

  • [main] 8 failures in test test {rerank.Reranker using another sort order ASYNC} (6.3% fail rate in 126 executions)
  • [main] 2 failures in step part-3 (5.6% fail rate in 36 executions)
  • [main] 2 failures in pipeline elasticsearch-periodic (66.7% fail rate in 3 executions)
  • [main] 2 failures in pipeline elasticsearch-pull-request (5.9% fail rate in 34 executions)

Build Scans:

@elasticsearchmachine
Copy link
Collaborator Author

Pinging @elastic/es-analytical-engine (Team:Analytics)

@elasticsearchmachine elasticsearchmachine added Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) needs:risk Requires assignment of a risk label (low, medium, blocker) labels Apr 5, 2025
@afoucret afoucret self-assigned this Apr 7, 2025
@dnhatn
Copy link
Member

dnhatn commented Apr 7, 2025

Fixed in #126415

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Analytics/ES|QL AKA ESQL needs:risk Requires assignment of a risk label (low, medium, blocker) Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) >test-failure Triaged test failures from CI
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants