Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CI] EsqlSpecIT test {rerank.Reranker before a limit ASYNC} failing #126361

Closed
elasticsearchmachine opened this issue Apr 5, 2025 · 3 comments · Fixed by #126500
Closed

[CI] EsqlSpecIT test {rerank.Reranker before a limit ASYNC} failing #126361

elasticsearchmachine opened this issue Apr 5, 2025 · 3 comments · Fixed by #126500
Assignees
Labels
:Analytics/ES|QL AKA ESQL needs:risk Requires assignment of a risk label (low, medium, blocker) Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) >test-failure Triaged test failures from CI

Comments

@elasticsearchmachine
Copy link
Collaborator

Build Scans:

Reproduction Line:

./gradlew ":x-pack:plugin:esql:qa:server:multi-node:javaRestTest" --tests "org.elasticsearch.xpack.esql.qa.multi_node.EsqlSpecIT" -Dtests.method="test {rerank.Reranker add the _score column when missing ASYNC}" -Dtests.seed=E9A81693DD813AD4 -Dtests.locale=mn-Cyrl-MN -Dtests.timezone=US/Hawaii -Druntime.java=24

Applicable branches:
main

Reproduces locally?:
N/A

Failure History:
See dashboard

Failure Message:

java.lang.AssertionError: 
Data mismatch:
row 1 column 3:a list containing
row 1 column 3:0: expected <0.02222> but was <0.02273>
row 3 column 3:a list containing
row 3 column 3:0: expected <0.01515> but was <0.01493>
Actual:
book_no:keyword | title:text                                            | author:text                                 | _score:double
5327            | War and Peace                                         | Leo Tolstoy                                 | 0.03846      
4536            | War and Peace (Signet Classics)                       | [John Hockenberry, Leo Tolstoy, Pat Conroy] | 0.02273      
9032            | War and Peace: A Novel (6 Volumes)                    | Tolstoy Leo                                 | 0.02083      
2776            | The Devil and Other Stories (Oxford World's Classics) | Leo Tolstoy                                 | 0.01493      

Expected:
book_no:keyword | title:text                                            | author:text        
[truncated]

Issue Reasons:

  • [main] 7 failures in test test {rerank.Reranker before a limit ASYNC} (5.3% fail rate in 132 executions)
  • [main] 3 failures in step part-3 (7.1% fail rate in 42 executions)
  • [main] 3 failures in pipeline elasticsearch-pull-request (7.7% fail rate in 39 executions)

Note:
This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

@elasticsearchmachine elasticsearchmachine added :Analytics/ES|QL AKA ESQL >test-failure Triaged test failures from CI labels Apr 5, 2025
@elasticsearchmachine
Copy link
Collaborator Author

This has been muted on branch main

Mute Reasons:

  • [main] 7 failures in test test {rerank.Reranker before a limit ASYNC} (5.3% fail rate in 132 executions)
  • [main] 3 failures in step part-3 (7.1% fail rate in 42 executions)
  • [main] 3 failures in pipeline elasticsearch-pull-request (7.7% fail rate in 39 executions)

Build Scans:

elasticsearchmachine added a commit that referenced this issue Apr 5, 2025
@elasticsearchmachine
Copy link
Collaborator Author

Pinging @elastic/es-analytical-engine (Team:Analytics)

@elasticsearchmachine elasticsearchmachine added Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) needs:risk Requires assignment of a risk label (low, medium, blocker) labels Apr 5, 2025
@afoucret afoucret self-assigned this Apr 7, 2025
@dnhatn
Copy link
Member

dnhatn commented Apr 7, 2025

Fixed in #126415

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Analytics/ES|QL AKA ESQL needs:risk Requires assignment of a risk label (low, medium, blocker) Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) >test-failure Triaged test failures from CI
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants