Skip to content

Making snapshot store/restore rate dynamic #18069

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

kkewwei
Copy link
Collaborator

@kkewwei kkewwei commented Apr 24, 2025

Description

How to use:

1.create repository

POST /_snapshot/my-fs-repository/
{
  "type": "fs",
  "settings": {
    "location": "/Users/xxx/Downloads/snap_data1/1",
     "max_restore_bytes_per_sec": "100mb",
     "max_snapshot_bytes_per_sec": "100mb"
  }
}

2.adjust the store and restore rate

POST /_snapshot/my-fs-repository/
{
  "type": "fs",
  "settings": {
    "location": "/Users/xxx/Downloads/snap_data1/1",
     "max_restore_bytes_per_sec": "50mb",
     "max_snapshot_bytes_per_sec": "50mb"
  }
}

or 

POST /_snapshot/my-fs-repository/
{
  "type": "fs",
  "settings": {
     "max_restore_bytes_per_sec": "50mb",
     "max_snapshot_bytes_per_sec": "50mb"
  }
}

Note:

  • Only max_snapshot_bytes_per_sec and max_restore_bytes_per_sec in settings can be changed, which will adjust the rate of ongoing snapshot. Other parameters within the settings can be left default or kept consistent.
  • If other parameters within the settings are also changed, it will have no impact on the rate of existing snapshots.

Related Issues

Resolves #17488

Check List

  • Functionality includes testing.
  • API changes companion pull request created, if applicable.
  • Public documentation issue/PR created, if applicable.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Copy link
Contributor

❌ Gradle check result for fc25085: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

@kkewwei kkewwei force-pushed the snapshot_rate_dynamic3 branch from fc25085 to 214486f Compare April 24, 2025 13:25
Copy link
Contributor

❌ Gradle check result for 7a20142: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

Copy link
Contributor

✅ Gradle check result for 7a20142: SUCCESS

@kkewwei kkewwei force-pushed the snapshot_rate_dynamic3 branch 3 times, most recently from 1d41354 to 3b763c5 Compare May 22, 2025 06:47
Copy link
Contributor

❌ Gradle check result for 3b763c5: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

@kkewwei kkewwei force-pushed the snapshot_rate_dynamic3 branch from 3b763c5 to 88dad9f Compare May 22, 2025 10:21
Copy link
Contributor

❌ Gradle check result for 88dad9f: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

@kkewwei kkewwei force-pushed the snapshot_rate_dynamic3 branch from 88dad9f to 0971aec Compare May 22, 2025 13:22
Signed-off-by: kkewwei <[email protected]>
Signed-off-by: kkewwei <[email protected]>
@kkewwei kkewwei force-pushed the snapshot_rate_dynamic3 branch from 0971aec to bd1f43c Compare May 22, 2025 13:35
Copy link
Contributor

❌ Gradle check result for bd1f43c: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

@kkewwei kkewwei closed this May 22, 2025
@github-project-automation github-project-automation bot moved this from 🏗 In progress to ✅ Done in Storage Project Board May 22, 2025
@kkewwei kkewwei reopened this May 22, 2025
@github-project-automation github-project-automation bot moved this from ✅ Done to 🏗 In progress in Storage Project Board May 22, 2025
Copy link
Contributor

❌ Gradle check result for bd1f43c:

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

@kkewwei kkewwei closed this May 23, 2025
@github-project-automation github-project-automation bot moved this from 🏗 In progress to ✅ Done in Storage Project Board May 23, 2025
@kkewwei kkewwei reopened this May 23, 2025
@github-project-automation github-project-automation bot moved this from ✅ Done to 🏗 In progress in Storage Project Board May 23, 2025
Copy link
Contributor

✅ Gradle check result for bd1f43c: SUCCESS

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Enhancement or improvement to existing feature or request Storage:Snapshots
Projects
Status: 🏗 In progress
Development

Successfully merging this pull request may close these issues.

[Feature Request] Making snapshot store/restore rate dynamic
5 participants