Accelerate migration

[wanghan5]

Summary

Using batch update to accelerate migration.

Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change.

Tip

Close issue syntax: Fixes #<issue number> or Resolves #<issue number>, see documentation for more details.

Fixes #17087

Screenshots

Before	After
...	...

Checklist

Important

Please review the checklist below before submitting your pull request.

• This change requires a documentation update, included: Dify Document
• I understand that this PR may be closed in case there was no previous discussion or issues. (This doesn't apply to typos!)
• I've added a test for each change that was introduced, and I tried as much as possible to make a single atomic change.
• I've updated the documentation accordingly.
• I ran dev/reformat(backend) and cd web && npx lint-staged(frontend) to appease the lint gods

[Copilot]

Pull Request Overview

This PR speeds up data migration by implementing a batch update mechanism for plugin data migration and updating the SQL query for better performance.

• Introduced a new class method migrate_db_records that retrieves and processes records in larger batches.
• Changed the SQL query to use pagination with a last_id parameter and batch updates to improve migration speed.

Comments suppressed due to low confidence (2)

api/services/plugin/data_migration.py:152

• [nitpick] Consider renaming the loop variable 'i' to a more descriptive name such as 'row' to improve readability.

for i in rs:

api/services/plugin/data_migration.py:170

• [nitpick] The try/except block wrapping this simple string formatting operation appears redundant, as string formatting is unlikely to fail; consider removing the try/except or handling a more specific exception.

updated_value = f"{DEFAULT_PLUGIN_ID}/{provider_name}/{provider_name}"

[crazywoola]

Please fix the lint errors. :) in this PR and previous one as well.

[wanghan5]

Please fix the lint errors. :) in this PR and previous one as well.

Reformated @crazywoola