Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support Bulk Folder Import for Knowledge Base Management #14240

Open
5 tasks done
Ivan001223 opened this issue Feb 24, 2025 · 5 comments · May be fixed by #17026
Open
5 tasks done

Support Bulk Folder Import for Knowledge Base Management #14240

Ivan001223 opened this issue Feb 24, 2025 · 5 comments · May be fixed by #17026
Labels
💪 enhancement New feature or request

Comments

@Ivan001223
Copy link

Self Checks

  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
  • Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

Currently, the file upload mechanism requires manual selection of individual files (e.g., .md/.txt/.pdf) through the file picker dialog. This workflow presents three key limitations:

Low Efficiency: Users managing knowledge bases with 50+ files require 50+ manual selections

Structural Loss: Nested directory structures (e.g., /docs/API/v1/spec.md) cannot be preserved during upload

Error Prone: Manual multi-selection in system file dialogs often leads to accidental omissions

2. Additional context or comments

No response

3. Can you help us with this feature?

  • I am interested in contributing to this feature.
@dosubot dosubot bot added the 💪 enhancement New feature or request label Feb 24, 2025
@fireyanci
Copy link

me too

@mamema
Copy link

mamema commented Mar 27, 2025

...and you forgot an important point. What happens when files are updated? How to keep these in sync.
The 50 manual steps can be prevented like so (problem solving for poor men):

  • go on a windows machine and select the folder you want to ingest
  • enter * or *.pdf or whatever in the search box (file select box - upper right corner)
  • mark every file showed.
  • select import

but the file update problem isn´t solved.
What i´m doing is:

  • add every file again like described above....
  • dify isn´t able to see that some of the files are already ingested and EVERYTHING will be indexed again

This is my main pain point with dify

@Silow9 Silow9 linked a pull request Mar 28, 2025 that will close this issue
Open
5 tasks
@Silow9
Copy link

Silow9 commented Mar 28, 2025

Hello, I met the same issue and tried to fix it. I submit the pull request. If you want to try it please check the pull request.

@Ivan001223
Copy link
Author

Hello, I met the same issue and tried to fix it. I submit the pull request. If you want to try it please check the pull request.

Tks, my bro.

@Silow9
Copy link

Silow9 commented Mar 28, 2025

Hello, I met the same issue and tried to fix it. I submit the pull request. If you want to try it please check the pull request.

Tks, my bro.

My pleasure

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
💪 enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

fix: Upload a folder to knowledgebase Silow9/dify
4 participants
@mamema @Silow9 @fireyanci @Ivan001223