v0.6.11 #5239

takatost · 2024-06-14T19:16:30Z

takatost
Jun 14, 2024
Maintainer

✨ What’s New in v0.6.11? ✨

Hey everyone, we’ve got a fresh update for you! Version 0.6.11 is here, and it’s packed with new features, enhancements, and fixes. Let’s dive into what’s changed:

🚀 New Features

📜 Knowledge

🔥 Firecrawl Support: Use Firecrawl as a "Sync from website" solution in Knowledge by @iamjoel in feat: support firecrawl frontend code #5226 and @JohnJyong @nickscamara @guchenhe in Feat/firecrawl data source #5232.

🚀 Workflow

Note Support: Add notes directly into your workflows to enhance documentation and readability when editing or reviewing shared DSLs by @zxhlyh in feat: workflow add note node #5164.

🤖 Model Support

Jina: Support for Jina-CLIP-v1 embedding model by @sinomoe in feat: support jina-clip-v1 embedding model #5146.
Zhipu: Added GLM4 new models and Zhipu embedding-2 by @orangeclk in feat: add glm4 new models and zhipu embedding-2 #5089.
ERNIE-4.0-8K-Latest: Support for ERNIE-4.0-8K-Latest by @iamsk in support ERNIE-4.0-8K-Latest #5216.
Doubao: Support for Doubao LLM function calling by @sinomoe in feat: support doubao llm function calling #5100.
Hunyuan: Support for Hunyuan LLM models by @xielong in feat: support hunyuan llm models #5013.
SiliconFlow: Added support for SiliconFlow by @orangeclk in feat: support siliconflow #5129.
Novita.ai: Added Novita.ai as a model provider by @jasonhp in Add novita.ai as model provider #4961.

🛠️ Tools

DuckDuckGo Tools: Added DuckDuckGo image search, translate, and AI chat tools by @hjlarry in feat: add duckduckgo img search, translate, ai chat #5074.
Feishu multi-dimensional table Tools: Added Feishu multi-dimensional table operation tools by @hgnulb in feat(Tools): Add Feishu multi-dimensional table operation function #5213.

🗄️ Vector DB

TiDB Vector: Support for TiDB vector by @Weaxs in feat: support tidb vector #4588.
Chroma Vector Store: Support for Chroma vector store by @bowenliang123 in feat: support Chroma vector store #5015.
Tencent Vector DB: Support for Tencent vector DB by @quicksandznzn in feat: support tencent vector db #3568.

☁️ AWS

EKS Pod Identity: Upgraded boto3 library to support EKS Pod Identity by @nanasi880 in Upgrade boto3 library to support EKS Pod Identity. #5064.
IAM Role for Bedrock: Allow using IAM Role for Bedrock by @tmokmss in feat: allow to use IAM Role for Bedrock #5188.
AWS S3 IAM Check: Added AWS S3 IAM check by @JohnJyong in add aws s3 iam check #5174.

🏗️ API Service Infrastructures

Poetry Support: Initial support for the Poetry build tool by @MatriQ in build: initial support for poetry build tool #4513.

⚠️ In the next version, we will deprecate pip as the primary package management tool for Dify api service, currently Poetry and pip coexist.
Poetry in CI: Use Poetry as the default build system for dependency installation in CI jobs by @bowenliang123 in build: use Poetry as default build system for dependency installation in CI jobs #5088.
Pydantic Migration: Modernized validation by migrating Pydantic from 1.x to 2.x by @bowenliang123 in improve: mordernizing validation by migrating pydantic from 1.x to 2.x #4592.

Other Enhancements

Editor User Permission: New editor user permission profile by @chazzhou in feat: new editor user permission profile #4435.
Memory Messages Limit: Set default memory messages limit to infinite by @takatost in feat: set default memory messages limit to infinite #5002.
DOCX Image Handling: Improved handling of external images when extracting DOCX images by @JohnJyong in deal the external image when extract docx image #5024.
Dataset Delete Endpoint: Added dataset delete endpoint by @perzeuss in feat: add dataset delete endpoint #5048.
Knowledge Retrieval: Optimized knowledge retrieval performance by batching dataset queries by @wangiii in Optimize knowledge retrieval performance by batching dataset quries. #4917.
Jina Tools: Added optional API key, proxy server, and bypass cache parameters to Jina tools by @XiaoLey in feat: Add Optional API Key, Proxy Server, and Bypass Cache Parameters to Jina Tools #5197.
HTTP Request Fix: Fixed HTTP request delete method not working by @th3n00b13 in Fix: http_request delete method not working #4975.

For additional enhancements and updates, refer to the What's Changed section below.

Upgrade Guide

Docker compose deployments

Back up your customized docker-compose YAML file (optional)

cd docker
cp docker-compose.yaml docker-compose.yaml.$(date +%s).bak

Get the latest code from the main branch
```
git checkout main
git pull origin main
```
Stop the service，Command, please execute in the docker directory
```
docker compose down
```

Back up data

tar -cvf volumes-$(date +%s).tgz volumes

Upgrade services
```
docker compose up -d
```

Source Code deployments

Stop API server, Worker and Web frontend Server.
Get the latest code from the main branch:
```
git checkout main
git pull origin main
```

Update Python dependencies:

If using pip
```
cd api
pip install -r requirements.txt
```
If using poetry
```
cd api
poetry install
```

Then, let's run the migration script:
- If using pip
```
flask db upgrade
```
- If using poetry
```
cd api
poetry run python -m flask db upgrade
```
Finally, run API server, Worker and Web frontend Server again.

What's Changed

change "Import from text file" to "Import from file" by @harrywang in change "Import from text file" to "Import from file" #4935
feat: pricing page add llm load balancing info by @iamjoel in feat: pricing page add llm load balancing info #4942
Optimize knowledge retrieval performance by batching dataset quries. by @wangiii in Optimize knowledge retrieval performance by batching dataset quries. #4917
fix: end node limit in next step by @zxhlyh in fix: end node limit in next step #4945
fix: import error in web/app/components/header/account-setting/model-provider-page/declarations.ts by @crazywoola in fix: import error in web/app/components/header/account-setting/model-provider-page/declarations.ts #4944
chore: fix indention violations by applying E111 to E117 ruff rules by @bowenliang123 in chore: fix indention violations by applying E111 to E117 ruff rules #4925
fix: missing dataset patch parameters in settings modal by @chazzhou in fix: missing dataset patch parameters in settings modal #4901
fix: missing iterator in task pipeline by @Yeuoly in fix: missing iterator in task pipeline #4948
fixing a bug of handling header row when parsing xls file, and tune xls/xlsx parsing result to be more structured by @yc-huang in fixing a bug of handling header row when parsing xls file, and tune xls/xlsx parsing result to be more structured #3600
fix: duckduckgo search does not work by @hjlarry in fix: duckduckgo search does not work #4949
feat: support tidb vector by @Weaxs in feat: support tidb vector #4588
Typo in Knowledge settings by @WeepsDanky in Typo in Knowledge settings #4958
fix some tidb bugs by @JohnJyong in fix some tidb bugs #4960
add meta.doc_id index for tidb by @JohnJyong in add meta.doc_id index for tidb #4963
feat: add create tenant command by @takatost in feat: add create tenant command #4974
chore: rename vdb tests for PGVector and PGvectoRS by @bowenliang123 in chore: rename vdb tests for PGVector and PGvectoRS #4973
fix: gemini timeout error by @ZhouhaoJiang in fix: gemini timeout error #4955
fix: llm selector position is incorrect in not workflow app by @iamjoel in fix: llm selector position is incorrect in not workflow app #4982
feat: support login by given mail by @iamjoel in feat: support login by given mail #4991
fix: add handling for non-string type in variable template parser by @Yeuoly in fix: add handling for non-string type in variable template parser #4996
fix: typo in sd3 by @Yeuoly in fix: typo in sd3 #5000
feat: set default memory messages limit to infinite by @takatost in feat: set default memory messages limit to infinite #5002
fix: some base models cannot be selected in Azure OpenAI Service setting page by @doufa in fix: some base models cannot be selected in Azure OpenAI Service setting page #4985
fix: modal z-index and cleanup by @chazzhou in fix: modal z-index and cleanup #4978
Fix/azure blob new version by @JohnJyong in Fix/azure blob new version #5004
Fix: z-index in header by @JzoNgKVO in Fix: z-index in header #5017
deal the external image when extract docx image by @JohnJyong in deal the external image when extract docx image #5024
Fix language setting not success by @doufa in Fix language setting not success #5023
fix(style): some style issues by @HiChen404 in fix(style): some style issues #5029
feat: feature modal style by @zxhlyh in feat: feature modal style #5032
improve: generalize vector factory classes and vector type by @bowenliang123 in improve: generalize vector factory classes and vector type #5033
🔧 fix docker-compose ssrf_proxy service WARNING: You should probably remove '::/0' from the ACL named 'all' by @takuya-o in 🔧 fix docker-compose ssrf_proxy service WARNING: You should probably remove '::/0' from the ACL named 'all' #5005
fix: update presence_penalty configuration for wenxin AI ernie-4.0-8k and ernie-3.5-8k models by @XiaoLey in fix: update presence_penalty configuration for wenxin AI ernie-4.0-8k and ernie-3.5-8k models #5039
fix: issue where an error occurs when invoking TTS without selecting a voice by @takatost in fix: issue where an error occurs when invoking TTS without selecting a voice #5046
fix: wrong link to web app repo in chatflow mode by @perzeuss in fix: wrong link to web app repo in chatflow mode #5062
feat: add dataset delete endpoint by @perzeuss in feat: add dataset delete endpoint #5048
chore: update maas model provider description by @sinomoe in chore: update maas model provider description #5056
🔧 Fix(docker/volumes/ssrf_proxy/squid.conf): The squid process on ssrf_proxy docker service crashes at startup by @takuya-o in 🔧 Fix(docker/volumes/ssrf_proxy/squid.conf): The squid process on ssrf_proxy docker service crashes at startup #5050
build: initial support for poetry build tool by @MatriQ in build: initial support for poetry build tool #4513
Arabic README.md by @ra2230 in Arabic README.md #5078
fix: dependency package versions are not synchronized to requirements.txt by @takatost in fix: dependency package versions are not synchronized to requirements.txt #5084
feat: add glm4 new models and zhipu embedding-2 by @orangeclk in feat: add glm4 new models and zhipu embedding-2 #5089
Fix: infinite loading not work when message is too short by @JzoNgKVO in Fix: infinite loading not work when message is too short #5075
fix: autoHeightTextarea dimensions in Firefox by @ZuzooVn in fix: autoHeightTextarea dimensions in Firefox #4891
fix: Google HL Parameter for SearchApi by @ugyuji in fix: Google HL Parameter for SearchApi #5071
feat: add duckduckgo img search, translate, ai chat by @hjlarry in feat: add duckduckgo img search, translate, ai chat #5074
fix: Can't save prompt when update to latest #4970 by @iamjoel in fix: #4970 #5093
dalle3 add style consistency parameter by @charli117 in dalle3 add style consistency parameter #5067
fix: remote_url doesn't work for gemini by @rerorero in fix: remote_url doesn't work for gemini #5090
build: use Poetry as default build system for dependency installation in CI jobs by @bowenliang123 in build: use Poetry as default build system for dependency installation in CI jobs #5088
feat: support doubao llm function calling by @sinomoe in feat: support doubao llm function calling #5100
chore: workflow syncing modal by @zxhlyh in chore: workflow syncing modal #5108
fix(typo): misspelling by @HiChen404 in fix(typo): misspelling #5094
feat: support hunyuan llm models by @xielong in feat: support hunyuan llm models #5013
fix: select field not work when it is not required by @hjlarry in fix: select field not work when it is not required #5101
fixed a typo and grammar error in sampled app by @harrywang in fixed a typo and grammar error in sampled app #5061
Fix: fix load_yaml logging, Avoid setting the log level to warning by @fishisnow in Fix: fix load_yaml logging, Avoid setting the log level to warning #5019
chore: sync pyproject.toml from requirements.txt by @takatost in chore: sync pyproject.toml from requirements.txt #5130
remove dalle3 seed by @charli117 in remove dalle3 seed #5136
feat: support siliconflow by @orangeclk in feat: support siliconflow #5129
chore: update question classifier prompt by @0xff-dev in chore: update question classifier prompt #5137
fix localai,baichuan agent chat err Baichuan conversation error #4943 by @yanghx-git in fix localai,baichuan agent chat err #4943 #5138
chore: update qdrant_vector.py by @eltociear in chore: update qdrant_vector.py #5128
chore:add some new api version for azure openai by @leslie2046 in chore:add some new api version for azure openai #5142
feat: support jina-clip-v1 embedding model by @sinomoe in feat: support jina-clip-v1 embedding model #5146
fix: style misalignment and inconsistency by @hjlarry in fix: style misalignment and inconsistency #5149
fix: front end error when same tool is called twice at once by @chazzhou in fix: front end error when same tool is called twice at once #5068
chore(docs): fix minor small typos by @kurokobo in chore(docs): fix minor small typos #5124
Upgrade boto3 library to support EKS Pod Identity. by @nanasi880 in Upgrade boto3 library to support EKS Pod Identity. #5064
Fix: google storage init with sa and download by @kazukitakamatsu in Fix: google storage init with sa and download #5054
feat: support Chroma vector store by @bowenliang123 in feat: support Chroma vector store #5015
feat: introduce APP_MAX_EXECUTION_TIME by @Yeuoly in feat: introduce APP_MAX_EXECUTION_TIME #5167
improve: CI experience by @Yeuoly in improve: CI experience #5168
improve: mordernizing validation by migrating pydantic from 1.x to 2.x by @bowenliang123 in improve: mordernizing validation by migrating pydantic from 1.x to 2.x #4592
fix: Vertex AI Anthropic models authentication failed by @hellof20 in fix: Vertex AI Anthropic models authentication failed #4971
fix: issues by pydantic2 upgrade by @takatost in fix: issues by pydantic2 upgrade #5171
fix: JSON mode with an image doesn't work for Gemini by @rerorero in fix: JSON mode with an image doesn't work for Gemini #5169
fix: milvus_vector default dataset index_struct type from weaviate to milvus by @sagarey in fix: milvus_vector default dataset index_struct type from weaviate to milvus #5098
fix: pydantic2 error by @takatost in fix: pydantic2 error #5172
chore(deps): bump azure-identity from 1.15.0 to 1.16.1 in /api by @dependabot in chore(deps): bump azure-identity from 1.15.0 to 1.16.1 in /api #5116
refactor: Delete the dataset to verify whether it is in use by @gubinjie in refactor: Delete the dataset to verify whether it is in use #5112
chore(deps): bump authlib from 1.2.0 to 1.3.1 in /api by @dependabot in chore(deps): bump authlib from 1.2.0 to 1.3.1 in /api #5115
Chore: refactor embedded chatbot by @JzoNgKVO in Chore: refactor embedded chatbot #5125
fix(core/tools): Fix the issue with iterating over None in _transform_tool_parameters_type. by @laipz8200 in fix(core/tools): Fix the issue with iterating over None in _transform_tool_parameters_type. #5190
Fix: conversation id display & support copy by @JzoNgKVO in Fix: conversation id display & support copy #5195
Modify docs in JP by @HanqingZ in Modify docs in JP #5185
fix: workflow as tool create error by type misuse by @takatost in fix: workflow as tool create error by type misuse #5205
chore: remove bump-pydantic dependency by @bowenliang123 in chore: remove bump-pydantic dependency #5177
chore: make the Celery command more noticeable by @doufa in chore: make the Celery command more noticeable #5203
feat: allow to use IAM Role for Bedrock by @tmokmss in feat: allow to use IAM Role for Bedrock #5188
add aws s3 iam check by @JohnJyong in add aws s3 iam check #5174
feat: workflow add note node by @zxhlyh in feat: workflow add note node #5164
Add novita.ai as model provider by @jasonhp in Add novita.ai as model provider #4961
fix(model_providers/ollama): Fix OllamaLargeLanguageModel to correctly set the stop option by @laipz8200 in fix(model_providers/ollama): Fix OllamaLargeLanguageModel to correctly set the stop option #5217
support ERNIE-4.0-8K-Latest by @iamsk in support ERNIE-4.0-8K-Latest #5216
feat: Add Optional API Key, Proxy Server, and Bypass Cache Parameters to Jina Tools by @XiaoLey in feat: Add Optional API Key, Proxy Server, and Bypass Cache Parameters to Jina Tools #5197
fix: add repo check for build-push.yml by @GOODBOY008 in fix: add repo check for build-push.yml #5141
feat: support tencent vector db by @quicksandznzn in feat: support tencent vector db #3568
Update README, deploy dify with YAML file on Kubernetes by @Winson-030 in Update README, deploy dify with YAML file on Kubernetes #5131
Fix: http_request delete method not working by @th3n00b13 in Fix: http_request delete method not working #4975
feat: new editor user permission profile by @chazzhou in feat: new editor user permission profile #4435
fix: number variable cause type error in openai moderation by @rerorero in fix: number variable cause type error in openai moderation #5222
fix: workspace member's last_active should be last_active_time, but not last_login_time by @DomKing in fix: workspace member's last_active should be last_active_time, but not last_login_time #4906
chore: development script for syncing Poetry lockfile by @bowenliang123 in chore: development script for syncing Poetry lockfile #5170
feat(Tools): Add Feishu multi-dimensional table operation function by @hgnulb in feat(Tools): Add Feishu multi-dimensional table operation function #5213
feat: support firecrawl frontend code by @iamjoel in feat: support firecrawl frontend code #5226
fix: initialize site with customized icon and icon_background by @kurokobo in fix: initialize site with customized icon and icon_background #5227
fix: allow the name and icon of the web app to be set independently of that of the bot itself by @kurokobo in fix: allow the name and icon of the web app to be set independently of that of the bot itself #5225
Update README.md by @takatost in Update README.md #5228
fix: z-index by @crazywoola in fix: z-index #5229
fix: note editor italic by @zxhlyh in fix: note editor italic #5230
update tooltip by @guchenhe in update tooltip #5235
Feat/firecrawl data source by @JohnJyong in Feat/firecrawl data source #5232
version to 0.6.11 by @takatost in version to 0.6.11 #5224
fix: ExtractSetting optional value missing None as default val by @takatost in fix: ExtractSetting optional value missing None as default val #5238

New Contributors

@harrywang made their first contribution in change "Import from text file" to "Import from file" #4935
@wangiii made their first contribution in Optimize knowledge retrieval performance by batching dataset quries. #4917
@yc-huang made their first contribution in fixing a bug of handling header row when parsing xls file, and tune xls/xlsx parsing result to be more structured #3600
@ZhouhaoJiang made their first contribution in fix: gemini timeout error #4955
@takuya-o made their first contribution in 🔧 fix docker-compose ssrf_proxy service WARNING: You should probably remove '::/0' from the ACL named 'all' #5005
@XiaoLey made their first contribution in fix: update presence_penalty configuration for wenxin AI ernie-4.0-8k and ernie-3.5-8k models #5039
@ra2230 made their first contribution in Arabic README.md #5078
@rerorero made their first contribution in fix: remote_url doesn't work for gemini #5090
@fishisnow made their first contribution in Fix: fix load_yaml logging, Avoid setting the log level to warning #5019
@0xff-dev made their first contribution in chore: update question classifier prompt #5137
@yanghx-git made their first contribution in fix localai,baichuan agent chat err #4943 #5138
@kurokobo made their first contribution in chore(docs): fix minor small typos #5124
@nanasi880 made their first contribution in Upgrade boto3 library to support EKS Pod Identity. #5064
@kazukitakamatsu made their first contribution in Fix: google storage init with sa and download #5054
@laipz8200 made their first contribution in fix(core/tools): Fix the issue with iterating over None in _transform_tool_parameters_type. #5190
@HanqingZ made their first contribution in Modify docs in JP #5185
@tmokmss made their first contribution in feat: allow to use IAM Role for Bedrock #5188
@jasonhp made their first contribution in Add novita.ai as model provider #4961
@GOODBOY008 made their first contribution in fix: add repo check for build-push.yml #5141
@quicksandznzn made their first contribution in feat: support tencent vector db #3568
@Winson-030 made their first contribution in Update README, deploy dify with YAML file on Kubernetes #5131
@th3n00b13 made their first contribution in Fix: http_request delete method not working #4975
@hgnulb made their first contribution in feat(Tools): Add Feishu multi-dimensional table operation function #5213

Full Changelog: 0.6.10...0.6.11

This discussion was created from the release v0.6.11.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

v0.6.11 #5239

{{title}}

Replies: 1 comment

Select a reply

v0.6.11 #5239

takatost Jun 14, 2024 Maintainer

✨ What’s New in v0.6.11? ✨

🚀 New Features

📜 Knowledge

🚀 Workflow

🤖 Model Support

🛠️ Tools

🗄️ Vector DB

☁️ AWS

🏗️ API Service Infrastructures

Other Enhancements

Upgrade Guide

Docker compose deployments

Source Code deployments

What's Changed

New Contributors

Replies: 1 comment

takatost
Jun 14, 2024
Maintainer