-
Notifications
You must be signed in to change notification settings - Fork 676
支持千问大模型并使用它作为开发的默认模型 #275
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
支持千问大模型并使用它作为开发的默认模型 #275
Conversation
2.使用 QdRant_URL 作为向量数据库 3.使用db_load.py 加载数据到向量数据库 4.可以通过launch.json 启动app-file.py 进行测试
merge the latest code to NLWeb_CN
|
@Andy0898 please read the following Contributor License Agreement(CLA). If you agree with the CLA, please reply with the following information.
Contributor License AgreementContribution License AgreementThis Contribution License Agreement (“Agreement”) is agreed to by the party signing below (“You”),
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull Request Overview
This PR removes the legacy old_code scraping and retrieval modules to make way for the new Qwen-based default model and Qdrant integration.
- Deletes all legacy scraping utilities (
expBackOffCrawl.py,example_usage.py,embedding.py,__init__.py,README.md) - Removes old retrieval clients (Snowflake, Qdrant, Postgres, OpenSearch, Milvus)
- Cleans out the
old_codedirectory entirely
Reviewed Changes
Copilot reviewed 91 out of 194 changed files in this pull request and generated no comments.
Show a summary per file
| File | Description |
|---|---|
| old_code/scraping/expBackOffCrawl.py | Legacy crawler removed |
| old_code/scraping/example_usage.py | Legacy usage examples removed |
| old_code/scraping/embedding.py | Legacy embedding script removed |
| old_code/scraping/init.py | Package initialization removed |
| old_code/scraping/README.md | Legacy documentation removed |
| old_code/retrieval/snowflake_client.py | Legacy Snowflake client removed |
| old_code/retrieval/retriever.py | Legacy unified retriever removed |
| old_code/retrieval/qdrant_retrieve.py | Legacy Qdrant retrieval helper removed |
| old_code/retrieval/qdrant.py | Legacy Qdrant client removed |
| old_code/retrieval/postgres_client.py | Legacy Postgres client removed |
| old_code/retrieval/opensearch_client.py | Legacy OpenSearch client removed |
| old_code/retrieval/milvus_client.py | Legacy Milvus client removed |
Comments suppressed due to low confidence (3)
|
related to #147 |
1.支持Qwen的embedding和llm
2.使用 QdRant_URL 作为向量数据库
3.使用db_load.py 加载数据到向量数据库
4.可以通过launch.json 启动app-file.py 进行测试