完善框架设计文档并添加英文版 #3
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- 更新中文框架设计文档，修正架构图和组件说明 - 明确DataFlex替换LlamaFactory训练层而非添加新层 - 添加Static Mix配置说明和Weighter组件详细说明 - 修正CustomWeighter继承关系和基类方法说明 - 新增完整的英文版框架设计文档 - 包含所有核心训练器的详细配置和使用指南
haolpku
reviewed
Sep 28, 2025
|
|
||
| **Note**: Unlike standard LlamaFactory, your `.yaml` configuration file must include DataFlex-specific parameters in addition to LlamaFactory's standard training parameters. | ||
|
|
||
| ## Select Trainer Details |
There was a problem hiding this comment.
看一下我的dataflex selector，你新建左边栏加一些dataflex mixture和dataflex reweighter吧。这些不用写在framework里。framework应该是一些设计理念而并非细节
… operators - Unified quickstart documentation format across all three operators - Added consistent example configuration files and run commands - Simplified content to focus on essential dynamic_train parameters - Each quickstart now includes one representative algorithm example
- Updated framework documentation with latest information - Added tutorial files for mixer, selector, and weighter operators - Removed obsolete quickstart files and reorganized structure - Updated navigation configuration for better user experience
- Updated sidebar icons for better visual distinction: - Selector: filter icon (solar:filter-outline) - Mixer: shuffle icon (solar:shuffle-outline) - Weighter: scale icon (solar:scale-outline) - Updated quickstart pages to use lightning bolt icon (solar:bolt-outline) - Updated tutorial pages to use add circle icon (solar:add-circle-outline) - Fixed selector tutorial title from '向dataflex添加算子' to '向dataflex添加Selector' - Improved overall navigation experience with meaningful icons
- Updated English navigation configuration with consistent icons: - Selector: solar:filter-outline - Mixer: solar:shuffle-outline - Weighter: solar:scale-outline - Created missing mixer/ and weighter/ directories in English docs - Translated and updated all quickstart documents: - Added lightning bolt icons (solar:bolt-outline) - Updated command examples and configuration snippets - Synchronized with Chinese version content - Translated and updated all tutorial documents: - Added add circle icons (solar:add-circle-outline) - Complete English translations of implementation guides - Maintained consistency with Chinese documentation structure - Fixed selector tutorial title and permalink - Ensured bilingual documentation parity
- Updated framework.md: Synchronized content and structure with Chinese version - Replaced verbose English content with concise, consistent framework description - Maintained proper ASCII diagram and component hierarchy explanations - Updated usage examples to match Chinese version paths - Updated intro.md: Aligned with Chinese version content - Focused on DataFlex as data-centric training system - Emphasized three core functionalities: data selection, ratio adjustment, weight allocation - Corrected references to DataFlow vs DataFlex - Updated install.md: Minor formatting improvements for consistency - Ensured bilingual documentation parity for basic information section
- Updated VuePress dependencies to consistent rc.24 versions: - vuepress: ^2.0.0-rc.23 → ^2.0.0-rc.24 - @vuepress/bundler-vite: ^2.0.0-rc.23 → ^2.0.0-rc.24 - @vuepress/plugin-redirect: ^2.0.0-rc.23 → ^2.0.0-rc.24 - vuepress-theme-plume: ^1.0.0-rc.155 → ^1.0.0-rc.164 - Regenerated package-lock.json with consistent dependency resolution - Verified successful build with npm run docs:build - Fixes ERESOLVE dependency conflict in CI/CD pipeline
- Restore package.json to upstream original configuration - Revert to VuePress 2.0.0-rc.23 and compatible dependency versions: - vuepress: ^2.0.0-rc.23 - @vuepress/bundler-vite: ^2.0.0-rc.23 - @vuepress/plugin-redirect: ^2.0.0-rc.23 - vuepress-theme-plume: ^1.0.0-rc.155 - Remove tmp.md temporary file - Regenerate package-lock.json with upstream-compatible versions - Verified successful build despite minor version warnings - Should resolve GitHub Actions dependency conflicts
- Add .npmrc with legacy-peer-deps=true for consistent dependency resolution - Update GitHub Actions workflows to use npm ci --legacy-peer-deps: - deploy.yml: Add --legacy-peer-deps flag to npm ci command - test_for_pr.yml: Add --legacy-peer-deps flag to npm ci command - Ensures GitHub Actions uses same dependency resolution strategy as local development - Should resolve ERESOLVE dependency conflicts in CI/CD pipeline
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.