File tree
5,855 files changed
+111852
-163299
lines changed- en
- main
- .doctrees
- api
- _modules
- data_juicer
- analysis
- config
- core
- data
- executor
- download
- format
- ops
- aggregator
- common
- deduplicator
- filter
- grouper
- mapper
- annotation
- selector
- tools
- utils
- _static
- styles
- api
- configs
- annotation
- data_juicer_recipes/alpaca_cot
- reproduced_bloom
- reproduced_redpajama
- demos
- docs
- operators
- aggregator
- deduplicator
- filter
- formatter
- grouper
- mapper
- op
- selector
- tutorial
- scripts
- thirdparty
- LLM_ecosystems
- models
- tools
- distributed_deduplication
- evaluator
- gpt_eval
- recorder
- fmt_conversion
- multimodal
- post_tuning_dialog
- hpo
- humanops
- mm_eval
- inception_metrics
- vbench_metrics
- postprocess
- preprocess
- quality_classifier
- v1.4.0
- .doctrees
- api
- _modules
- data_juicer
- analysis
- config
- core
- data
- executor
- download
- format
- ops
- aggregator
- common
- deduplicator
- filter
- grouper
- mapper
- annotation
- selector
- utils
- _static
- styles
- api
- configs
- annotation
- data_juicer_recipes/alpaca_cot
- reproduced_bloom
- reproduced_redpajama
- demos
- docs
- tutorial
- scripts
- thirdparty
- LLM_ecosystems
- models
- tools
- distributed_deduplication
- evaluator
- gpt_eval
- recorder
- fmt_conversion
- multimodal
- post_tuning_dialog
- hpo
- humanops
- mm_eval
- inception_metrics
- vbench_metrics
- postprocess
- preprocess
- quality_classifier
- v1.4.1
- .doctrees
- api
- _modules
- data_juicer
- analysis
- config
- core
- data
- executor
- download
- format
- ops
- aggregator
- common
- deduplicator
- filter
- grouper
- mapper
- annotation
- selector
- tools
- utils
- _static
- styles
- api
- configs
- annotation
- data_juicer_recipes/alpaca_cot
- reproduced_bloom
- reproduced_redpajama
- demos
- docs
- tutorial
- scripts
- thirdparty
- LLM_ecosystems
- models
- tools
- distributed_deduplication
- evaluator
- gpt_eval
- recorder
- fmt_conversion
- multimodal
- post_tuning_dialog
- hpo
- humanops
- mm_eval
- inception_metrics
- vbench_metrics
- postprocess
- preprocess
- quality_classifier
- v1.4.2
- .doctrees
- api
- _modules
- data_juicer
- analysis
- config
- core
- data
- executor
- download
- format
- ops
- aggregator
- common
- deduplicator
- filter
- grouper
- mapper
- annotation
- selector
- tools
- utils
- _static
- styles
- api
- configs
- annotation
- data_juicer_recipes/alpaca_cot
- reproduced_bloom
- reproduced_redpajama
- demos
- docs
- tutorial
- scripts
- thirdparty
- LLM_ecosystems
- models
- tools
- distributed_deduplication
- evaluator
- gpt_eval
- recorder
- fmt_conversion
- multimodal
- post_tuning_dialog
- hpo
- humanops
- mm_eval
- inception_metrics
- vbench_metrics
- postprocess
- preprocess
- quality_classifier
- v1.4.3
- .doctrees
- api
- _modules
- data_juicer
- analysis
- config
- core
- data
- executor
- download
- format
- ops
- aggregator
- common
- deduplicator
- filter
- grouper
- mapper
- annotation
- selector
- tools
- utils
- _static
- styles
- api
- configs
- annotation
- data_juicer_recipes/alpaca_cot
- reproduced_bloom
- reproduced_redpajama
- demos
- docs
- operators
- aggregator
- deduplicator
- filter
- formatter
- grouper
- mapper
- op
- selector
- tutorial
- scripts
- thirdparty
- LLM_ecosystems
- models
- tools
- distributed_deduplication
- evaluator
- gpt_eval
- recorder
- fmt_conversion
- multimodal
- post_tuning_dialog
- hpo
- humanops
- mm_eval
- inception_metrics
- vbench_metrics
- postprocess
- preprocess
- quality_classifier
- zh_CN/main
- .doctrees
- api
- _modules/data_juicer
- analysis
- config
- core
- data
- executor
- download
- format
- ops
- aggregator
- common
- deduplicator
- filter
Some content is hidden
Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
5,855 files changed
+111852
-163299
lines changedBinary file not shown.
Binary file not shown.
Binary file not shown.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | | - | |
4 | | - | |
| 3 | + | |
| 4 | + | |
5 | 5 | | |
6 | | - | |
| 6 | + | |
7 | 7 | | |
8 | | - | |
| 8 | + | |
9 | 9 | | |
10 | 10 | | |
11 | | - | |
| 11 | + | |
12 | 12 | | |
13 | 13 | | |
14 | 14 | | |
| |||
24 | 24 | | |
25 | 25 | | |
26 | 26 | | |
27 | | - | |
28 | | - | |
| 27 | + | |
| 28 | + | |
29 | 29 | | |
30 | 30 | | |
31 | 31 | | |
32 | 32 | | |
33 | | - | |
34 | | - | |
| 33 | + | |
| 34 | + | |
35 | 35 | | |
36 | 36 | | |
37 | 37 | | |
| |||
148 | 148 | | |
149 | 149 | | |
150 | 150 | | |
151 | | - | |
152 | | - | |
153 | | - | |
154 | | - | |
155 | | - | |
156 | | - | |
157 | | - | |
158 | | - | |
| 151 | + | |
| 152 | + | |
| 153 | + | |
| 154 | + | |
159 | 155 | | |
160 | 156 | | |
161 | 157 | | |
| |||
165 | 161 | | |
166 | 162 | | |
167 | 163 | | |
168 | | - | |
169 | | - | |
| 164 | + | |
170 | 165 | | |
171 | 166 | | |
172 | 167 | | |
173 | 168 | | |
174 | 169 | | |
175 | 170 | | |
176 | 171 | | |
177 | | - | |
178 | | - | |
| 172 | + | |
179 | 173 | | |
180 | 174 | | |
181 | 175 | | |
182 | 176 | | |
183 | 177 | | |
184 | 178 | | |
185 | 179 | | |
186 | | - | |
187 | | - | |
| 180 | + | |
188 | 181 | | |
189 | 182 | | |
190 | 183 | | |
| |||
249 | 242 | | |
250 | 243 | | |
251 | 244 | | |
252 | | - | |
| 245 | + | |
253 | 246 | | |
254 | 247 | | |
255 | 248 | | |
| |||
339 | 332 | | |
340 | 333 | | |
341 | 334 | | |
342 | | - | |
343 | | - | |
| 335 | + | |
344 | 336 | | |
345 | 337 | | |
346 | 338 | | |
347 | 339 | | |
348 | 340 | | |
349 | 341 | | |
350 | 342 | | |
351 | | - | |
352 | | - | |
| 343 | + | |
353 | 344 | | |
354 | 345 | | |
355 | 346 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | | - | |
4 | | - | |
5 | | - | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
6 | 6 | | |
7 | | - | |
| 7 | + | |
8 | 8 | | |
9 | 9 | | |
10 | | - | |
| 10 | + | |
11 | 11 | | |
12 | 12 | | |
13 | 13 | | |
| |||
23 | 23 | | |
24 | 24 | | |
25 | 25 | | |
26 | | - | |
27 | | - | |
| 26 | + | |
| 27 | + | |
28 | 28 | | |
29 | 29 | | |
30 | 30 | | |
31 | 31 | | |
32 | | - | |
33 | | - | |
| 32 | + | |
| 33 | + | |
34 | 34 | | |
35 | 35 | | |
36 | 36 | | |
| |||
147 | 147 | | |
148 | 148 | | |
149 | 149 | | |
150 | | - | |
151 | | - | |
152 | | - | |
153 | | - | |
154 | | - | |
155 | | - | |
156 | | - | |
157 | | - | |
| 150 | + | |
| 151 | + | |
| 152 | + | |
| 153 | + | |
158 | 154 | | |
159 | 155 | | |
160 | 156 | | |
| |||
164 | 160 | | |
165 | 161 | | |
166 | 162 | | |
167 | | - | |
168 | | - | |
| 163 | + | |
169 | 164 | | |
170 | 165 | | |
171 | 166 | | |
172 | 167 | | |
173 | 168 | | |
174 | 169 | | |
175 | 170 | | |
176 | | - | |
177 | | - | |
| 171 | + | |
178 | 172 | | |
179 | 173 | | |
180 | 174 | | |
181 | 175 | | |
182 | 176 | | |
183 | 177 | | |
184 | 178 | | |
185 | | - | |
186 | | - | |
| 179 | + | |
187 | 180 | | |
188 | 181 | | |
189 | 182 | | |
| |||
248 | 241 | | |
249 | 242 | | |
250 | 243 | | |
251 | | - | |
| 244 | + | |
252 | 245 | | |
253 | 246 | | |
254 | 247 | | |
| |||
332 | 325 | | |
333 | 326 | | |
334 | 327 | | |
335 | | - | |
336 | | - | |
| 328 | + | |
337 | 329 | | |
338 | 330 | | |
339 | 331 | | |
340 | 332 | | |
341 | 333 | | |
342 | 334 | | |
343 | 335 | | |
344 | | - | |
345 | | - | |
| 336 | + | |
346 | 337 | | |
347 | 338 | | |
348 | 339 | | |
| |||
0 commit comments