Enhance Model Loading By Providing Parallelism, Uses Optional Env Flag#36835

Merged

Cyrilvallez merged 34 commits intohuggingface:mainfrom

inf3rnus:03-18-25-parallel-model-loading

May 23, 2025

Commits on Mar 19, 2025

Commits on Mar 21, 2025

Correct times for parallelized loading, previous times were for a "hot" filesystem
inf3rnus
authored

Commits on Mar 24, 2025

Update parallel model loading so the spawn method is encapsulated. DRY up the code by leveraging get_submodule.
inf3rnus
committed
Update docs on model loading parallelism so that details on setting the multiprocessing start method are removed, now that the package handles this step internally.
inf3rnus
committed
Fix style on model loading parallelism changes.
inf3rnus
committed

Commits on Apr 30, 2025

Commits on May 1, 2025

Remove use of is_true(). Favor checking env var true values for HF_ENABLE_PARALLEL_LOADING.
inf3rnus
committed

Commits on May 22, 2025

Commits on May 23, 2025

Merge branch 'main' into 03-18-25-parallel-model-loading
Cyrilvallez
authored