🏷️ Track LiteRT and LiteRT LM files

[tf-marissaw]

Track LiteRT files (.tflite) and add an additional supported LiteRT LM format for tracking as well.

[Wauplin]

Hi @tf-marissaw, from what I understood from previous discussions, .task files are the legacy file extension for LiteRT-LM, correct? I prefer not to add custom rules for them as the filename is very generic compared to the more recent .litertlm.

Regarding tracking .tflite files, this is already done with a server-side custom logic. In practice, all repos with a .tflite file is automatically tagged as tflite and download are correctly tracked (see https://huggingface.co/models?library=tflite). Having server-side custom logic is not something we want to encourage in the future, but we kept this one for historical reasons.

Therefore I don't think there is anything to change here regarding tflite / litert-lm. Hope that finds you well and let me know if you have any questions :)

[tf-marissaw]

Thank for your quick response! Our previous HuggingFace maintainer left so I have some catching up to do. I apologize if you have answered these questions previously.

For the .task files, we believe that they are still actively used so we would like them to be tracked. We don't expect to publish new models with .task but it is the main file format for an older API: MediaPipe LLM Inference API. LiteRT LM is an open source successor to this older API. Would it be appropriate for us instead to add a "MediaPipe LLM Inference API" that tracks .task instead?

It is great to hear that .tflite is already tracked! It is of course used by our classical TFLite Runtime but also by our newer LiteRT runtime. We don't want to disrupt any existing .tflite models for other users. However, we would like the ability to show on our litert-community page a "Use this model" > "Library" option for LiteRT. We have it for LiteRT LM presumably from updating "packages/tasks/src/model-libraries.ts". How do you recommend we achieve this for LiteRT given that .tflite is tracked differently?

[lu-wang-g]

Gentle ping. Any updates, @Wauplin?