Deepseek moe jax Training code

[Lisennlp]

Hello, Do you have plan to open deepseek moe training code?

[markian-rybchuk]

There are plans to make the models differentiable relatively soon