Move megatron conversion script and add rope arguments #24

loubnabnl wants to merge 5 commits intosc2-ablationsbigcode-project/transformers:sc2-ablationsfrom

conevrt-megatron-ropebigcode-project/transformers:conevrt-megatron-ropeCopy head branch name to clipboard