Skip to content

Commit 28962ad

Browse files
Merge pull request #76 from graphcore-research/add-umup-slides
fix paper link in docs
2 parents 7d94472 + e691999 commit 28962ad

File tree

1 file changed

+3
-2
lines changed

1 file changed

+3
-2
lines changed

docs/index.rst

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -4,8 +4,9 @@ Unit Scaling
44
Welcome to the :code:`unit-scaling` library. This library is designed to facilitate
55
the use of the *unit scaling* and *u-µP* methods, as outlined in the papers
66
`Unit Scaling: Out-of-the-Box Low-Precision Training (ICML, 2023)
7-
<https://arxiv.org/abs/2303.11257>`_ and `u-μP: The Unit-Scaled Maximal Update Parametrization
8-
<https://arxiv.org/abs/2407.17465>`_.
7+
<https://arxiv.org/abs/2303.11257>`_ and
8+
`u-μP: The Unit-Scaled Maximal Update Parametrization
9+
<https://arxiv.org/abs/2407.17465>`_
910

1011
For a demonstration of the library, see `u-μP using the unit_scaling library
1112
<https://github.com/graphcore-research/unit-scaling/blob/main/examples/demo.ipynb>`_ — a notebook showing the definition and training of a u-µP language model, comparing against Standard Parametrization (SP).

0 commit comments

Comments
 (0)