CI: Use a custom docker container for the arm64 builder

Right now, the "configure environment" part of the build takes 5m with the default runner and 9m with the 4xlarge runner (unclear why AWS is so slow here...).

Instead of running a script every time, we should just have custom pre-built docker images which should, unless I'm mistaken, get cached.