ROCM support in Docker

[Krisseck]

Closes issue #63

Added a new docker profile for AUTOMATIC1111 / AMD Rocm support.

docker compose --profile auto-rocm up

Tried on my 7900 XTX, works okay.

Xformers has an experimental AMD support in 0.0.25, but I could not get it to work. facebookresearch/xformers@44b0d07

[Mrrwmix]

This works for me on my 6750 XT, but I have to add HSA_OVERRIDE_GFX_VERSION=10.3.0 as an ENV variable in Dockerfile.rocm

[AbdBarho]

Is this the only difference between this docker file and the nvidia one?

[Krisseck]

Additionally, all references to CodeFormer was removed, and the env variable NVIDIA_VISIBLE_DEVICES

[AbdBarho]

I think the environment variable would not make a difference in this case right?

I am wondering if we can configure this different image as a build arg instead of duplicating the entire dockerfile

[picarica]

hey man i tried testing your branch but is rx 550-580 supported? i got this error

webui-docker-auto-rocm-1  | Stable diffusion model failed to load
webui-docker-auto-rocm-1  | 
webui-docker-auto-rocm-1  | rocBLAS error: Cannot read /opt/rocm/lib/rocblas/library/TensileLibrary.dat: Illegal seek for GPU arch : gfx803
webui-docker-auto-rocm-1  |  List of available TensileLibrary Files : 

any idea how to make it supported?

i think maybe pytorch version is too new? or rocm version, but i cant find which version to install

[picarica]

i tried changin from rocm6 to rocm 5.7
and i got this error RuntimeError: "LayerNormKernelImpl" not implemented for 'Half'
sdlog.log
what did i do worngly :/

[picarica]

got it run but still uses my cpu instead of gpu
workingbutcpu.log

[hakimilg]

Do you think it would be possible to merge this feature @AbdBarho ? I would love to take advantages of the update of your repo, but still using my AMD GPU.

[AJenbo]

Confirmed on Ubuntu 24.04 with a 7800xt

[JaCoB1123]

Confirmed working on Manjaro with a 7800 GRE. I had to add HIP_VISIBLE_DEVICES=0 to the docker-compose.yml

[picarica]

Confirmed working on Manjaro with a 7800 GRE. I had to add HIP_VISIBLE_DEVICES=0 to the docker-compose.yml

where did u add that? i have issues with it working with my rx570

[JaCoB1123]

Confirmed working on Manjaro with a 7800 GRE. I had to add HIP_VISIBLE_DEVICES=0 to the docker-compose.yml

where did u add that? i have issues with it working with my rx570

I can't check the file currently, but I think it was in the base-service at the top of the file, something like this (taken from the current docker-compose.yml):

x-base_service: &base_service
    ports:
      - "${WEBUI_PORT:-7860}:7860"
    volumes:
      - &v1 ./data:/data
      - &v2 ./output:/output
    stop_signal: SIGKILL
    environment:
      - HIP-VISIBLE_DEVICES=0
    tty: true
    deploy:
      resources:
        reservations:
          devices:
              - driver: nvidia
                device_ids: ['0']
                capabilities: [compute, utility]

name: webui-docker

services:
...