Files deleted from Media stay Uploads on server

Files deleted in "Media" on Wordpress are not being deleted from "Uploads" folder. I deleted 40G files and they stayed in "Uploads". Tested on multiple servers. Other occurance is when I delete file and reupload file that has the same name - it adds number to title, because even if files are not in media library, they're in uploads and can't be "reuploaded".

KVM, 22.04