If you try to delete a folder and the Mac warns you that it "can't be modified," you might be trying to delete an actual folder rather than a shortcut. If the icon has a little arrow badge, it is a shortcut and safe to delete.
Whether you are using Windows 10 or Windows 11, there are several simple methods to clear your icons: how to remove a shortcut from desktop