To customize or change your file or folder icons in Windows 11, do the following: 3] Now click on ‘Themes’, and go to ‘Desktop Icon Settings’. 4] Once you click on ‘Desktop Icon Settings ...