Note that this will remove any controls you had set for the icons.
Just look at all the items in the list…
I don’t even have some of those applications installed anymore.
Select both of them and delete them.
Now go to the File menu, choose New Task and punch in in explorer into the open box.
Hit enter, and explorer should restart itself.
Note that some icons might disappear entirely until you reboot your box.