I had been looking through my steam games list and took notice of just how many games I have installed that don't have any artwork for them. Most of them are just old HL mods (like NS1 for example), and a few are 3rd party games that I have added to my steam games list. The old HL mods won't allow me to add icons for. But the 3rd party games you can.
Anyway, I found this great sight for getting all that artwork content from. It's called
Steam Grid DB.
Each game in your inventory has an APP ID. Right click on the game of choice and select "Properties" from the menu. Then click the "Updates" tab on the left. This will show you the APP ID number. You then go to your games drive/program files/Steam/appcache/librarycache/ and look for that ID number. If it doesn't have one, you have to make it. Go to steamgriddb and find the game you are looking for and pick the artwork you like and add it to that specific app id folder. Once you get the artwork you want, click the customization tab for that game and add your new artwork manually.
Keep in mind, your steam games icons have to be 32x32 and have to be in .jpg or .ico format to work. If you grab games menu icons from steamgriddb, make sure that when you download the icon, change the file type to ".jpg"before accepting the download.