W is right. The problem is that all of the preview images are stored in a cache file, which sometimes goes wacky, or it gets corrupted and requires a cleanup.
To fix the problem on a Windows computer:
click > Start > Search and type "disk cleanup" (without quotation marks) into the search box,
or click > Start > Accessories >Disk Cleanup.
You can run a full disk cleanup if you want, but if you just want to quickly fix the problem, scroll down until you see Thumbnails and make sure that it is checked.
Then click the Clean up system files button, wait for it to finish, and then probably log off and back on.
If you're on a MAC someone else will certainly tell you how to do it.