ImageFieldFile.delete nicely removes all thumbnails, but it leaves behind the Source object.
This is a problem when later, a file with the same name is uploaded, and in general it's not hygienic. We can safely delete it anyway as the file itself is also being deleted, so the Source becomes meaningless.