You can delete the ones with the zip extension without causing any problems, but I would suggest not doing that until after you have used/tested/installed the file extracted from the zip file.
I personally don't get rid of them as they can be used again if something should corrupt the file or program obtained from the zip file. But if you are limited on hard drive space, it would make sense to delete them once you are done whit them.