When you move your mouse over the picture in the File Upload manager, you will see cross in the right corner. Clicking on it will delete the file.