A confirmation dialog asks if you really want to delete the gradient. Remember that sometimes you cannot actually delete the gradient because you lack the necessary rights to the file. But you better be sure (especially under Win32) because you will not be able to undo the delete. However, if you are not entitled to delete the Gradient, it will be deleted from the rest of your present GIMP Session and reappear the next time you start GIMP.