How to delete materials entirely?

In the materials panel, in the drop down you get when you hit the grey button on the left, there are materials that I wan’t to delete. But I can’t figure out how to do that. Help?

Select the material, holding shift press the X button, save your blend file and re-open it