Removing confirmations seems to be a slow process, but in 2.8 beta, you can now delete in object mode using the delete key without any confirmations: https://developer.blender.org/D3953
However, in edit mode you still have to choose a variety of deleting methods. I think they should add another function on the delete key in edit mode. There should be a default delete method chosen so no menu pops up. The default method should either be the one most used often or the’ logical’ operation (deleting a face = face deleted). However, it’s probably best to let the user choose the default deleting method.
In the mean time, there’s an add on: