O readline command unix-filename-rubout faz exatamente isso:
Kill the word behind point, using white space and the slash character as the word boundaries. The killed text is saved on the kill-ring.
Você só precisa ligá-lo a Escape - Backspace . Basta adicionar a ~/.inputrc :
"\e\C-?": unix-filename-rubout