Como @MarkPlotnick apontou, você pode usar padrões glob. De man zip
:
zip -d foo foo/tom/junk foo/harry/\* \*.o
will remove the entry foo/tom/junk, all of the files that start with foo/harry/, and all of the files that end with .o (in any path).