Consegui excluir a pasta no final seguindo as etapas abaixo:
1) ended explorer.exe process
2) pressed CTRL+SHITF+ESC to run Task Manager
3) ran powershell.exe as an admin
4) ran get-item -path "\server\drive$\folder" | remove-item -force -verbose
5) started explorer.exe back