Coloque um loop com um bloco try, de forma muito simplista:
$worked = $false
while (-not $worked) {
try {
#Perform command to retry, passing -ErrorAction Stop
$worked = $true # An exception will skip this
} catch {
# Should check to retry: error record is in $_
}
}