A solução é usar Alt + Esc
Mudará para a próxima janela aberta, ignorando as minimizadas. Mais importante, funciona mesmo se o Windows Shell desliga e Alt + Tab pára de funcionar
Unfortunately, with all this excitement attached to Alt+Tab, another hotkey has been woefully neglected. Windows 2.0 introduced the Alt+Esc hotkey. Whereas Alt+Tab lets you pick an application, Alt+Esc lets you cycle through them.
When you press Alt+Esc, the active window is sent to the bottom of the window stack, allowing the window beneath it in the z-order to become the new active window. And if the next window is a minimized window, it stays minimized. While this may sound like an annoyance, it is actually a useful device, as it lets you skip past minimized applications without having to open them.
Raymond Chen Discusses the Alt+Tab and Alt+Esc Hotkeys