Not certain which update caused the start of this issue but apparently one of the latest updates from Microsoft started the issue.  The fix appears to be if you force RDP to use TCP instead and disabled UDP.

The fix

On the client side

RunRegistry Editor (regedit)
Navigate to: HKEY_LOCAL_MACHINE\SOFTWARE\Policies\Microsoft\Windows NT\Terminal Services\Client
Create a new entry DWORD (32-bit) Value:

Name: fClientDisableUDP
Value: 1

Restart your PC and test RDP again.

This has worked on a few systems so far.