When PowerShellGet v1 fails to install the NuGet Provider

Recently there's been a number of users who have encountered a particular bug with PowerShellGet 1.0.0.1 in Windows PowerShell. This bug occurs when you try to to use a PowerShellGet cmdlet that is dependent on PackageManagement, including cmdlets such as Find-Module,