Locked Files When Publishing .NET Core Apps to IIS with WebDeploy

When using Visual Studio's Publish Web Site feature with ASP.NET Core you may get frustrating errors when publishing to already running sites as files on the server are locked and can't be updated until the site is shutdown.