WSL2 localhost redirect not working

I was very excited to see preview 3 of .NET 6 come out, especially with the hot reload enabled for Blazor. Not wanting to tamper with my main Windows environment, I installed dotnet 6 into my WSL2 Ubuntu instance. And immediately discovered that I was unable to access my Blazor server endpoint from Windows via localhost.