Marrying Kubernates and AWS on Windows

— disclaimer — 
I'm not sure if it's the correct topic, so if it's not please direct me to the correct one. 
Also, yes, I know that these things work better on Linux, but I'm stuck with this setup for now so I need help.
– disclaimer end — 

Hey guys. 
I've lost access to my Ubuntu machine and the fine setup I had on it and am forced to work on Win11 at least for the time being. I'm setting things up here and ran into a bit of an issue with K8s and AWS plugins. 
My company's projects run on AWS EKS with developers using SSO profiles to access them. Thus kubectl uses those profiles to access the clusters. 
On Ubuntu I just use `aws sso login` from the IDE console and the K8S plugin gets access to everything no problem. But on Win11 I can't seem to get it working. I installed both kubectl and AWS CLI and am using Powershell7 for the SSO but even then the K8S clusters refresh doesn't seem to work. 
kubectl get pods returns an error 

E0530 20:40:54.493401   30840 memcache.go:265] couldn't get current server API group list: Get "http://localhost:8080/api?timeout=32s": dial tcp [::1]:8080: connectex: No connection could be made because the target machine actively refused it.

Why is it trying to connect to the local cluster if the address is set in the context? 
Am I missing something or is it just not feasible in Windows?