What controllers are you using where this happens? I've used an old Logitech controller, ps3, ps4, Xbox, 8bitdo, and cheap Chinese generic android controllers and there is exactly zero difference between using them on my phone and using them on a computer. They use the exact same connection protocol on a PC as they do on android so it makes no sense for it to lag on android and not PC.
Well, I never use Bluetooth to connect my controller to PC either.