the problem is you're probably running on a medium power setting (or possibly low) and it takes away either processing or networking as soon as you stop using it to conserve power.
it may do this on high settings too.
click on the battery in the bottom right, go to more power options, change plan settings, change advanced plan settings, and adjust as you see fit. Namely, the wireless adapter settings, where it may not be on max performance.