At this point, it most likely is your side that's lagging, I personally experience no lag except when there's a massive amount of action going on, and even then, it really has to be a lot of people on screen doing skills etc. For more stuff on helping with the lag, I recommend
this topic, read it, do as much as you can safely, and it should help.