EZ Server

General Category => General Discussion => Topic started by: Chunka on October 24, 2015, 05:43:03 pm



Title: Lag was gone, now worse than ever (for me)
Post by: Chunka on October 24, 2015, 05:43:03 pm
Lag went away for a bit, then after Hate's last repop things went boom for me. Lag is horrid. Just me?


Title: Re: Lag was gone, now worse than ever (for me)
Post by: littlelongbeard on October 24, 2015, 05:46:51 pm
No it has gotten much worse for me. Zoning is taking about 5 mins per toon.


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Kruciel on October 24, 2015, 05:49:51 pm
Hate and Akka have multiple debugging scripts running on the server to try and catch any and all errors currently infecting the server. Any slight hiccup until reboot is going to cause a massive explosion of lag as a result.


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Chunka on October 25, 2015, 01:04:55 pm
Day 2, lag is one hell of a lot worse even than yesterday. Hope its still just debugging.


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Chunka on October 25, 2015, 01:59:34 pm
Thanks HB! Whatever you did lag is about gone.


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Kruciel on October 25, 2015, 09:29:33 pm
Update: Playing in Qvic solo @ 10:00 pm EST, lag is gone as is the massive lockup during mass EXP messages. Server is running smoother for me than it has been since August.  8)


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Noot on October 25, 2015, 09:50:52 pm
Parroting Kruciel, past hour has been smooth as 60fps butter videos.

I tried to find a video of 60fps butter, but I found this instead...

WTF did I just see? (https://youtu.be/2Ush-1esQ-4)


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Phah on October 25, 2015, 10:30:55 pm
I 100% regret clicking on that link.


Title: Re: Lag was gone, now worse than ever (for me)
Post by: littlelongbeard on October 26, 2015, 12:09:40 am
https://www.youtube.com/watch?v=ndsaoMFz9J4


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Mixlor on October 26, 2015, 12:28:25 am
Woot! Woot! Sounds like Hate managed to put the ban hammer down on the Lag Monster for now! Sounding great! Man.. cant wait to get back into the game!


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Brannyn on October 26, 2015, 12:29:21 am
I was not expecting the meow


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Mixlor on October 26, 2015, 03:27:56 am
Oh hell yeah! I just logged in a created a Qvic instance. I pulled all the way up to the buildings and had 25+ mobs on me. I killed them all and my latency stayed at a cool 105ms. No lag spike or desync. Working for me anyway...unlike in the past where no matter what time I logged in had lag spikes with desync after pulling 10+ mobs. Thanks a million Hate! Do tell what the issue was please! Thanks again!

Mix


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Akkadius on October 26, 2015, 07:10:47 am
I've been on vacation but I've spent some late hours in Italy to pinpoint the issue.

I located it for Hate even though it wasn't the easiest problem to locate. Once found, the behavior made perfect sense, we should see the crippling lag go away as a result.

I'm on my phone so I am not going to explain the elaborate reasoning as to why it causes an issue intermittently but in the end, we should be good for Halloween which was my goal


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Brannyn on October 26, 2015, 09:19:59 am
Nope, server is even more broken right now


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Mixlor on October 26, 2015, 09:36:00 am
Something set it back like it was before. Toons are desyncing on pulls, and I have them blinking out every 15 secs or so again. Latency is shooting up to 1769+ just standing around.

Gonna go out on a limb here Hate and ask if the scaling in the Halloween zones could be causing it? When I first logged in and entered the House Garden zone from Mr. Halloween, I did 4 pulls with over 25+ mobs just fine. As more ppl log in and try to enter the zone and farm it.. could that be causing the lag spikes as repops happen and the server has to check each mob and toons in the zone to scale to the appropriate level? Across all the instances that ppl have created that do the scaling, I could see that might cause the server to be bogged down due to all the checking and cross referencing of mob level vs group/raid level?

I managed to get about 10+ pet bosses to pop during chains so I managed to get something before the server became unplayable for me. I am happy so far.

Mix


Title: Re: Lag was gone, now worse than ever (for me)
Post by: hateborne on October 26, 2015, 11:16:45 am
Waiting on reply back from Akkadius. At this point, I've gutted things that have been in play for 6+ months. Since a lot of the lag we are seeing is EventNPC and timer related, I've torn down a LOT. Yet...zero improvement. The only thing left is a source change. From what I'm seeing based on guesstimated source update dates, EVENT_TICK was added. This causes an extra step/hit every single time a timer hits. I'm posting here in the hopes that another may be able to provide something useful from there.

https://github.com/EQEmu/Server/commit/fe0758c9843d48c98a86cd7318bd3dff53969bb6


-Hate


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Warbash on October 26, 2015, 11:42:08 am
Don't stress it Hate :) we are good. I am sure we can go clean the house and make the wives happy lol. At least that will earn us so points to play longer.


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Expletus on October 26, 2015, 11:46:51 am
It only takes me 2 mins to make my wife happy....  ;D


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Poker-ecaf on October 26, 2015, 12:32:24 pm
HAHA, comin back from like 2hour break maybe now back and directly 550MS 1 sec later 4500 MS ... and /quit ... maybe tomorrow


Title: Re: Lag was gone, now worse than ever (for me)
Post by: huffdady on October 26, 2015, 10:21:06 pm
Took about 20 min's to get all my toons logged in, took another 10 to get them all to Nexus.  Then when I zoned into the halloween zone, everyone LD'ed.......   I guess I will try tomorrow.


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Brannyn on October 27, 2015, 12:36:40 am
So Kruciel mentioned something about riposting stuff is much less laggy than ae procs. Take the berserkers out of the equation and my war stops desyncing. So mass spell damage might be part of the problem.
Also, ber ae proc has the agro decrease effect on it. That firing off hundreds of times might be part of what is creating issues.  I doubt it's the main issue since whatever fix was used before was working for awhile. But the added math onto each proc does not help at all.


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Kruciel on October 27, 2015, 01:22:26 am
It's always been that way, nothing new. Before people had zerks, they had 3 warriors rocking Anger 5 x 6 which was wayyyy more spammy.

The issue is more just combat data being sent, whether it's riposte spam, warrior getting hit, aoe procs. All of that together is getting sent to clients at different rates, and the more clients you have in a small bubble sharing the data the worse it is.


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Kruciel on October 27, 2015, 01:34:07 am
If you want to do everything you can to reduce lag in your instance, drop as many clients as you can, delete all of your other instances, and have as few boxes in range of the combat as possible.

(http://mygaming.co.za/news/wp-content/uploads/2012/04/tinfoil-hat-guy.jpg)

No but seriously, I've been without lag all day. If I log a full group on it's desync city.


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Ponzi on October 27, 2015, 06:14:36 am
^^^

Kru's right, it worked. racked up 100 tokens to get my only new box a MOF pet in the 5 hrs after i got home from work just using warrior. The sacrifice in kill speed was well worth 0 desyncs. Such a waste of AAs, but we're making the best of it. :)


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Chunka on October 27, 2015, 12:54:00 pm
Lag was fine for a bit, after Hate did the yellow text remove....then suddenly the server ate it again, about 5 mins ago.


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Chunka on October 27, 2015, 01:21:53 pm
Also, still getting the yellow hp text in all instances, Didnt get it in public grounds or nexus, getting it everywhere else (yes, new instances)


Title: Re: Lag was gone, now worse than ever (for me)
Post by: hateborne on October 27, 2015, 01:50:58 pm
I don't have the ability to restart the server, so ...again...we're stuck waiting until tomorrow to see if that helps.

I am really, REALLY sorry guys. If this persists all week, I will make the halloween and DL time up to you. I understand a lot of you took time off for the biggest event on EZ...yet it's just disappointing as hell. :-(


-Hate


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Warbash on October 27, 2015, 01:52:34 pm
No sweat Hate :) still having fun not working lol.


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Chunka on October 28, 2015, 07:31:59 am
After reboot I popped in before worth to try it out.....100 mob pull with 8 boxes in and 0 lag! Thanks Hate!

But not to jump the gun....lets see how she does under load! Only 150 on atm.


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Blurring on October 28, 2015, 10:02:43 am
(http://www.houseofstrix.com/mike/targetremains.jpg)


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Warbash on October 28, 2015, 10:39:56 am
Nope just started again as the server reached 300 toons. Same thing, high ping, blinking toons and slow zoneing.


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Kruciel on October 28, 2015, 10:43:26 am
(https://media1.giphy.com/media/rtrMrY4SzDhew/200_s.gif)


Title: Re: Lag was gone, now worse than ever (for me)
Post by: hateborne on October 28, 2015, 01:20:35 pm
Nope just started again as the server reached 300 toons. Same thing, high ping, blinking toons and slow zoneing.

(http://i.imgur.com/RG0BS1U.gif)


-Hate


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Kruciel on October 28, 2015, 01:44:21 pm
https://www.youtube.com/watch?v=oCZevpfEK5k

You will never be able to watch the movie without laughing again.

If you haven't heard this gem, welcome to the internet  :D


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Raygan on October 28, 2015, 03:51:17 pm
I just had to log off....event isn't even worth doing atm with lag as bad as it is.  Thank you for attempting this, Hate.  Shame it just isn't panning out this year.  :'(


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Expletus on October 28, 2015, 04:25:13 pm
I couldnt even log on lag was so bad.


Title: Re: Lag was gone, now worse than ever (for me)
Post by: balidet on October 28, 2015, 04:55:10 pm
Log on each toon 100% by it self....

i have found this to make things load faster...


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Akito1221 on October 28, 2015, 06:20:40 pm
I logged into each toon sitting between 500-1300 MS before pulling. Going back to sleep and checking back later.


Title: Re: Lag was gone, now worse than ever (for me)
Post by: barrettd04 on October 28, 2015, 06:42:36 pm
https://www.youtube.com/watch?v=oCZevpfEK5k

You will never be able to watch the movie without laughing again.

If you haven't heard this gem, welcome to the internet  :D

(http://i66.tinypic.com/2jcshmc.gif)


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Akkadius on October 28, 2015, 09:59:30 pm
I'll be home from vacation Friday and I can deep dive on pinpointing lag issues


Title: Re: Lag was gone, now worse than ever (for me)
Post by: warrior5 on October 28, 2015, 10:30:35 pm
Woot!


Title: Re: Lag was gone, now worse than ever (for me)
Post by: littlelongbeard on October 29, 2015, 12:13:31 am
does this mean the DBL will be put on hold? or still going for Thursday to Sunday?


Title: Re: Lag was gone, now worse than ever (for me)
Post by: Akkadius on October 29, 2015, 01:46:49 am
does this mean the DBL will be put on hold? or still going for Thursday to Sunday?

Still going, but as is