EZ Server

General Category => Updates => Topic started by: Hunter on September 01, 2010, 11:49:44 pm



Title: CRASH!
Post by: Hunter on September 01, 2010, 11:49:44 pm
Yeah, I killed the server. Was working on LDoN Instances and umm, yeah, whole thing took a dump. Need to bring down server and reboot.


Title: Re: CRASH!
Post by: ieawenpo on September 01, 2010, 11:52:59 pm
LOL, had 2 full groups in t3 taking out a boss and wamo!


Title: Re: CRASH!
Post by: ieawenpo on September 02, 2010, 12:00:34 am
dude, i totally lost a cyan on that one :P


Title: Re: CRASH!
Post by: ieawenpo on September 02, 2010, 12:03:49 am
Still appreciate the hard work youre putting into it!


Title: Re: CRASH!
Post by: Otaduke on September 02, 2010, 12:06:35 am
in the middle of an RoA run 55 up to 70. Thought someone crashed the zone again but then found this posted.


Title: Re: CRASH!
Post by: walk2k on September 02, 2010, 12:08:02 am
Ctrl-Alt-Ice cream sandwich in the keyboard


Title: Re: CRASH!
Post by: Mghargh on September 02, 2010, 12:14:16 am
How long do you think it will be?


Title: Re: CRASH!
Post by: Chunka on September 02, 2010, 12:15:24 am
I estimate it'll be around 1 to 5 minutes after he fixes the issue, the server will be back up.

Just spitballin.


Title: Re: CRASH!
Post by: ieawenpo on September 02, 2010, 12:16:28 am
Time for bed.
Night EZ (http://forums.offtopic.com/images/smilies/wavey.gif)


Title: Re: CRASH!
Post by: Hunter on September 02, 2010, 12:18:26 am
I may have killed our database. Not sure yet. Might need to revert to our 3am back up (22 hours ago).


Title: Re: CRASH!
Post by: Fatboy5706 on September 02, 2010, 12:20:46 am
noooooo


Title: Re: CRASH!
Post by: Sineroth on September 02, 2010, 12:21:08 am
WoW 3am back up thats just a few hours BEFORE i got my 2.0 man am i sad


Title: Re: CRASH!
Post by: MarkR on September 02, 2010, 12:22:28 am
maybe, just maybe, since it is a holiday, AND if we have to revert to a back up, double loot weekend starting early ??


Title: Re: CRASH!
Post by: Lored on September 02, 2010, 12:24:25 am
Well there goes my first level 70, my epic 1.5, and the majority of my CG items turned in. Oh and my 2.0 book. Yay, I'm thrilled!


Title: Re: CRASH!
Post by: Mghargh on September 02, 2010, 12:25:26 am
Oh damn, that'll smart.  :'(


Title: Re: CRASH!
Post by: Fatboy5706 on September 02, 2010, 12:26:08 am
Well there goes my first level 70, my epic 1.5, and the majority of my CG items turned in. Oh and my 2.0 book. Yay, I'm thrilled!

you should be thrilled, after harassing me in OOT... im losing my 3.0 and a full cg set i was getting ready to sell


Title: Re: CRASH!
Post by: lerxst2112 on September 02, 2010, 12:26:17 am
Geez guys, don't panic yet.  

I'll lose some stuff too if there's a rollback, but it's just some time to get it back.


Title: Re: CRASH!
Post by: Othose on September 02, 2010, 12:27:09 am
wow and i thought i was losing allot with 1.5 and half of a Cg and Fg set


Title: Re: CRASH!
Post by: Aluana on September 02, 2010, 12:28:26 am
losing 2.0. 2.5, 3.0, and PoDragons gear, on my first level 70 on this server.

this must be my welcome gift :P


i love it.


Title: Re: CRASH!
Post by: Fatboy5706 on September 02, 2010, 12:30:42 am
oh and about 300 aa


Title: Re: CRASH!
Post by: walk2k on September 02, 2010, 12:32:03 am
Well *cough* if you really did all that in less than 1 day.... you can easily do it again, right?


Title: Re: CRASH!
Post by: Aluana on September 02, 2010, 12:32:45 am
eh, my guild helped me with it all, random act of kindness, not sure if that'll happen again for a while :)


Title: Re: CRASH!
Post by: ieawenpo on September 02, 2010, 12:34:45 am
im available to help with everything for those who lost items if the dbase cant be restored.
No promises but if im available i will help anyone i can.


Title: Re: CRASH!
Post by: Aluana on September 02, 2010, 12:35:34 am
im available to help with everything for those who lost items if the dbase cant be restored.
No promises but if im available i will help anyone i can.

that's very generous of you to do for people :)

rock on


Title: Re: CRASH!
Post by: Lored on September 02, 2010, 12:37:08 am
Aye,

Thank you kind sir!


Title: Re: CRASH!
Post by: menehuni on September 02, 2010, 12:37:44 am
If this is the case, I will be back at 5k plat. I will be selling 1.5-3.0 runs (no 2.0 ldon runs) for some plat. PST to hustlin/nobox/frshtadeath


Title: Re: CRASH!
Post by: tab on September 02, 2010, 12:39:27 am
Oh, man.  Please don't let this be so.  I got so much done today >.<

EDIT:  If anyone wants a leveling buddy in BoT, hit up Juruumpu.  I've got a bunch of levels, items, and AA to get again :P


Title: Re: CRASH!
Post by: Rostam on September 02, 2010, 12:41:39 am
im available to help with everything for those who lost items if the dbase cant be restored.
No promises but if im available i will help anyone i can.

I'm with Ieawenpo, i'm available every morning for help from 3 to 3:15 AM PST. ;D


Title: Re: CRASH!
Post by: Rostam on September 02, 2010, 12:43:30 am
i rolled a pally and got him to 70, i dont mind losing him i'll just redo it but if i lose the complete FG set i got for him and the 400k i made from selling the T2 BP ...


Title: Re: CRASH!
Post by: Fatboy5706 on September 02, 2010, 12:45:37 am
Well *cough* if you really did all that in less than 1 day.... you can easily do it again, right?


why, yes i can, but man i was so close to maxing out aas tonight, was redoing my epic up to 2.0 for pet buff and on and off i was aaing... took me about 12-15 of non stop playing yes, but, i guess i can do the same exact thing tomorrow, so, if you want to question what ive done today, do it.


Title: Re: CRASH!
Post by: Hunter on September 02, 2010, 12:47:19 am
I made a full backup of what we currently have. Then I wiped our current database, and I'm restoring from our 6am backup yesterday (actually, was about 20 hrs ago). If this works, I can put in the inventory table from before the wipe so nobody will lose their items. Same with qglobals table too if thats not screwed up, which holds your flags (CG, FG, 3.0, etc).

Hopefully 6am back up works, then I'll take down the server, put in the inventory, and boot up again.

Hunter


Title: Re: CRASH!
Post by: tab on September 02, 2010, 12:50:30 am
I made a full backup of what we currently have. Then I wiped our current database, and I'm restoring from our 6am backup yesterday (actually, was about 20 hrs ago). If this works, I can put in the inventory table from before the wipe so nobody will lose their items. Same with qglobals table too if thats not screwed up, which holds your flags (CG, FG, 3.0, etc).

Hopefully 6am back up works, then I'll take down the server, put in the inventory, and boot up again.

Hunter

Cool deal, sir.  Thanks for the update!


Title: Re: CRASH!
Post by: Artimis on September 02, 2010, 12:50:52 am
Doh! Finished my new warrior's 3.0s, FG, qvic gear (minus helm, damn you helm!), 6 peices of Tacvi gear, and was just about to take her cute butt into PoD for the 1st time today!

Such is life I suppose :) Will get it back.

I will probably be starting a new Qvic guild instance when the servers come back up. If you lost gear and don't need plate legs or helm I will have three spots in my group to bring folks along. As long as you don't mind temporarily being a member of Zerg Force D of course :D Send me a tell! (Try Arees 1st)

This is all assuming Hunters amazingly awesome plan somehow fails, but I have faith that it will not! <3 Hunter



Title: Re: CRASH!
Post by: Jonat on September 02, 2010, 12:51:09 am
<3 u


Title: Re: CRASH!
Post by: Othose on September 02, 2010, 12:51:20 am
Hope it works. Thanks for the hard work.. now WORK HARDER......  :P


Title: Re: CRASH!
Post by: Lanaki on September 02, 2010, 12:51:48 am
YESS!! there is a god! (Hunter)
 :o  ;D


Title: Re: CRASH!
Post by: Aluana on September 02, 2010, 12:52:39 am
@Hunter

You're the Maniacal Technological equivalent to chuck norris.
and that's the truth


Title: Re: CRASH!
Post by: Hunter on September 02, 2010, 12:53:36 am
SUCCESS!

Backup worked.

I quickly took down the database so I can restore peoples flags and items.

Anyone who created a character after last 6am backup will be completely lost.

Server coming up again soon.

Hunter


Title: Re: CRASH!
Post by: tab on September 02, 2010, 12:54:34 am
Life is awesome.


Title: Re: CRASH!
Post by: Lored on September 02, 2010, 12:55:42 am
Actually his idea is very sound imo. He said he was working on LDoN content, which hopefully shouldn't have messed with the inventory table, but I'm kinda sketchy as to whether it messed with the qglobals table or not. Not all too familiar with EQEmu code, but I am familiar with databases. Goodluck with it Hunter!

EDIT: Ooops hit the post button a tad bit late lol. Goodjob though, toobad my character is gone gone gone :(


Title: Re: CRASH!
Post by: Artimis on September 02, 2010, 12:56:15 am
SUCCESS!

Backup worked.

I quickly took down the database so I can restore peoples flags and items.

Anyone who created a character after last 6am backup will be completely lost.

Server coming up again soon.

Hunter

Hm, I think I love you Hunter. Very nice!


Title: Re: CRASH!
Post by: Aluana on September 02, 2010, 12:58:47 am
Actually his idea is very sound imo. He said he was working on LDoN content, which hopefully shouldn't have messed with the inventory table, but I'm kinda sketchy as to whether it messed with the qglobals table or not. Not all too familiar with EQEmu code, but I am familiar with databases. Goodluck with it Hunter!

EDIT: Ooops hit the post button a tad bit late lol. Goodjob though, toobad my character is gone gone gone :(
i've got a 21 pally on my box account i've been meaning to level. i'll level it with you back up to 70

-Pweas
-Pwomise


Title: Re: CRASH!
Post by: Lored on September 02, 2010, 01:00:20 am
Sounds good to me. Gonna try and expedite the process this time and probably going to box two characters to have two 70s this time :-P Thanks Pwease!


Edit: Heh, guess I was 70 when the backup was done. AWESOMENESS! Now I just have a ton of AA's to get :-X


Title: Re: CRASH!
Post by: Hunter on September 02, 2010, 01:03:27 am
FIXED!

Only took 1 hr 10 minutes to figure out there was a record in the qglobals table that had a null value on the name field. I know the quest code that did it too when I was creating instances for LDoN, so that wont happen again.

Inventory and Flags should be restored.

Anyone that created a character after the last 6am reboot will be lost cause we reverted back to that backup then restored inventory + flags from before the wipe/fix to figure out the problem.

Keep me posted via email if serious problems.

Hunter


Title: Re: CRASH!
Post by: Mghargh on September 02, 2010, 01:04:36 am
It's UP!!

YEAAAAA!!

Thankee muchly Hunter!

Especially for the O-Dark working!


Title: Re: CRASH!
Post by: Hunter on September 02, 2010, 01:05:43 am
Character table wasn't restored, so oh yeah, levels and AA are not reimbursed, but at least you have all your items and flags. Yay for backup.


Title: Re: CRASH!
Post by: Fatboy5706 on September 02, 2010, 01:14:44 am
bank didnt back up


Title: Re: CRASH!
Post by: Lored on September 02, 2010, 01:15:40 am
Hunter, we got a problem with money missing, and someone mentioned something about bank inventory too.


Title: Re: CRASH!
Post by: Mghargh on September 02, 2010, 01:16:38 am
Erp?


Title: Re: CRASH!
Post by: Aluana on September 02, 2010, 01:17:23 am
screeeeeeeeeeeeeech

and there she blows

lol down again.


Title: Re: CRASH!
Post by: Lored on September 02, 2010, 01:18:11 am
Was shutdown on purpose this time. Think he figured out how to fix a problem or is looking into how to fix it. Hope for the best and prepare for the worst!


Title: Re: CRASH!
Post by: Hunter on September 02, 2010, 01:18:27 am
Money was saved in char profile. Going to try and restore peoples characters in addition to inventory and flags.


Title: Re: CRASH!
Post by: Lored on September 02, 2010, 01:19:19 am
If you made a backup of what the database looked like at time of crash, why not just throw up that backup and fix the nullstring?


Title: Re: CRASH!
Post by: Othose on September 02, 2010, 01:20:31 am
hope I get to keep that SMR I just picked up


Title: Re: CRASH!
Post by: Mghargh on September 02, 2010, 01:21:57 am
My knowledge of the EQ code is minimal but not all datastrings are easy to do that with.


Title: Re: CRASH!
Post by: Hunter on September 02, 2010, 01:23:37 am
LDoN Instances are 99% done.

I got them working 100%, via hail, for free, so I moved the code down to sub EVENT_ITEM so that you have to pay plat for the instance, but I forgot to copy and paste some variables there that are using in the naming of the qglobals, therefore a record in the qglobals table was create with a null value for name, thus crashing everything. That part is now fixed, and we should have LDoN (Public) instances tonight. Will cost 1k pp for instance v1 and 2k pp for instance v2, so there will be 3 total zones per LDoN level.


Title: Re: CRASH!
Post by: Hunter on September 02, 2010, 01:24:24 am
If you made a backup of what the database looked like at time of crash, why not just throw up that backup and fix the nullstring?

Because I did a lot of edits to a lot of tables before I backed it up before the wipe, trying to figure out which tables were affected by a screwed up instance, when it was a screwed up qglobal I found out later.


Title: Re: CRASH!
Post by: Lored on September 02, 2010, 01:24:33 am
True, especially if it was repeated over multiple records. BUT he did already remove the nullstring, so I'm assuming it was an easy fix in the first place, hopefully he can do it to the other backup. Hard to tell without actually seeing it in front of me. Even so though, a few lines of code to repair the database could very well work. Just go through and parse out the null strings that aren't supposed to be there in the records. Too many variables to really guess at it though without seeing it in front of me.


Title: Re: CRASH!
Post by: Lored on September 02, 2010, 01:25:45 am
Ahhhhh got ya got ya. Thanks for the explanation.


Title: Re: CRASH!
Post by: zulkern77 on September 02, 2010, 01:33:56 am
You, sir, are a very skilled individual and I appreciate all the hard work you put in. Glad to know that you figured out the problem and that someone like you is running the server. :D


Title: Re: CRASH!
Post by: Mghargh on September 02, 2010, 05:05:08 am
For myself I am exceedingly grateful that he was willing to get it all straightened out in the wee hours of the morning rather than waiting for daylight.


Title: Re: CRASH!
Post by: Uxt on September 02, 2010, 07:56:07 am
Nice save, Hunter. If it were me, I'd have looked at it, checked the clock, and said "Screw it, going to bed".  :P

Guess I'll add more to this post and say that Artimis is so cute and cuddly. :3


Title: Re: CRASH!
Post by: Thyl on September 02, 2010, 09:00:33 am
Wow, ouch. I'm actually going to lose some T2 BPs on that  :'(


Title: Re: CRASH!
Post by: Fugitive on September 02, 2010, 09:40:15 am
Character table wasn't restored, so oh yeah, levels and AA are not reimbursed, but at least you have all your items and flags. Yay for backup.



Looks like you will have your T2BPs.



Title: Re: CRASH!
Post by: Thyl on September 02, 2010, 09:48:44 am
Character table wasn't restored, so oh yeah, levels and AA are not reimbursed, but at least you have all your items and flags. Yay for backup.



Looks like you will have your T2BPs.


Yeah I think I missed some posts in there lol. Well thats good news  ;D


Title: Re: CRASH!
Post by: swamphy on September 02, 2010, 11:28:11 am
Didn't Rostam spend all day yesterday making a new Pally? Tough breaks man.

Maybe we could get a double-loot weekend to compensate?? How bout a few hours at least?



Title: Re: CRASH!
Post by: lerxst2112 on September 02, 2010, 03:17:03 pm

I'm not entirely sure what, if anything, was lost.  I know on the two characters I played yesterday I didn't see anything gone.  I was expecting to log my warrior in at level 59 or 60 like he was at the beginning of the day, but instead he was level 70 with a bunch of AA that I had gotten in the last minutes before the crash.

Whatever you did to fix it Hunter, you made me happy. :)