Pages: 1 2  Next -- Posted by davjs at 10:18 am on June 20, 2008 Replies are stored in 16 database tables, the 16th and most recent of which recently became corrupted and I had to delete a large number of those replies.   The issue is that we now have millions upon millions of replies. The database software (MySQL) is not adept at handling so many entries and occasionally begins writing them incorrectly. When this happens, and it has happened before, I have no choice but to delete those duplicate entries. To "recover" the replies I would have to read each reply and guess which topic they belonged to. I only deleted replies that appeared more than once in the database, so in most cases one reply will still remain. However, it does seem that many topics remain damaged. My heart goes out to those of you applying to become support leaders who may have lost some of your application material. We store the replies in merge tables, so mysql reads 16 separate tables as if they were one table. It makes it possible for mysql to read them more efficiently (read faster and without crashing the server). However, merge tables are prone to corruption. This is not a coding issue. I have repaired the damaged database tables over the course of 2 days because the operations were so tedious and time consuming when dealing with 13 million replies. -- Posted by bluskypeChris at 10:19 am on June 20, 2008 Koolio -- Posted by i who have nothing at 10:20 am on June 20, 2008 Get some better database software yo.  Where do all those advertising dollars go? -- Posted by OverTheAir at 10:20 am on June 20, 2008 Urgg can all my messed up topics just be deleted? -- Posted by Aphrodite54 at 10:21 am on June 20, 2008 Ok, well thanks for fixing it. And thanks for explaining what went wrong :) 54 -- Posted by Rowanie at 10:25 am on June 20, 2008 Thanks. Does that mean it might happen again? Can't you get a better program? -- Posted by coloring the void at 10:25 am on June 20, 2008 Quote: from OverTheAir at 10:20 am on June 20, 2008 Urgg can all my messed up topics just be deleted? Psh, NO! They sound so funny. :P -- Posted by acausedelle at 10:27 am on June 20, 2008 Cool. Maybe find a better application for that? -- Posted by BubbleCake at 10:29 am on June 20, 2008 So, will all the messed up topics and replies be fixed? Or just stay the way they are? -- Posted by The Bastard at 10:30 am on June 20, 2008 David Jones, I no longer have any expectations of you anymore. -- Posted by Daleacus at 10:33 am on June 20, 2008 It may be annoying, but, thanks for putting the effort in to fix it, as always. -- Posted by Autumndaze at 10:37 am on June 20, 2008 Quote: from davjs at 1:18 pm on June 20, 2008 My heart goes out to those of you applying to become support leaders who may have lost some of your application material. At least the bug is being fixed so we won't have to worry about our newer replies being trashed. -- Posted by hateitandloveit at 10:41 am on June 20, 2008 Try HS for MySQL scalability tips: http://highscalability.com/tags/mysql Or use PostgreSQL if your database is abstracted (by means of any Perl MVC system or something.) -- Posted by 4est at 11:43 am on June 20, 2008 Quote: from hateitandloveit at 10:41 am on June 20, 2008 Try HS for MySQL scalability tips: http://highscalability.com/tags/mysql Or use PostgreSQL if your database is abstracted (by means of any Perl MVC system or something.) He's Asian, so he must know his shit. -- Posted by audrey820 at 11:58 am on June 20, 2008 Suckssssss, but you had to do what you had to do. Don't sound so guilty about it! -- Posted by Briley 07 at 12:18 pm on June 20, 2008 I lost 2 SL replies completly, and one is in a topic of it's own, so I dunno if it can be accepted, free SL status David? -- Posted by DefaultTo0 at 12:20 pm on June 20, 2008 Quote: from The Bastard at 6:30 pm on June 20, 2008 David Jones, I no longer have any expectations of you anymore. A valid opinion. -- Posted by BLUEAUTOMATIC at 12:58 pm on June 20, 2008 Quote: from i who have nothing at 6:20 pm on June 20, 2008 Get some better database software yo.  Where do all those advertising dollars go? Prostitutes, yo. I'MONLYJOKINGDAVIDIKNOWYOUDON'TREALLYNEEDTOPAYPEOPLETOHAVESEXWITHYOU -- Posted by carracer at 1:02 pm on June 20, 2008 Quote: from laineyloo at 10:29 am on June 20, 2008 So, will all the messed up topics and replies be fixed? Or just stay the way they are? This is my question too most of my topics are corrupted it was pretty unsetting actually but i do not see how completely corrupted topics are useful anymore will they be deleted? or clog up the server? -- Posted by branflakes at 1:35 pm on June 20, 2008 Quote: from i who have nothing at 1:20 pm on June 20, 2008 Where do all those advertising dollars go? Good question. -- Posted by lunchbox at 3:06 pm on June 20, 2008 Quote: from i who have nothing at 10:20 am on June 20, 2008 Get some better database software yo. Where do all those advertising dollars go? umm i dont think theres a better software the SQL... especialy with this type of aplacation that needs a database. -- Posted by lunchbox at 3:07 pm on June 20, 2008 Quote: from carracer at 1:02 pm on June 20, 2008 Quote: from laineyloo at 10:29 am on June 20, 2008 So, will all the messed up topics and replies be fixed? Or just stay the way they are? This is my question too most of my topics are corrupted it was pretty unsetting actually but i do not see how completely corrupted topics are useful anymore will they be deleted? or clog up the server? as he said, he dosnt want to go though 13 million entrys and guess what goes whre. more then likely they will either be deleted, or stay where they are. -- Posted by HatesYou at 3:24 pm on June 20, 2008 Quote: from 4est at 2:43 pm on June 20, 2008 Quote: from hateitandloveit at 10:41 am on June 20, 2008 Try HS for MySQL scalability tips:    http://highscalability.com/tags/mysql    Or use PostgreSQL if your database is abstracted (by means of any Perl MVC system or something.) He's Asian, so he must know his shit. i lol'd -- Posted by i who have nothing at 3:45 pm on June 20, 2008 Quote: from lunchbox at 6:06 pm on June 20, 2008 Quote: from i who have nothing at 10:20 am on June 20, 2008 Get some better database software yo. Where do all those advertising dollars go?   umm i dont think theres a better software the SQL... especialy with this type of aplacation that needs a database. There's database software that costs money and is much better equipped to handle large amounts of data. Think of Youtube or Google and all the info they put in there compared to LW and their shiz doesn't crash. -- Posted by hubert cumberdale at 5:07 pm on June 20, 2008 Quote: from i who have nothing at 10:20 am on June 20, 2008 Get some better database software yo.  Where do all those advertising dollars go? yeah and donations -- Posted by hithere at 5:42 pm on June 20, 2008 are you sure you had to delete so much? all my topics created more than about a month ago were fine...you ruined all of them going back like an entire year, wtfffffff -- Posted by marshmellowman at 5:45 pm on June 20, 2008 Quote: from Briley 07 at 8:18 pm on June 20, 2008 I lost 2 SL replies completly, and one is in a topic of it's own, so I dunno if it can be accepted, free SL status David? TWO? I lost like TEN FREAKING replies. It's basically delayed my whole application a by a week or two. Grrrrrr. -- Posted by Corrupted Innocence at 5:46 pm on June 20, 2008 Quote: from marshmellowman at 1:45 am on June 21, 2008 Quote: from Briley 07 at 8:18 pm on June 20, 2008 I lost 2 SL replies completly, and one is in a topic of it's own, so I dunno if it can be accepted, free SL status David? TWO? I lost like TEN FREAKING replies. It's basically delayed my whole application a by a week or two. Grrrrrr. I feel bad for you, as you give awesome advice to be honest. Well lets hope you get it soon. -- Posted by marshmellowman at 5:47 pm on June 20, 2008 TY Emma, you're too kind, srsly. -- Posted by Brookie Chookie23 at 6:29 pm on June 20, 2008 Quote: from The Bastard at 3:00 am on June 21, 2008 David Jones, I no longer have any expectations of you anymore. A redundant sentence. Pages: 1 2  Next