Jump to content


Photo
Issue

Wiki pages are very slow



  • Please log in to reply
76 replies to this topic

#46 Darth_mathias

Darth_mathias

    Dragon King

  • Pack Authors
  • PipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPip
  • 4,013 posts

Posted 09 October 2016 - 10:20 AM

wow 10 mins to try and just load the main forum page and login several 504 gateway timeouts.


  • 0

#47 TechAngel85

TechAngel85

    Akatosh

  • Administrators
  • PipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPip
  • 12,278 posts

Posted 09 October 2016 - 10:34 AM

I just logged into the AdminCP and the server load is currently in the green for the forums. The wiki seems to be okay at the moment too. Possibly it was just a spike on the server for a while.



#48 Darth_mathias

Darth_mathias

    Dragon King

  • Pack Authors
  • PipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPip
  • 4,013 posts

Posted 09 October 2016 - 10:41 AM

everything seems OK now


  • 0

#49 Greg

Greg

    Dragonborn

  • Super Moderators
  • PipPipPipPipPipPipPipPipPipPipPipPipPipPipPip
  • 1,563 posts

Posted 09 October 2016 - 11:05 AM

Yeah, the whole forum went down just as I was posting a reply. Seems to be working now, although I'm still getting a gateway timeout on the DynDOLOD topic. When I try to go to first unread post in this topic it seems as if the rest of the forum slows down as well.



#50 TechAngel85

TechAngel85

    Akatosh

  • Administrators
  • PipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPip
  • 12,278 posts

Posted 09 October 2016 - 11:16 AM

Yeah, the whole forum went down just as I was posting a reply. Seems to be working now, although I'm still getting a gateway timeout on the DynDOLOD topic. When I try to go to first unread post in this topic it seems as if the rest of the forum slows down as well.

I can confirm this behavior and it's only the last page which will not load. That is the largest topic we've every had. I've asked Sheson if he wants a support forum similar to MO, but he likes the single topic. I think a support forum will be better suited so users can better search for previous support quests. May have to make an executive decision there if the forum is being overwhelmed by that single topic. For now, I'll try splitting it out from the last update post to see if that fixes it.



#51 LordOfLA

LordOfLA

    Guard

  • Members
  • PipPip
  • 129 posts

Posted 09 October 2016 - 11:37 AM

If the forums are running on mysql you probably don't want long threads unless you have a dedicated db cluster with lots of ram caching going on.

 

It's not the MySQL is bad, just that most web based forums aren't written with optimal DB querying.


  • 0

#52 TechAngel85

TechAngel85

    Akatosh

  • Administrators
  • PipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPip
  • 12,278 posts

Posted 09 October 2016 - 12:21 PM

I've closed that topic and opened a new one by splitting off several pages of posts and moving the rest. It started loading properly on the first split so that was likely the issue. That topic was approaching 5000 posts. I've offered Sheson the support forum again.



#53 Darth_mathias

Darth_mathias

    Dragon King

  • Pack Authors
  • PipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPip
  • 4,013 posts

Posted 10 October 2016 - 01:49 PM

i am still regularly getting 504 timeouts while trying to edit my SRLE extended LOTD guide.


  • 0

#54 TechAngel85

TechAngel85

    Akatosh

  • Administrators
  • PipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPip
  • 12,278 posts

Posted 10 October 2016 - 11:38 PM

I got in touch with s4n. He was able to take a look. Seems like there has been a spike in requests the last couple days. He did some tuning to hopefully relieve some of the 504s. He will likely keep an eye on it for a few days. We have to be careful of remaining at high loads on the server for too long or we risk our host pulling the plug for a while; or worse.



#55 z929669

z929669

    Ixian Inventor

  • Administrators
  • PipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPip
  • 9,262 posts

Posted 14 October 2016 - 09:47 PM

Yes, we are still having issues related to limiting resource use on the server so that we don't risk our hosting relations. s4n has made some tweaks as a possible short-term fix. There must be an issue with thread size for forums, but the real issues are more likely the wiki, which is muuuuch larger than the forums in terms of storage by an order of magnitude at least.

 

However, LordOfLA makes a good point about DB query efficiency, and I am not sure if forums and wiki DBs differ in terms of optimization. Breaking large, popular threads into chunks might help, and we have some doozies like Skyrim Revisited, which is getting the largest number of topic views this year by far and second only to MO support in 2015. Mods, MO Support, General, and Sheson's DynDOLOD are other large and potentially high-trafic forums with hot topics that should be archived. Sheson's thread has not had nearly as much traffic since early 2015 though (probably due to DynDOLOD wiki supoort).



#56 TechAngel85

TechAngel85

    Akatosh

  • Administrators
  • PipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPip
  • 12,278 posts

Posted 14 October 2016 - 09:55 PM

Yes, we are still having issues related to limiting resource use on the server so that we don't risk our hosting relations. s4n has made some tweaks as a possible short-term fix. There must be an issue with thread size for forums, but the real issues are more likely the wiki, which is muuuuch larger than the forums in terms of storage by an order of magnitude at least.

 

However, LordOfLA makes a good point about DB query efficiency, and I am not sure if forums and wiki DBs differ in terms of optimization. Breaking large, popular threads into chunks might help, and we have some doozies like Skyrim Revisited, which is getting the largest number of topic views this year by far and second only to MO support in 2015. Mods, MO Support, General, and Sheson's DynDOLOD are other large and potentially high-trafic topics that should be archived. Sheson's thread has not had nearly as much traffic since early 2015 though (probably due to DynDOLOD wiki supoort).

You probably missed it, but I've created a support forum for Sheson at the top level and broken his topic up into multiple topics. He's now running that forum as a moderator as it'll be the place for support for his tool.



#57 z929669

z929669

    Ixian Inventor

  • Administrators
  • PipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPip
  • 9,262 posts

Posted 14 October 2016 - 10:18 PM

Yeah, I saw that and forgot about it when I wrote. Good move. We should start breaking up the others though and implement a post limit per topic ... maybe archiving the rest into subforums within  adjacent to their own Topic forums. The big topics with lots of page views, I mean that are under the forums I mentioned.



#58 Darth_mathias

Darth_mathias

    Dragon King

  • Pack Authors
  • PipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPip
  • 4,013 posts

Posted 17 October 2016 - 01:57 AM

Yes, we are still having issues related to limiting resource use on the server so that we don't risk our hosting relations. s4n has made some tweaks as a possible short-term fix. There must be an issue with thread size for forums, but the real issues are more likely the wiki, which is muuuuch larger than the forums in terms of storage by an order of magnitude at least.

 

However, LordOfLA makes a good point about DB query efficiency, and I am not sure if forums and wiki DBs differ in terms of optimization. Breaking large, popular threads into chunks might help, and we have some doozies like Skyrim Revisited, which is getting the largest number of topic views this year by far and second only to MO support in 2015. Mods, MO Support, General, and Sheson's DynDOLOD are other large and potentially high-trafic forums with hot topics that should be archived. Sheson's thread has not had nearly as much traffic since early 2015 though (probably due to DynDOLOD wiki supoort).

I think we can attribute the higher number of topics for SRLE because of 3 new mod guide that hit there last year:

1st my SRLE Extended guide.

2nd my SRLE Extended Legacy of the dragonborn guide.

3rd paul666root brand new SRLE Legacy of the Dragonborn Requiem guide.

 

These are hugely popular (mine was a big surprise to me).

 

Now my 2 original SRLE Extended forums and the SRLE Extended support forum have both been closed at my request cos they weren't being used anymore and i was longer supporting that guide.

 

my SRLE Extended LOTD guide and forums are still going strong even thou I have now announced my semi-retirement from maintaining the guide.  this due the the birth of my twins back in August and lack of time to do so.

 

Paul Requiem guide is going strong and guide is still under construction.

 

So you might want to breakup both the SRLE Extended: Legacy of The Dragonborn and the SRLE:Legacy of The Drgaonborn Reqtified Threads into there own sub forums or something i don't know.


  • 0

#59 stoppingby4now

stoppingby4now

    Sleepy

  • Administrators
  • PipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPip
  • 4,281 posts

Posted 17 October 2016 - 07:49 PM

The recent issue with the forum revealing the database problems has nothing to do with thread size. It was a configuration on MySQL that was causing out of memory errors (I over-allocated). IPB is somewhat decent on its queries, using LIMIT's on a thread view to reduce the number of rows returned, and it caches frequented views. I currently don't see an issue with the forum, and breaking apart threads right now would only induce a placebo affect.

 

The Wiki is the real beast currently.



#60 Darth_mathias

Darth_mathias

    Dragon King

  • Pack Authors
  • PipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPipPip
  • 4,013 posts

Posted 30 November 2016 - 01:48 PM

been getting alot of 503 and 504 errors from the wiki pages today forum are OK thou.


  • 0



Also tagged with one or more of these keywords: Issue

0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users