Pennsylvania Firearm Owners Association
Page 1 of 22 1234511 ... LastLast
Results 1 to 10 of 211
  1. #1
    Join Date
    Mar 2006
    Location
    Philadelphia, Pennsylvania
    (Philadelphia County)
    Age
    42
    Posts
    4,353
    Rep Power
    4350210

    Default PAFOA Forum hosting infrastructure upgraded - Report issues here

    As announced last week, today I upgraded the hosting infrastructure that the forum runs on. This migration has largely gone as planned except for a few minor issues I have found and fixed.

    With that said, I fully expect there will be minor issues that we will need to find, debug, and fix. Additionally the forum is now configured to automatically scale servers up and down to match traffic, but I am certain we will need to dial that configuration in over the coming weeks to find the ideal setup that keeps the forum running fast regardless of the traffic levels.

    Please use this thread to report bugs, broken functionality, and other weirdness you see.

    Please do not use this thread to post feature requests or changes to the forum, only report stuff that is broken.

    Server Stability

    Problem: We are still seeing occasional 502 Bad Gateway/503 Service Unavailable/504 Gateway Timeout errors when the servers get maxed out until a new one comes online.
    Status: Ongoing, but appears to be mostly resolved
    Theories:
    • Servers are maxing our available memory, may need to adjust php-fpm's process/children settings to leave more headroom and tweak the memory target autoscaling rule
    • vBulletin-based searches may be spiking the load and blocking other page requests

    Attempted Remediations:

    • Increased task memory allocation from 2048 MB to 3072 MB: This appears to have significantly improved reliability and reduced the 50X errors being returned.


    Slow/Duplicate posting of threads/replies/quick replies

    Problem: There are times when posting is slow and/or times out, and can sometimes result in duplicate posts
    Status: Ongoing, but appears to be mostly resolved
    Theory: This is likely related to the general server stability


    Human Verification Images Not Loading

    Problem: Areas where the forum asks you to verify you are a human with an image are loading blank images
    Status: Resolved
    Theory: Misconfiguration with image manipulation libraries on service
    Attempted Remediations:
    • Temporarily disabled HVI on registration and password reset forms so they are usable until underlying issue is fixed properly.

    Root Cause: libfreetype/libjpeg were not properly configured for the php/gd extension


    Attachment Images Not Loading

    Problem: Uploaded image attachments are not displaying when posted
    Status: Very Likely Resolved
    Theory: Misconfiguration with image manipulation libraries on service
    Root Cause: libfreetype/libjpeg were not properly configured for the php/gd extension
    Last edited by danp; May 29th, 2020 at 05:19 PM.
    Dan P, Founder & President, Pennsylvania Firearm Owners Association
    Purchase a Forum SubscriptionBuy some PAFOA MerchandiseHelp PAFOA's Search Engine Ranking


  2. #2
    Join Date
    Oct 2010
    Location
    Lebanon, Tennessee
    Posts
    4,941
    Rep Power
    21474854

    Default Re: PAFOA Forum hosting infrastructure upgraded - Report issues here

    Nice work Dan and team! Thank you! Nice to see the lock up there now.
    Life has a melody. Not great, not terrible.

  3. #3
    Join Date
    May 2006
    Location
    127.0.0.1, Pennsylvania
    (Lancaster County)
    Posts
    20,351
    Rep Power
    21474874

    Default Re: PAFOA Forum hosting infrastructure upgraded - Report issues here

    Not sure if you're still working on it or not, but I just got a 504 Gateway time out error.
    Rules are written in the stone,
    Break the rules and you get no bones,
    all you get is ridicule, laughter,
    and a trip to the house of pain.

  4. #4
    Join Date
    Mar 2006
    Location
    Philadelphia, Pennsylvania
    (Philadelphia County)
    Age
    42
    Posts
    4,353
    Rep Power
    4350210

    Default Re: PAFOA Forum hosting infrastructure upgraded - Report issues here

    Quote Originally Posted by JustinHEMI View Post
    ... Nice to see the lock up there now.
    Long overdue, now we'll learn what I screwed up in this process over the next couple days.
    Dan P, Founder & President, Pennsylvania Firearm Owners Association
    Purchase a Forum SubscriptionBuy some PAFOA MerchandiseHelp PAFOA's Search Engine Ranking


  5. #5
    Join Date
    Mar 2006
    Location
    Philadelphia, Pennsylvania
    (Philadelphia County)
    Age
    42
    Posts
    4,353
    Rep Power
    4350210

    Default Re: PAFOA Forum hosting infrastructure upgraded - Report issues here

    Quote Originally Posted by streaker69 View Post
    Not sure if you're still working on it or not, but I just got a 502 Gateway time out error.
    Yeah server stability is currently a problem I'm looking into. It's looking like the database is being a bit slow. Will be investigating and watching throughout the day.
    Dan P, Founder & President, Pennsylvania Firearm Owners Association
    Purchase a Forum SubscriptionBuy some PAFOA MerchandiseHelp PAFOA's Search Engine Ranking


  6. #6
    Join Date
    Aug 2013
    Location
    Pittsburgh, Pennsylvania
    (Allegheny County)
    Age
    66
    Posts
    3,140
    Rep Power
    21474850

    Default Re: PAFOA Forum hosting infrastructure upgraded - Report issues here

    Quote Originally Posted by streaker69 View Post
    Not sure if you're still working on it or not, but I just got a 504 Gateway time out error.
    same here .....504 Gateway time out error

  7. #7
    Join Date
    Aug 2013
    Location
    Pittsburgh, Pennsylvania
    (Allegheny County)
    Age
    66
    Posts
    3,140
    Rep Power
    21474850

    Default Re: PAFOA Forum hosting infrastructure upgraded - Report issues here

    posted twice lol

  8. #8
    Join Date
    May 2006
    Location
    127.0.0.1, Pennsylvania
    (Lancaster County)
    Posts
    20,351
    Rep Power
    21474874

    Default Re: PAFOA Forum hosting infrastructure upgraded - Report issues here

    Quote Originally Posted by danp View Post
    Yeah server stability is currently a problem I'm looking into. It's looking like the database is being a bit slow. Will be investigating and watching throughout the day.
    I tried searching and it timed out as well, I tried to edit a post, and it timed out.
    Rules are written in the stone,
    Break the rules and you get no bones,
    all you get is ridicule, laughter,
    and a trip to the house of pain.

  9. #9
    Join Date
    May 2006
    Location
    127.0.0.1, Pennsylvania
    (Lancaster County)
    Posts
    20,351
    Rep Power
    21474874

    Default Re: PAFOA Forum hosting infrastructure upgraded - Report issues here

    Quote Originally Posted by danp View Post
    Yeah server stability is currently a problem I'm looking into. It's looking like the database is being a bit slow. Will be investigating and watching throughout the day.
    I tried searching and it timed out as well, I tried to edit a post, and it timed out.
    Rules are written in the stone,
    Break the rules and you get no bones,
    all you get is ridicule, laughter,
    and a trip to the house of pain.

  10. #10
    Join Date
    May 2006
    Location
    127.0.0.1, Pennsylvania
    (Lancaster County)
    Posts
    20,351
    Rep Power
    21474874

    Default Re: PAFOA Forum hosting infrastructure upgraded - Report issues here

    Check to make sure all the servers are time synced.
    Rules are written in the stone,
    Break the rules and you get no bones,
    all you get is ridicule, laughter,
    and a trip to the house of pain.

Page 1 of 22 1234511 ... LastLast

Similar Threads

  1. The PAFOA Forum has been upgraded to vBulletin 4
    By danp in forum Forum Announcements
    Replies: 206
    Last Post: October 20th, 2015, 09:37 PM
  2. Replies: 7
    Last Post: July 3rd, 2013, 10:41 AM
  3. PAFOA has switched to new hosting. Report problems here.
    By danp in forum Forum Announcements
    Replies: 213
    Last Post: October 5th, 2012, 07:04 PM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •