PAFOA has switched to new hosting. Report problems here.

[ChamberedRound]

Anyone know if the RSS feeds are working? I can't find any.

Paul

This isn't something I can look at, but I've alerted Dan to the problem.

[Breadman03]

Anyone know if the RSS feeds are working? I can't find any.

Paul

Ever since the switch, mine has only picked up updates every week or so.

[cruzans]

If you're reading this than it appears the transition from our outdated colocation and into Amazon's Cloud to hang out with all the other cool kids was successful.

In theory this hosting infrastructure should be significantly more stable in the long run since hardware failures are now Amazon's problem, not ours. No more 2 days of downtime while my friend in Michigan gets a chance to pop over to the data center and figure out what went wrong.

Some of the highlights/advantages:

1. Completely automated provisioning of servers: In a catastrophe situation where the entire server infrastructure disappears, I could rebuild it in about 10-20 minutes with one command.
2. Automatic scaling of servers: When load gets high, new servers will automatically be spun up to meet the demand using the previously mentioned provisioning. When traffic dies down, unnecessary servers will be killed off.
3. Self-healing servers: We'll always have a minimum of two servers so that if one craps out, the other one can handle the load until a new one is started based off of that autoscaling.
4. We now have ridiculously redundant backups of 5-minute windows for 30 days on our database. We've never had to recover from a database backup in the past, but if we ever have to in the future we are more than covered.

Some of the disadvantages:

1. Amazon sometimes has to do server maintenance on the cloud database every few months and while we can specify a window in which they do it (around 4am) there are times where the site will be down for 5-10 minutes while they do that.
2. While I won't have finalized numbers for a week or two when I get a better idea of how many of Amazon's servers it takes to keep this thing chugging along, I would assume that we just doubled the cost of our hosting, at least. With that said, we can afford it, but if you've been considering donating or buying a subscription, now couldn't hurt

Amazon is not perfect and has had downtime in the past and likely will in the future, however with this infrastructure recovering from such downtime should be significantly faster and less painful than on our old setup.

Lastly, while CR and I tested stuff pretty thoroughly, there is almost guaranteed to be something I overlooked, if you notice something not right on the forum please report it here and I'll look into it. I'm mostly looking for pages that error, pages that don't load properly, broken images, broken links, etc.

If you find a problem that seems like it should be reported privately (security/privacy issues, etc) PM me directly.

Known Open Issues

• Search rate limiting: I was 99% sure this had been fixed and I can't personally recreate it, but people are still reporting it sporadically. For the time being I have disabled search rate-limiting, we'll see how the servers handle that and if it's not a problem we'll just leave it disabled. Search to your heart's content!
• The Forum RSS feeds are not working: This appears to be sporadic working sometimes but not others.
• Double posting of posts: Not sure exactly why this is happening, one theory is that if one server behind the load balancer is slow to respond it sends the request to another one resulting in two servers handling the same request.
• Sporadic errors when uploading pictures: Working theory is that pictures over a certain size are rejected by our web server. Waiting on file size examples from people reporting the problem.
• Various rate limiting messages: Still not exactly sure about this one.

Please report new issues by replying to this thread.

Any update on when the problems will be fixed ? Might have been addressed or answered, but because of the problems where only the original post shows, and you have to use the drill downs to read every resonse individually, I didn't want to spend 20 minutes doing that. This is the same problem that occured several days ago, but returned to normal - now as of yesterday, jacked again. Thanks.

[cruzans]

Been playing and have figured out the fix. If anyone else is having the same problem where all you see is the original post, and have to drill down on everyones posts in box above to see any - you need to go to the "display mode" box and hit the drop down box. For some reason, settings were changed to "threaded mode" so you need to change back to "linear mode".
If anyone needs help, pm me. I have not seen any communication or fixes in the forum so hopefully this will help others having the same problem!