PAFOA's website is located at one the premier hosting facilities in the USA,
ServerCentral Network. They have physical links to most major Internet service providers, usually 10gigE. A complete list can be seen at
ServerCentral's FixedOrbit Page. Consider each of those links is a MINIMUM of 2GBps, you can quickly see the overall capacity of ServerCentral, and realize any speed issues are not caused by any bottlenecks at the hosting ISP.
As Dan mentioned, unless your ISP is directly connected to ServerCentral's network (ie, is on that fixedorbit list), then your connection must traverse third party networks in order to complete your requests. Sometimes these third party networks suck bigtime, and that will drastically impact performance. Which third party network you traverse is determined largely by your ISP's upstream providers preference.
One way to see your connection path is to use the tool traceroute. It was created to help troubleshoot network problems such as this.
