Well, I can only speak for myself, but for me the OLFSL website most of the time takes a few seconds to appear at all. Before that, I see only a blank screen. I guess it's the DNS querying that takes such a long time.
At home I have a 6MBit DSL and at my working place an even faster connection to the internet. Doesn't change anything.