First of all you are confusing two completely separate issues.
Issue 1) British users at BT who have absolutely no problem at all with any of LFS services apart from one very specific type of traffic: http requests from LFS.exe to our web server, downloading images, mods or mod list.
NOTE: These users have no other issue between their computer and our servers. This currently points to BT traffic shaping as the only thing I can think of. Once again, I cannot and will not stop developing the new full version, at this time, to deal with BT traffic shaping or whatever it is that doesn't affect anyone in Europe other than BT users in the UK.
Issue 2) You are having problems with all types of connection to LFS servers, from Singapore to the Netherlands. There is no way that this can be explained by a problem with the i3d internet connection that is working fine for most people. It's a long way between Singapore and the Netherlands and we cannot be held responsible for the behaviour of multiple internet routers around the world.
REPEAT: You are talking about a separate, unrelated issue.
I am serious busy working 12 to 14 hour days trying to finish the new version - and nothing has changed in LFS code pages in recent times.
So, please. before I look into it at all can you have a look to see DIRECTLY the output from LFS? Special Japanese characters are output as double-byte characters from Windows code page 932
LFS.exe has absolutely no knowledge or implementation of anything to do with UTF-8 etc.
It only knows single byte ASCII and code pages (including double-byte code pages for Chinese Japanese and Korean). It does not do UTF-8 or any kind of UTF.
This forum section is purely to let me know about LFS bugs, for me to fix. But people are reporting issues with text strings that other programs have already converted.
It has also been proved that if you use a different internet connection, the problem goes away.
So the problem, for the UK users, appears to be BT. The only possibility I can think of is that they are restricting http traffic from sources they don't understand. LFS connects with a "user agent" called "LFS" rather than "Firefox" etc. So maybe BT suspects it is a bot or web crawler. This is speculation.
Seeing as it's pretty much only BT users that have this issue, the ideal people to fix the issue would be BT, if they would kindly avoid traffic shaping that would be appreciated.
Alternatively we can try experimenting, so that LFS 'spoofs' its user agent to try to appear like Firefox. But I am seriously much too busy, currently working on average 12 hour days to try and get this release finished, so I can't start messing around now trying to get around BT's traffic shaping.
Basically I would like to know if:
1) replays saved after you restart your host, now have the correct date?
or:
2) You restarted your host but new replays recorded after the restart, still say 20 July?
My test: I started a host and recorded a replay. Restarted the host on a different server and saved another replay. Both have the correct date.
Restarting the host will not correct the replays that were already recorded in the past, but hopefully new replays have the correct date.
OK, I can't really understand how this has happened.
It seems like something might have happened on that server at that point in time, probably affecting all hosts running on that server, so the function "GetSystemTimeAsFileTime" always returned the same value, and that value was implanted into the replays.
It seems that it will be fixed if you restart your host, and that's what I suggest at this point.
I am trying to investigate the cause of a strange issue for some users, particularly some of our UK users with BT internet. They have connections that appear to work well, and our website works as expected, but downloads in game run very slowly (skins, mods, mods browser, event list). We are talking VERY slowly: 15 seconds for a small image, 10 minutes for a mod.
If you do have that problem, please visit the special thread on that subject. There are some tests you can try if you set your browser to allow http connections (LFS uses http connections, not https, but this does not seem to be directly the cause of the issue).
Hi, please can you check out this thread on this specific issue? I am trying to investigate UK users with slow in-game downloads. There is a test you may be able to do.
For those who have got consistent slow downloads of skins, mods, mods browser and event list in LFS:
We are trying to establish what could be the cause. It seems particularly strange in the UK, where connections are good and our servers are located just across the sea in the Netherlands.
Known UK users with the issue are o000o, Zero7, Cimanu, Boypower, ka darai
TEST 1: This test was to see if there is some issue with plain http, between your ISP and our servers.
Using Firefox so you can view http (not https) visit the 'LX skinning competition' and see if the images and skins download at normal speed: http://competition.lfs.net/lx_skinning/
Results so far: those people who could visit it, reported no issue.
TEST 2: This test is to get closer to what LFS does in game.
I asked Victor but he is also puzzled, we can't really see why something that has been in the game and our site for so many years and has not changed in any way, might start to be a problem for some people. We are using simple http protocol, with no funny tricks.
He sent a couple of example links that you can try in Firefox:
These links are just as they would be accessed from LFS.
EDIT: One thing I wonder about is if the ISP (e.g. BT) might be doing deep packet searching. If so it would find "User-Agent: LFS" (rather than Firefox etc) and I just wonder if they might be doing throttling or traffic shaping (e.g. they could possibly think the requests come from a bot or crawler and not be legitimate traffic - I'm just making this up, I really have no idea). There's one tiny change you can make in LFS to remove a small item from the URL that it sends to our site. Although I find it extremely unlikely that it would make any difference, if you switch off "Allow regional downloads" it will not include "X-Caps: 1" in the URL (it's just a line telling our web server that LFS can allow redirections).
I can't see or reproduce any bug. Something appears to be wrong in your code or analysis.
The TextStart byte refers to the actual offset in the original binary representation of the string in the packet, but you seem to be comparing it with some interpreted or converted strings.
Your "to utf16(?)" strings don't mean much to me. For instance, in the original output packet there is no ^c - there is just a plain colon.
To deal with your examples:
1) If you restore the ^c to : then the offset of "test" is 14 as expected.
2) Single width katakana (1 byte for this katakana) again the offset it correct if you replace ^c with :
3) Double width character so it's one more than example (2).
Basically if you look at the original bytes in the packet before doing any conversion into other text encoding systems, you should find the offset points to the first character of the message. I've verified this in my own InSim packet checker.