Server tonight

[Alulien]

Just experienced issues (5:45PM UTC). 5 characters in forest, 4 went LD. 5th remains active and responsive: can cast, talk, etc. Immediately after this started web service was unavailable for about 2 minutes.

Tracert for http://www.thehiddenforest.org started immediately upon noticing the issue:

Code: Select all

Tracing route to thflive.dyndns.org [195.5.177.21]
over a maximum of 30 hops:

  1    12 ms     8 ms     8 ms  c-174-52-28-1.hsd1.ut.comcast.net [174.52.28.1]

  2    23 ms     9 ms     9 ms  te-0-6-0-7-sur02.sandy.ut.utah.comcast.net [68.8
7.220.221]
  3     9 ms     9 ms     9 ms  te-0-7-0-0-sur01.sandy.ut.utah.comcast.net [69.1
39.247.17]
  4    13 ms    11 ms    11 ms  te-9-3-ar01.saltlakecity.ut.utah.comcast.net [68
.87.170.5]
  5    22 ms    27 ms    27 ms  pos-2-1-0-0-cr01.denver.co.ibone.comcast.net [68
.86.90.237]
  6    38 ms    39 ms    39 ms  he-2-12-0-0-cr01.dallas.tx.ibone.comcast.net [68
.86.87.34]
  7    38 ms    39 ms    37 ms  pos-0-0-0-0-pe01.1950stemmons.tx.ibone.comcast.n
et [68.86.86.90]
  8    36 ms    35 ms    35 ms  75.149.231.30
  9   149 ms   148 ms   149 ms  xe-3-0-0.par72.ip4.gtt.net [141.136.109.90]
 10   149 ms   150 ms   155 ms  interoute-gw.ip4.gtt.net [77.67.75.238]
 11   174 ms   174 ms   174 ms  ae0-0.par-gar-score-2-re0.interoute.net [212.23.
42.26]
 12   174 ms   174 ms   174 ms  ae1-0.fra-006-score-2-re1.interoute.net [212.23.
42.30]
 13     *        *        *     Request timed out.
 14     *        *        *     Request timed out.
 15   181 ms   174 ms   175 ms  ae1-0.bud-001-score-1-re0.interoute.net [84.233.
138.214]
 16   174 ms   174 ms   174 ms  89.202.178.42
 17   174 ms   174 ms   174 ms  TE-2-2.CR3.dhq.bud.doclerweb.hu [80.77.112.177]

 18     *        *        *     Request timed out.
 19     *        *        *     Request timed out.
 20     *        *        *     Request timed out.
 21     *        *        *     Request timed out.
 22     *        *        *     Request timed out.
 23     *        *        *     Request timed out.
 24     *        *        *     Request timed out.
 25     *        *        *     Request timed out.
 26     *        *        *     Request timed out.
 27     *        *        *     Request timed out.
 28     *        *        *     Request timed out.
 29     *        *        *     Request timed out.
 30     *        *        *     Request timed out.

Trace complete.


[Subdued]

Lost 4 of 6 at 1:32pm EST on 9/4/2014 in Plane of Air. As mentioned in an earlier post, I use Comcast and I'm located in Florida.

[Mazhar]

Unable to play at all now. Randomly crash at zoning with each and every character. I've tried 2 different clients (twice, both clean). I've also tried running with no MQ2, and I reset the router - problem still persists. I also flushed the dns.

Here's a paste from dbg:

[Thu Sep 04 20:25:20 2014]00453:Networking: connection terminated [client:DisconnectReasonUnacknowledgedTimeout,server:DisconnectReasonNone]
[Thu Sep 04 20:25:20 2014]00454:disconnected at C:\p4\EverQuest\live\EverQuest\EverQuest.cpp:18484 (char. select) DisconnectReasonUnacknowledgedTimeout

I haven't had any other issues with my internet today as far as I know.

Here's a tracert I just ran to thehiddenforest.org:

Code: Select all

1     2 ms   <1 ms   <1 ms  192.168.0.1
 2    11 ms     8 ms     8 ms  10.246.0.1
 3     9 ms     9 ms    10 ms  cm-84.208.41.49.getinternet.no [84.208.41.49]
 4    14 ms    22 ms    14 ms  212.162.27.14
 5    15 ms    21 ms    16 ms  ae51.bar1.Oslo1.Level3.net [212.162.27.13]
 6    35 ms    64 ms     *     ae-7-9.bar1.Copenhagen2.Level3.net [4.69.201.78]

 7    31 ms    47 ms     *     ae-0-10.bar1.Copenhagen1.Level3.net [4.69.137.15
]
 8     *        *        *     Forespørsel avbrutt.
 9    41 ms    48 ms    42 ms  ae-48-48.ebr3.Frankfurt1.Level3.net [4.69.143.17
]
10     *        *        *     Forespørsel avbrutt.
11    47 ms    47 ms    54 ms  ae-3-80.edge6.Frankfurt1.Level3.net [4.69.154.13
]
12    45 ms    45 ms    42 ms  COLT-TELECO.edge6.Frankfurt1.Level3.net [195.16.
61.198]
13     *        *        *     Forespørsel avbrutt.
14     *        *        *     Forespørsel avbrutt.
15     *        *        *     Forespørsel avbrutt.
16     *        *        *     Forespørsel avbrutt.
17     *        *        *     Forespørsel avbrutt.
18     *        *        *     Forespørsel avbrutt.
19     *        *        *     Forespørsel avbrutt.
20     *        *        *     Forespørsel avbrutt.
21     *        *        *     Forespørsel avbrutt.
22     *        *        *     Forespørsel avbrutt.
23     *        *        *     Forespørsel avbrutt.
24     *        *        *     Forespørsel avbrutt.
25     *        *        *     Forespørsel avbrutt.
26     *        *        *     Forespørsel avbrutt.

[Lillu]

Please keep posting time stamps for timeouts, that helps. Also your location and your ISP might be helpful for the troubleshooting. Basically any information is helpful that might affect your game play (playing over Wifi, etc).

Also, if there's more issues, we'll just reboot with a reverted server code to a 100% stable state, that will (at least) tell us if the desyncs are connection or server code related issues.

[Alulien]

Just experienced a total disconnect. 8:38 pm UTC. 5 characters in forest, all 5 disconnected. Web services unavailable for 2 minutes.

The issue seems to be increasing in frequency for me.

[Alulien]

A connection to the server could not be reached. Please check your internet connection.

All clients, despite web services functioning with the usual speed. I was able to reconnect roughly 2 minutes 30 seconds after initial disconnect. (edited for clarity)

Edit: tracert started again at the time of disconnect (forgot to include this)

Code: Select all

Tracing route to thflive.dyndns.org [195.5.177.21]
over a maximum of 30 hops:

  1     9 ms     8 ms     8 ms  c-174-52-28-1.hsd1.ut.comcast.net [174.52.28.1]

  2     9 ms     8 ms     8 ms  te-0-6-0-7-sur02.sandy.ut.utah.comcast.net [68.8
7.220.221]
  3    10 ms     9 ms    16 ms  te-0-7-0-0-sur01.sandy.ut.utah.comcast.net [69.1
39.247.17]
  4    15 ms    18 ms    16 ms  te-9-3-ar01.saltlakecity.ut.utah.comcast.net [68
.87.170.5]
  5    27 ms    23 ms    23 ms  pos-2-1-0-0-cr01.denver.co.ibone.comcast.net [68
.86.90.237]
  6    36 ms    35 ms    35 ms  he-2-12-0-0-cr01.dallas.tx.ibone.comcast.net [68
.86.87.34]
  7    39 ms    39 ms    39 ms  pos-0-0-0-0-pe01.1950stemmons.tx.ibone.comcast.n
et [68.86.86.90]
  8    36 ms    35 ms    36 ms  75.149.231.30
  9   151 ms   149 ms   149 ms  xe-4-1-0.par72.ip4.gtt.net [89.149.181.146]
 10   158 ms   151 ms   150 ms  interoute-gw.ip4.gtt.net [77.67.75.238]
 11   173 ms   184 ms   172 ms  ae0-0.par-gar-score-2-re0.interoute.net [212.23.
42.26]
 12   172 ms   172 ms   172 ms  ae1-0.fra-006-score-2-re1.interoute.net [212.23.
42.30]
 13   171 ms   171 ms   198 ms  ae1-0.prg-001-score-1-re0.interoute.net [84.233.
138.209]
 14   165 ms   165 ms   165 ms  ae0-0.prg-001-score-2-re0.interoute.net [84.233.
138.206]
 15   172 ms   172 ms   172 ms  ae1-0.bud-001-score-1-re0.interoute.net [84.233.
138.214]
 16   171 ms   171 ms   172 ms  89.202.178.42
 17   336 ms   172 ms   171 ms  TE-2-2.CR3.dhq.bud.doclerweb.hu [80.77.112.177]

 18     *        *        *     Request timed out.
 19     *        *        *     Request timed out.
 20     *        *        *     Request timed out.
 21     *        *        *     Request timed out.
 22     *        *        *     Request timed out.
 23     *        *        *     Request timed out.
 24     *        *        *     Request timed out.
 25     *        *        *     Request timed out.
 26     *        *        *     Request timed out.
 27     *        *        *     Request timed out.
 28     *        *        *     Request timed out.
 29     *        *        *     Request timed out.
 30     *        *        *     Request timed out.

Trace complete.


[Alulien]

Just ran another 2 tracerts while everything is functioning fine. They look almost identical to the last one, with the only difference being:

12 172 ms 220 ms 178 ms ae1-0.fra-006-score-2-re1.interoute.net [212.23
2.30]
13 176 ms 173 ms 174 ms ae1-0.prg-001-score-1-re0.interoute.net [84.233
38.209]
14 166 ms 166 ms 166 ms ae0-0.prg-001-score-2-re0.interoute.net [84.233
38.206]
15 173 ms 172 ms 202 ms ae1-0.bud-001-score-1-re0.interoute.net [84.233
38.214]
16 172 ms 172 ms 332 ms 89.202.178.42
17 172 ms 173 ms 173 ms TE-2-2.CR3.dhq.bud.doclerweb.hu [80.77.112.177]

With the high(er) ping leaving the greater Hungarian IP vs. the high(er) ping entering the local in Budapest.

Looking back to a previous tracert:

12 174 ms 174 ms 174 ms ae1-0.fra-006-score-2-re1.interoute.net [212.23.
42.30]
13 * * * Request timed out.
14 * * * Request timed out.
15 181 ms 174 ms 175 ms ae1-0.bud-001-score-1-re0.interoute.net [84.233.
138.214]
16 174 ms 174 ms 174 ms 89.202.178.42
17 174 ms 174 ms 174 ms TE-2-2.CR3.dhq.bud.doclerweb.hu [80.77.112.177]

The issue seems to have arisen in Prague, lines 13/14.

[Subdued]

I was offline from 2:30pm EST until 6:20pm EST. I came online for a few minutes and at 6:35pm EST I lost 5 of 6 toons.

[Subdued]

You know, I feel stupid not mentioning this before, and I just noticed it happened again (I've seen it 2-3 other times after disconnects, but not always), is there's a system message that says "ZServer BROADCASTS, 'WARNING: World server connection lost'.

That message came up about 2-3 minutes after I was able to log my toons back in again. I don't know if it's completely unrelated or not though.

[Lillu]

Reverting code to a 100% stable state. Please give us update after this reboot.