Page MenuHomeSchine - Phabricator
Create Task
Maniphest T1367

Starmade | Deadlock in server
Closed, FinishedPublic
Actions

Description

Deadlock in server.

jstack of deadlock (core part):

Found one Java-level deadlock:
=============================
"SERVER-PROCESSOR: null; PID: 467":
  waiting to lock monitor 0x00007fabb806d698 (object 0x00000003fcd8d168, a obfuscated.aoY),
  which is held by "ServerEntityWriterThread"
"ServerEntityWriterThread":
  waiting for ownable synchronizer 0x000000043323c620, (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync),
  which is held by "ServerController"
"ServerController":
  waiting to lock monitor 0x00007fabb806d698 (object 0x00000003fcd8d168, a obfuscated.aoY),
  which is held by "ServerEntityWriterThread"

Java stack information for the threads listed above:
===================================================
"SERVER-PROCESSOR: null; PID: 467":
	at org.schema.schine.network.server.ServerProcessor.run(SourceFile:564)
	- waiting to lock <0x00000003fcd8d168> (a obfuscated.aoY)
	at java.lang.Thread.run(Thread.java:745)
"ServerEntityWriterThread":
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x000000043323c620> (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283)
	at java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727)
	at obfuscated.acw.a(SourceFile:455)
	- locked <0x00000004a4e8b790> (a [B)
	at org.schema.game.common.controller.io.SegmentDataIO.a(SourceFile:943)
	at obfuscated.Su.handle(SourceFile:2062)
	at obfuscated.Sc.a(SourceFile:382)
	at org.schema.game.common.controller.SegmentBuffer.a(SourceFile:646)
	- locked <0x000000048b3655d0> (a org.schema.game.common.controller.SegmentBuffer)
	at org.schema.game.common.controller.SegmentBufferManager.a(SourceFile:513)
	- locked <0x000000043b0c14a0> (a it.unimi.dsi.fastutil.longs.Long2ObjectOpenHashMap)
	at obfuscated.Sr.writeAllBufferedSegmentsToDatabase(SourceFile:290)
	- locked <0x0000000435b5ef88> (a org.schema.game.common.controller.SegmentBufferManager)
	at obfuscated.acx.a(SourceFile:2408)
	at obfuscated.acx.a(SourceFile:107)
	at obfuscated.acA.run(SourceFile:2486)
	- locked <0x00000003fccb1b28> (a org.schema.schine.network.NetworkStateContainer)
	- locked <0x00000003fcd8d168> (a obfuscated.aoY)
	at org.schema.schine.network.server.ServerEntityWriterThread.run(SourceFile:48)
"ServerController":
	at org.schema.schine.network.server.ServerController.synchronizePrivate(SourceFile:462)
	- waiting to lock <0x00000003fcd8d168> (a obfuscated.aoY)
	at org.schema.schine.network.server.ServerController.synchronize(SourceFile:390)
	at org.schema.game.server.controller.GameServerController.update(SourceFile:1410)
	at org.schema.schine.network.server.ServerController.run(SourceFile:256)
	at java.lang.Thread.run(Thread.java:745)

Found 1 deadlock.

Details

Task Type
Bug
Testing Results
Affected Gamemode(s)
Serverside
Reproducible
Not on purpose
Category
Engine
Hardware/Software/System
OS-Specific
No
Hardware-Specific
No
Video Card Vendor
uncertain
Steps to reproduce
  • unknown
Tester information (Internal use only)

jstack in locked state:

2016-04-18 16:45:04
Full thread dump OpenJDK 64-Bit Server VM (25.77-b03 mixed mode):

"SendingQueueThread(null)" #3072 daemon prio=5 os_prio=0 tid=0x00007fabb8069800 nid=0x1709 in Object.wait() [0x00007fab2e3a2000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at org.schema.schine.network.server.ServerProcessor$SendingQueueThread.run(SourceFile:865)
	- locked <0x00000003c9f618a8> (a it.unimi.dsi.fastutil.objects.ObjectArrayFIFOQueue)

"ServerPing null" #3071 daemon prio=5 os_prio=0 tid=0x00007fabb8069000 nid=0x1708 waiting on condition [0x00007fab28847000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at org.schema.schine.network.server.ServerProcessor$ServerPing.run(SourceFile:1048)
	at java.lang.Thread.run(Thread.java:745)

"SERVER-PROCESSOR: null; PID: 467" #3070 daemon prio=5 os_prio=0 tid=0x000000000194e000 nid=0x1707 waiting for monitor entry [0x00007fabd84a3000]
   java.lang.Thread.State: BLOCKED (on object monitor)
	at org.schema.schine.network.server.ServerProcessor.run(SourceFile:564)
	- waiting to lock <0x00000003fcd8d168> (a obfuscated.aoY)
	at java.lang.Thread.run(Thread.java:745)

"SendingQueueThread(null)" #3069 daemon prio=5 os_prio=0 tid=0x00007fabb8068000 nid=0x16ee in Object.wait() [0x00007fab29150000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at org.schema.schine.network.server.ServerProcessor$SendingQueueThread.run(SourceFile:865)
	- locked <0x00000003c9edb588> (a it.unimi.dsi.fastutil.objects.ObjectArrayFIFOQueue)

"ServerPing null" #3068 daemon prio=5 os_prio=0 tid=0x00007fabb8067800 nid=0x16ed waiting on condition [0x00007fab29857000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at org.schema.schine.network.server.ServerProcessor$ServerPing.run(SourceFile:1048)
	at java.lang.Thread.run(Thread.java:745)

"SERVER-PROCESSOR: null; PID: 466" #3067 daemon prio=5 os_prio=0 tid=0x000000000194d000 nid=0x16ec waiting for monitor entry [0x00007fabd99b8000]
   java.lang.Thread.State: BLOCKED (on object monitor)
	at org.schema.schine.network.server.ServerProcessor.run(SourceFile:564)
	- waiting to lock <0x00000003fcd8d168> (a obfuscated.aoY)
	at java.lang.Thread.run(Thread.java:745)

"SERVER-PROCESSOR: null; PID: 465" #3064 daemon prio=5 os_prio=0 tid=0x000000000193a800 nid=0x16ad waiting for monitor entry [0x00007fab20f01000]
   java.lang.Thread.State: BLOCKED (on object monitor)
	at org.schema.schine.network.server.ServerProcessor.run(SourceFile:564)
	- waiting to lock <0x00000003fcd8d168> (a obfuscated.aoY)
	at java.lang.Thread.run(Thread.java:745)

"SendingQueueThread(RegisteredClient: TheGeek007 (35) [TheGeek007]connected: true)" #2962 daemon prio=5 os_prio=0 tid=0x00007fabb8066800 nid=0x1647 in Object.wait() [0x00007fab26423000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at org.schema.schine.network.server.ServerProcessor$SendingQueueThread.run(SourceFile:865)
	- locked <0x00000004510ea6d8> (a it.unimi.dsi.fastutil.objects.ObjectArrayFIFOQueue)

"ServerPing RegisteredClient: TheGeek007 (35) [TheGeek007]connected: true" #2961 daemon prio=5 os_prio=0 tid=0x00007fabb801e000 nid=0x1646 waiting on condition [0x00007fab338f7000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at org.schema.schine.network.server.ServerProcessor$ServerPing.run(SourceFile:1048)
	at java.lang.Thread.run(Thread.java:745)

"SERVER-PROCESSOR: RegisteredClient: TheGeek007 (35) [TheGeek007]connected: true; PID: 431" #2960 daemon prio=5 os_prio=0 tid=0x0000000001930000 nid=0x1645 waiting for monitor entry [0x00007fab2dc9b000]
   java.lang.Thread.State: BLOCKED (on object monitor)
	at org.schema.schine.network.server.ServerProcessor.run(SourceFile:564)
	- waiting to lock <0x00000003fcd8d168> (a obfuscated.aoY)
	at java.lang.Thread.run(Thread.java:745)

"SendingQueueThread(RegisteredClient: TechPriest (34) [Tech-priest]connected: true)" #2936 daemon prio=5 os_prio=0 tid=0x00007fabb8064800 nid=0x1567 in Object.wait() [0x00007fab187ae000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at org.schema.schine.network.server.ServerProcessor$SendingQueueThread.run(SourceFile:865)
	- locked <0x0000000430fb9a00> (a it.unimi.dsi.fastutil.objects.ObjectArrayFIFOQueue)

"ServerPing RegisteredClient: TechPriest (34) [Tech-priest]connected: true" #2935 daemon prio=5 os_prio=0 tid=0x00007fabb8047000 nid=0x1566 waiting on condition [0x00007fab23bfb000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at org.schema.schine.network.server.ServerProcessor$ServerPing.run(SourceFile:1048)
	at java.lang.Thread.run(Thread.java:745)

"SERVER-PROCESSOR: RegisteredClient: TechPriest (34) [Tech-priest]connected: true; PID: 423" #2934 daemon prio=5 os_prio=0 tid=0x0000000001917800 nid=0x1565 waiting for monitor entry [0x00007fab2a968000]
   java.lang.Thread.State: BLOCKED (on object monitor)
	at org.schema.schine.network.server.ServerProcessor.run(SourceFile:564)
	- waiting to lock <0x00000003fcd8d168> (a obfuscated.aoY)
	at java.lang.Thread.run(Thread.java:745)

"Java2D Disposer" #2880 daemon prio=10 os_prio=0 tid=0x00007fab3870e800 nid=0x1433 in Object.wait() [0x00007fab27635000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
	- locked <0x000000044ec9fae0> (a java.lang.ref.ReferenceQueue$Lock)
	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
	at sun.java2d.Disposer.run(Disposer.java:148)
	at java.lang.Thread.run(Thread.java:745)

"SendingQueueThread(RegisteredClient: RemitormDarkwind (33) [captainairspeed]connected: true)" #2538 daemon prio=5 os_prio=0 tid=0x00007fabb8066000 nid=0x12a2 in Object.wait() [0x00007fab27d3c000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at org.schema.schine.network.server.ServerProcessor$SendingQueueThread.run(SourceFile:865)
	- locked <0x0000000462cf2980> (a it.unimi.dsi.fastutil.objects.ObjectArrayFIFOQueue)

"ServerPing RegisteredClient: RemitormDarkwind (33) [captainairspeed]connected: true" #2537 daemon prio=5 os_prio=0 tid=0x00007fabb8065000 nid=0x12a1 waiting on condition [0x00007fab27f3e000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at org.schema.schine.network.server.ServerProcessor$ServerPing.run(SourceFile:1048)
	at java.lang.Thread.run(Thread.java:745)

"SERVER-PROCESSOR: RegisteredClient: RemitormDarkwind (33) [captainairspeed]connected: true; PID: 405" #2536 daemon prio=5 os_prio=0 tid=0x000000000193b800 nid=0x12a0 waiting for monitor entry [0x00007fab29251000]
   java.lang.Thread.State: BLOCKED (on object monitor)
	at org.schema.schine.network.server.ServerProcessor.run(SourceFile:564)
	- waiting to lock <0x00000003fcd8d168> (a obfuscated.aoY)
	at java.lang.Thread.run(Thread.java:745)

"SendingQueueThread(RegisteredClient: Sachys (32) [Sachys]connected: true)" #2530 daemon prio=5 os_prio=0 tid=0x00007fabb802a800 nid=0x125b in Object.wait() [0x00007fabda5c8000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at org.schema.schine.network.server.ServerProcessor$SendingQueueThread.run(SourceFile:865)
	- locked <0x000000041f6c9ba8> (a it.unimi.dsi.fastutil.objects.ObjectArrayFIFOQueue)

"ServerPing RegisteredClient: Sachys (32) [Sachys]connected: true" #2529 daemon prio=5 os_prio=0 tid=0x00007fabb8029800 nid=0x125a waiting on condition [0x00007fab15f86000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at org.schema.schine.network.server.ServerProcessor$ServerPing.run(SourceFile:1048)
	at java.lang.Thread.run(Thread.java:745)

"SERVER-PROCESSOR: RegisteredClient: Sachys (32) [Sachys]connected: true; PID: 403" #2528 daemon prio=5 os_prio=0 tid=0x000000000192e800 nid=0x1259 waiting for monitor entry [0x00007fab25817000]
   java.lang.Thread.State: BLOCKED (on object monitor)
	at org.schema.schine.network.server.ServerProcessor.run(SourceFile:564)
	- waiting to lock <0x00000003fcd8d168> (a obfuscated.aoY)
	at java.lang.Thread.run(Thread.java:745)

"SendingQueueThread(RegisteredClient: Wolfe (31) [lordWolfe]connected: true)" #2517 daemon prio=5 os_prio=0 tid=0x00007fabb8063000 nid=0x124e in Object.wait() [0x00007fab28140000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at org.schema.schine.network.server.ServerProcessor$SendingQueueThread.run(SourceFile:865)
	- locked <0x00000004a7d50928> (a it.unimi.dsi.fastutil.objects.ObjectArrayFIFOQueue)

"ServerPing RegisteredClient: Wolfe (31) [lordWolfe]connected: true" #2516 daemon prio=5 os_prio=0 tid=0x00007fabb8053800 nid=0x124d waiting on condition [0x00007fab23dfd000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at org.schema.schine.network.server.ServerProcessor$ServerPing.run(SourceFile:1048)
	at java.lang.Thread.run(Thread.java:745)

"SERVER-PROCESSOR: RegisteredClient: Wolfe (31) [lordWolfe]connected: true; PID: 399" #2515 daemon prio=5 os_prio=0 tid=0x0000000001939000 nid=0x124c waiting for monitor entry [0x00007fab33efd000]
   java.lang.Thread.State: BLOCKED (on object monitor)
	at org.schema.schine.network.server.ServerProcessor.run(SourceFile:564)
	- waiting to lock <0x00000003fcd8d168> (a obfuscated.aoY)
	at java.lang.Thread.run(Thread.java:745)

"SendingQueueThread(RegisteredClient: Jake_Lancia (30) [Jake_Lancia]connected: true)" #2513 daemon prio=5 os_prio=0 tid=0x00007fabb8005800 nid=0x124a in Object.wait() [0x00007fab13b62000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at org.schema.schine.network.server.ServerProcessor$SendingQueueThread.run(SourceFile:865)
	- locked <0x00000004a7d52208> (a it.unimi.dsi.fastutil.objects.ObjectArrayFIFOQueue)

"ServerPing RegisteredClient: Jake_Lancia (30) [Jake_Lancia]connected: true" #2512 daemon prio=5 os_prio=0 tid=0x00007fabb8013800 nid=0x1249 waiting on condition [0x00007fab226e6000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at org.schema.schine.network.server.ServerProcessor$ServerPing.run(SourceFile:1048)
	at java.lang.Thread.run(Thread.java:745)

"SERVER-PROCESSOR: RegisteredClient: Jake_Lancia (30) [Jake_Lancia]connected: true; PID: 398" #2511 daemon prio=5 os_prio=0 tid=0x0000000001927800 nid=0x1248 waiting for monitor entry [0x00007fab22ded000]
   java.lang.Thread.State: BLOCKED (on object monitor)
	at org.schema.schine.network.server.ServerProcessor.run(SourceFile:564)
	- waiting to lock <0x00000003fcd8d168> (a obfuscated.aoY)
	at java.lang.Thread.run(Thread.java:745)

"SendingQueueThread(RegisteredClient: funboy1243 (29) [funboy1243]connected: true)" #2013 daemon prio=5 os_prio=0 tid=0x00007fabb8031800 nid=0xe4b in Object.wait() [0x00007fabd8aa9000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at org.schema.schine.network.server.ServerProcessor$SendingQueueThread.run(SourceFile:865)
	- locked <0x00000004419c6188> (a it.unimi.dsi.fastutil.objects.ObjectArrayFIFOQueue)

"ServerPing RegisteredClient: funboy1243 (29) [funboy1243]connected: true" #2012 daemon prio=5 os_prio=0 tid=0x00007fabb8028800 nid=0xe4a waiting on condition [0x00007fab28443000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at org.schema.schine.network.server.ServerProcessor$ServerPing.run(SourceFile:1048)
	at java.lang.Thread.run(Thread.java:745)

"SERVER-PROCESSOR: RegisteredClient: funboy1243 (29) [funboy1243]connected: true; PID: 371" #2011 daemon prio=5 os_prio=0 tid=0x0000000001933000 nid=0xe49 waiting for monitor entry [0x00007fab2da99000]
   java.lang.Thread.State: BLOCKED (on object monitor)
	at org.schema.schine.network.server.ServerProcessor.run(SourceFile:564)
	- waiting to lock <0x00000003fcd8d168> (a obfuscated.aoY)
	at java.lang.Thread.run(Thread.java:745)

"SendingQueueThread(RegisteredClient: Swag (27) [SwagMcTwerkster]connected: true)" #1970 daemon prio=5 os_prio=0 tid=0x00007fabb8038000 nid=0xd81 in Object.wait() [0x00007fab18cb3000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at org.schema.schine.network.server.ServerProcessor$SendingQueueThread.run(SourceFile:865)
	- locked <0x00000004000297f8> (a it.unimi.dsi.fastutil.objects.ObjectArrayFIFOQueue)

"ServerPing RegisteredClient: Swag (27) [SwagMcTwerkster]connected: true" #1969 daemon prio=5 os_prio=0 tid=0x00007fabb802f800 nid=0xd80 waiting on condition [0x00007fab186ad000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at org.schema.schine.network.server.ServerProcessor$ServerPing.run(SourceFile:1048)
	at java.lang.Thread.run(Thread.java:745)

"SERVER-PROCESSOR: RegisteredClient: Swag (27) [SwagMcTwerkster]connected: true; PID: 358" #1968 daemon prio=5 os_prio=0 tid=0x0000000001903000 nid=0xd7f waiting for monitor entry [0x00007fab22eee000]
   java.lang.Thread.State: BLOCKED (on object monitor)
	at org.schema.schine.network.server.ServerProcessor.run(SourceFile:564)
	- waiting to lock <0x00000003fcd8d168> (a obfuscated.aoY)
	at java.lang.Thread.run(Thread.java:745)

"SendingQueueThread(RegisteredClient: Nocturna (25) [Nocturna]connected: true)" #1883 daemon prio=5 os_prio=0 tid=0x00007fabb804a000 nid=0xb48 in Object.wait() [0x00007fab2f9b8000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at org.schema.schine.network.server.ServerProcessor$SendingQueueThread.run(SourceFile:865)
	- locked <0x00000004a8d31c38> (a it.unimi.dsi.fastutil.objects.ObjectArrayFIFOQueue)

"ServerPing RegisteredClient: Nocturna (25) [Nocturna]connected: true" #1882 daemon prio=5 os_prio=0 tid=0x00007fabb804b000 nid=0xb47 waiting on condition [0x00007fab18eb5000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at org.schema.schine.network.server.ServerProcessor$ServerPing.run(SourceFile:1048)
	at java.lang.Thread.run(Thread.java:745)

"SERVER-PROCESSOR: RegisteredClient: Nocturna (25) [Nocturna]connected: true; PID: 330" #1881 daemon prio=5 os_prio=0 tid=0x0000000001931000 nid=0xb46 waiting for monitor entry [0x00007fab25110000]
   java.lang.Thread.State: BLOCKED (on object monitor)
	at org.schema.schine.network.server.ServerProcessor.run(SourceFile:564)
	- waiting to lock <0x00000003fcd8d168> (a obfuscated.aoY)
	at java.lang.Thread.run(Thread.java:745)

"SendingQueueThread(RegisteredClient: MisterCraft506 (23) [MisterCraft506]connected: true)" #1831 daemon prio=5 os_prio=0 tid=0x00007fabb801d800 nid=0x95b in Object.wait() [0x00007fab2bb7a000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at org.schema.schine.network.server.ServerProcessor$SendingQueueThread.run(SourceFile:865)
	- locked <0x000000046d311508> (a it.unimi.dsi.fastutil.objects.ObjectArrayFIFOQueue)

"ServerPing RegisteredClient: MisterCraft506 (23) [MisterCraft506]connected: true" #1830 daemon prio=5 os_prio=0 tid=0x00007fabb803a800 nid=0x95a waiting on condition [0x00007fab2c988000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at org.schema.schine.network.server.ServerProcessor$ServerPing.run(SourceFile:1048)
	at java.lang.Thread.run(Thread.java:745)

"SERVER-PROCESSOR: RegisteredClient: MisterCraft506 (23) [MisterCraft506]connected: true; PID: 315" #1829 daemon prio=5 os_prio=0 tid=0x000000000191d800 nid=0x959 waiting for monitor entry [0x00007fabdaccd000]
   java.lang.Thread.State: BLOCKED (on object monitor)
	at org.schema.schine.network.server.ServerProcessor.run(SourceFile:564)
	- waiting to lock <0x00000003fcd8d168> (a obfuscated.aoY)
	at java.lang.Thread.run(Thread.java:745)

"SendingQueueThread(RegisteredClient: Saskini (22) [Saskini]connected: true)" #1818 daemon prio=5 os_prio=0 tid=0x00007fabb803a000 nid=0x94d in Object.wait() [0x00007fab2a160000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at org.schema.schine.network.server.ServerProcessor$SendingQueueThread.run(SourceFile:865)
	- locked <0x00000003fdfcb110> (a it.unimi.dsi.fastutil.objects.ObjectArrayFIFOQueue)

"ServerPing RegisteredClient: Saskini (22) [Saskini]connected: true" #1817 daemon prio=5 os_prio=0 tid=0x00007fabb8039000 nid=0x94c waiting on condition [0x00007fab1547b000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at org.schema.schine.network.server.ServerProcessor$ServerPing.run(SourceFile:1048)
	at java.lang.Thread.run(Thread.java:745)

"SERVER-PROCESSOR: RegisteredClient: Saskini (22) [Saskini]connected: true; PID: 311" #1816 daemon prio=5 os_prio=0 tid=0x000000000192f000 nid=0x94b waiting for monitor entry [0x00007fabd8cab000]
   java.lang.Thread.State: BLOCKED (on object monitor)
	at org.schema.schine.network.server.ServerProcessor.run(SourceFile:564)
	- waiting to lock <0x00000003fcd8d168> (a obfuscated.aoY)
	at java.lang.Thread.run(Thread.java:745)

"SendingQueueThread(RegisteredClient: Chuchu (15) [chuchu4chu]connected: true)" #1602 daemon prio=5 os_prio=0 tid=0x00007fabb802c000 nid=0x497 in Object.wait() [0x00007fab27b3a000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at org.schema.schine.network.server.ServerProcessor$SendingQueueThread.run(SourceFile:865)
	- locked <0x000000047896e248> (a it.unimi.dsi.fastutil.objects.ObjectArrayFIFOQueue)

"ServerPing RegisteredClient: Chuchu (15) [chuchu4chu]connected: true" #1601 daemon prio=5 os_prio=0 tid=0x00007fabb8022000 nid=0x496 waiting on condition [0x00007fab24c0b000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at org.schema.schine.network.server.ServerProcessor$ServerPing.run(SourceFile:1048)
	at java.lang.Thread.run(Thread.java:745)

"SERVER-PROCESSOR: RegisteredClient: Chuchu (15) [chuchu4chu]connected: true; PID: 245" #1600 daemon prio=5 os_prio=0 tid=0x0000000001920800 nid=0x495 waiting for monitor entry [0x00007fab2cb8a000]
   java.lang.Thread.State: BLOCKED (on object monitor)
	at org.schema.schine.network.server.ServerProcessor.run(SourceFile:564)
	- waiting to lock <0x00000003fcd8d168> (a obfuscated.aoY)
	at java.lang.Thread.run(Thread.java:745)

"SendingQueueThread(RegisteredClient: ErthParadine (3) [Erth Paradine]connected: true)" #596 daemon prio=5 os_prio=0 tid=0x00007fabec042000 nid=0x7419 in Object.wait() [0x00007fabdabcc000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at org.schema.schine.network.server.ServerProcessor$SendingQueueThread.run(SourceFile:865)
	- locked <0x00000003e9b33968> (a it.unimi.dsi.fastutil.objects.ObjectArrayFIFOQueue)

"ServerPing RegisteredClient: ErthParadine (3) [Erth Paradine]connected: true" #595 daemon prio=5 os_prio=0 tid=0x00007fabec041800 nid=0x7418 waiting on condition [0x00007fabda4c3000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at org.schema.schine.network.server.ServerProcessor$ServerPing.run(SourceFile:1048)
	at java.lang.Thread.run(Thread.java:745)

"SERVER-PROCESSOR: RegisteredClient: ErthParadine (3) [Erth Paradine]connected: true; PID: 61" #594 daemon prio=5 os_prio=0 tid=0x00000000018fa000 nid=0x7417 waiting for monitor entry [0x00007fab225e5000]
   java.lang.Thread.State: BLOCKED (on object monitor)
	at org.schema.schine.network.server.ServerProcessor.run(SourceFile:564)
	- waiting to lock <0x00000003fcd8d168> (a obfuscated.aoY)
	at java.lang.Thread.run(Thread.java:745)

"pool-4-thread-25" #525 prio=5 os_prio=0 tid=0x00007fac34055000 nid=0x714e waiting on condition [0x00007fabdb0d3000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c8580> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-4-thread-24" #524 prio=5 os_prio=0 tid=0x00007fac34054800 nid=0x714d waiting on condition [0x00007fab2fab9000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c8580> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-4-thread-23" #523 prio=5 os_prio=0 tid=0x00007fac34053800 nid=0x714c waiting on condition [0x00007fab2ca89000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c8580> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-3-thread-10" #522 prio=5 os_prio=0 tid=0x00007fac44014000 nid=0x714b waiting on condition [0x00007fab337f6000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c86b8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-3-thread-9" #521 prio=5 os_prio=0 tid=0x00007fac44012800 nid=0x714a waiting on condition [0x00007fab2500f000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c86b8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-3-thread-8" #520 prio=5 os_prio=0 tid=0x00007fac44011800 nid=0x7149 waiting on condition [0x00007fab237f7000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c86b8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-3-thread-7" #519 prio=5 os_prio=0 tid=0x00007fac44010800 nid=0x7148 waiting on condition [0x00007fab25e1d000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c86b8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-3-thread-6" #518 prio=5 os_prio=0 tid=0x00007fac4400f800 nid=0x7147 waiting on condition [0x00007fabd93b2000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c86b8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-3-thread-5" #517 prio=5 os_prio=0 tid=0x00007fac4400e000 nid=0x7146 waiting on condition [0x00007fab27332000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c86b8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-3-thread-4" #516 prio=5 os_prio=0 tid=0x00007fac4400d000 nid=0x7145 waiting on condition [0x00007fab2e7a6000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c86b8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-3-thread-3" #515 prio=5 os_prio=0 tid=0x00007fac4400c000 nid=0x7144 waiting on condition [0x00007fab26625000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c86b8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-3-thread-2" #514 prio=5 os_prio=0 tid=0x00007fac4400b000 nid=0x7143 waiting on condition [0x00007fab2a564000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c86b8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-3-thread-1" #513 prio=5 os_prio=0 tid=0x00007fac4400a000 nid=0x7142 waiting on condition [0x00007fabd9ab9000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c86b8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-4-thread-22" #512 prio=5 os_prio=0 tid=0x00007fac34027000 nid=0x713d waiting on condition [0x00007fab2bf7e000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c8580> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-4-thread-21" #511 prio=5 os_prio=0 tid=0x00007fac34025800 nid=0x713c waiting on condition [0x00007fab2efae000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c8580> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-4-thread-20" #510 prio=5 os_prio=0 tid=0x00007fac34024000 nid=0x713b waiting on condition [0x00007fab28f4e000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c8580> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-4-thread-19" #509 prio=5 os_prio=0 tid=0x00007fac34023000 nid=0x713a waiting on condition [0x00007fabd8fae000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c8580> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-4-thread-18" #508 prio=5 os_prio=0 tid=0x00007fac34021800 nid=0x7139 waiting on condition [0x00007fab26f2e000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c8580> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-4-thread-17" #507 prio=5 os_prio=0 tid=0x00007fac34020800 nid=0x7138 waiting on condition [0x00007fab24302000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c8580> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-4-thread-16" #506 prio=5 os_prio=0 tid=0x00007fac3401f000 nid=0x7137 waiting on condition [0x00007fab2cf8e000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c8580> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-4-thread-15" #505 prio=5 os_prio=0 tid=0x00007fac3401d800 nid=0x7136 waiting on condition [0x00007fab2eaa9000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c8580> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-4-thread-14" #504 prio=5 os_prio=0 tid=0x00007fac3401c800 nid=0x7135 waiting on condition [0x00007fabdafce000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c8580> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-4-thread-13" #503 prio=5 os_prio=0 tid=0x00007fac3401b000 nid=0x7134 waiting on condition [0x00007fab2c887000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c8580> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-4-thread-12" #502 prio=5 os_prio=0 tid=0x00007fac34019800 nid=0x7133 waiting on condition [0x00007fab28645000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c8580> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-4-thread-11" #501 prio=5 os_prio=0 tid=0x00007fac34018000 nid=0x7132 waiting on condition [0x00007fab321e0000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c8580> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-4-thread-10" #500 prio=5 os_prio=0 tid=0x00007fac34016800 nid=0x7131 waiting on condition [0x00007fab2e09f000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c8580> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-4-thread-9" #499 prio=5 os_prio=0 tid=0x00007fac34015800 nid=0x7130 waiting on condition [0x00007fab2cd8c000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c8580> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-4-thread-8" #498 prio=5 os_prio=0 tid=0x00007fac34011800 nid=0x712f waiting on condition [0x00007fabd91b0000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c8580> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-4-thread-7" #497 prio=5 os_prio=0 tid=0x00007fac34012800 nid=0x712e waiting on condition [0x00007fab2e1a0000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c8580> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-4-thread-6" #496 prio=5 os_prio=0 tid=0x00007fac34010000 nid=0x712d waiting on condition [0x00007fab301c0000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c8580> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-4-thread-5" #495 prio=5 os_prio=0 tid=0x00007fac3400e800 nid=0x712c waiting on condition [0x00007fab2d392000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c8580> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-4-thread-4" #494 prio=5 os_prio=0 tid=0x00007fac3400d800 nid=0x712b waiting on condition [0x00007fabd8dac000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c8580> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-4-thread-3" #493 prio=5 os_prio=0 tid=0x00007fac3400c000 nid=0x712a waiting on condition [0x00007fab26827000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c8580> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-4-thread-2" #492 prio=5 os_prio=0 tid=0x00007fac3400a800 nid=0x7129 waiting on condition [0x00007fab33cfb000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c8580> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"pool-4-thread-1" #491 prio=5 os_prio=0 tid=0x00007fac34003000 nid=0x7128 waiting on condition [0x00007fab303c2000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x00000004020c8580> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
	at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
	at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)

"Attach Listener" #376 daemon prio=9 os_prio=0 tid=0x00007fabec001800 nid=0x6d32 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Thread-5" #369 daemon prio=1 os_prio=0 tid=0x00000000018fc800 nid=0x6ccd waiting on condition [0x00007fab201f8000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at org.schema.schine.network.server.ServerSender.run(SourceFile:38)

"ServerController" #368 prio=5 os_prio=0 tid=0x00007fabf4935000 nid=0x6ccc waiting for monitor entry [0x00007fab202f9000]
   java.lang.Thread.State: BLOCKED (on object monitor)
	at org.schema.schine.network.server.ServerController.synchronizePrivate(SourceFile:462)
	- waiting to lock <0x00000003fcd8d168> (a obfuscated.aoY)
	at org.schema.schine.network.server.ServerController.synchronize(SourceFile:390)
	at org.schema.game.server.controller.GameServerController.update(SourceFile:1410)
	at org.schema.schine.network.server.ServerController.run(SourceFile:256)
	at java.lang.Thread.run(Thread.java:745)

"ServerListener" #367 daemon prio=5 os_prio=0 tid=0x00007fabf4934000 nid=0x6ccb runnable [0x00007fab203fa000]
   java.lang.Thread.State: RUNNABLE
	at java.net.PlainSocketImpl.socketAccept(Native Method)
	at java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
	at java.net.ServerSocket.implAccept(ServerSocket.java:545)
	at java.net.ServerSocket.accept(ServerSocket.java:513)
	at org.schema.schine.network.server.ServerListener.run(SourceFile:204)
	at java.lang.Thread.run(Thread.java:745)

"SimPlanner" #357 daemon prio=5 os_prio=0 tid=0x00007fabf4875800 nid=0x6cca waiting on condition [0x00007fab206fb000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
	at java.lang.Thread.sleep(Native Method)
	at obfuscated.aqd.run(SourceFile:72)

"ElementCollectionCalculationThreadManager" #361 daemon prio=4 os_prio=0 tid=0x00007fabf46b1800 nid=0x6cc9 in Object.wait() [0x00007fab209fc000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at org.schema.game.common.controller.elements.ElementCollectionCalculationThreadManager.getNextQueueElement(SourceFile:77)
	- locked <0x00000004019da530> (a it.unimi.dsi.fastutil.objects.ObjectArrayList)
	at org.schema.game.common.controller.elements.ElementCollectionCalculationThreadManager.run(SourceFile:40)

"SegmentPFG" #366 daemon prio=1 os_prio=0 tid=0x00007fabf46ae000 nid=0x6cc8 in Object.wait() [0x00007fab20afd000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at obfuscated.anm.run(SourceFile:66)
	- locked <0x00000004015391a0> (a it.unimi.dsi.fastutil.objects.ObjectArrayFIFOQueue)

"SegmentPF" #365 daemon prio=1 os_prio=0 tid=0x00007fabf46ac000 nid=0x6cc7 in Object.wait() [0x00007fab20bfe000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at obfuscated.anm.run(SourceFile:66)
	- locked <0x00000004010442f0> (a it.unimi.dsi.fastutil.objects.ObjectArrayFIFOQueue)

"ServerSegmentRequestThread" #363 daemon prio=5 os_prio=0 tid=0x00007fabf4698800 nid=0x6cc6 in Object.wait() [0x00007fab20cff000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at obfuscated.amY.a(SourceFile:28)
	- locked <0x00000003f866e7d8> (a it.unimi.dsi.fastutil.objects.ObjectArrayFIFOQueue)
	at obfuscated.amY.run(SourceFile:41)

"SysInListener" #359 daemon prio=5 os_prio=0 tid=0x00007fabf46aa800 nid=0x6cc4 runnable [0x00007fab20e00000]
   java.lang.Thread.State: RUNNABLE
	at java.io.FileInputStream.readBytes(Native Method)
	at java.io.FileInputStream.read(FileInputStream.java:255)
	at java.io.BufferedInputStream.read1(BufferedInputStream.java:284)
	at java.io.BufferedInputStream.read(BufferedInputStream.java:345)
	- locked <0x00000003ec419f08> (a java.io.BufferedInputStream)
	at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284)
	at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326)
	at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178)
	- locked <0x0000000401ab2120> (a java.io.InputStreamReader)
	at java.io.InputStreamReader.read(InputStreamReader.java:184)
	at java.io.BufferedReader.fill(BufferedReader.java:161)
	at java.io.BufferedReader.readLine(BufferedReader.java:324)
	- locked <0x0000000401ab2120> (a java.io.InputStreamReader)
	at java.io.BufferedReader.readLine(BufferedReader.java:389)
	at org.schema.schine.network.server.ServerController$SystemInListener.run(SourceFile:579)
	at java.lang.Thread.run(Thread.java:745)

"HSQLDB Timer @3d27caa5" #356 daemon prio=5 os_prio=0 tid=0x00007fabf4636800 nid=0x6cc2 in Object.wait() [0x00007fab21202000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at org.hsqldb.lib.HsqlTimer$TaskQueue.park(Unknown Source)
	- locked <0x00000003fca774a0> (a org.hsqldb.lib.HsqlTimer$TaskQueue)
	at org.hsqldb.lib.HsqlTimer.nextTask(Unknown Source)
	- locked <0x00000003fca774a0> (a org.hsqldb.lib.HsqlTimer$TaskQueue)
	at org.hsqldb.lib.HsqlTimer$TaskRunner.run(Unknown Source)
	at java.lang.Thread.run(Thread.java:745)

"GalaxyZoneRequestThreadServer" #355 prio=5 os_prio=0 tid=0x00007fabf457c000 nid=0x6cc1 in Object.wait() [0x00007fab21503000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at obfuscated.acq.run(SourceFile:278)
	- locked <0x00000003f866e7f8> (a it.unimi.dsi.fastutil.objects.ObjectArrayFIFOQueue)
	at java.lang.Thread.run(Thread.java:745)

"GalaxyRequestThreadServer" #354 prio=5 os_prio=0 tid=0x00007fabf457a000 nid=0x6cc0 in Object.wait() [0x00007fab21604000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at obfuscated.acp.run(SourceFile:251)
	- locked <0x00000003f866e818> (a it.unimi.dsi.fastutil.objects.ObjectArrayFIFOQueue)
	at java.lang.Thread.run(Thread.java:745)

"GameMapProvider" #353 daemon prio=5 os_prio=0 tid=0x00007fabf4574800 nid=0x6cbf in Object.wait() [0x00007fab21905000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at obfuscated.amJ.run(SourceFile:78)
	- locked <0x00000003f866e778> (a it.unimi.dsi.fastutil.objects.ObjectArrayFIFOQueue)

"MobSpawnThread" #352 daemon prio=3 os_prio=0 tid=0x00007fabf456b800 nid=0x6cbe in Object.wait() [0x00007fab21a06000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at obfuscated.apb.run(SourceFile:1874)
	- locked <0x00000003fca68068> (a java.util.ArrayList)

"SERVER_SEGMENT_WRITER_THREAD" #351 daemon prio=5 os_prio=0 tid=0x00007fabf404d000 nid=0x6cbd in Object.wait() [0x00007fab21b07000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at obfuscated.QO.a(SourceFile:27)
	- locked <0x00000003f866e798> (a java.util.LinkedList)
	at obfuscated.Rd.run(SourceFile:43)
	at java.lang.Thread.run(Thread.java:745)

"ServerEntityWriterThread" #350 daemon prio=5 os_prio=0 tid=0x00007fabf404b000 nid=0x6cbc waiting on condition [0x00007fab21c08000]
   java.lang.Thread.State: WAITING (parking)
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x000000043323c620> (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283)
	at java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727)
	at obfuscated.acw.a(SourceFile:455)
	- locked <0x00000004a4e8b790> (a [B)
	at org.schema.game.common.controller.io.SegmentDataIO.a(SourceFile:943)
	at obfuscated.Su.handle(SourceFile:2062)
	at obfuscated.Sc.a(SourceFile:382)
	at org.schema.game.common.controller.SegmentBuffer.a(SourceFile:646)
	- locked <0x000000048b3655d0> (a org.schema.game.common.controller.SegmentBuffer)
	at org.schema.game.common.controller.SegmentBufferManager.a(SourceFile:513)
	- locked <0x000000043b0c14a0> (a it.unimi.dsi.fastutil.longs.Long2ObjectOpenHashMap)
	at obfuscated.Sr.writeAllBufferedSegmentsToDatabase(SourceFile:290)
	- locked <0x0000000435b5ef88> (a org.schema.game.common.controller.SegmentBufferManager)
	at obfuscated.acx.a(SourceFile:2408)
	at obfuscated.acx.a(SourceFile:107)
	at obfuscated.acA.run(SourceFile:2486)
	- locked <0x00000003fccb1b28> (a org.schema.schine.network.NetworkStateContainer)
	- locked <0x00000003fcd8d168> (a obfuscated.aoY)
	at org.schema.schine.network.server.ServerEntityWriterThread.run(SourceFile:48)

"DestroyJavaVM" #349 prio=5 os_prio=0 tid=0x00007fac58009000 nid=0x6b54 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Service Thread" #10 daemon prio=9 os_prio=0 tid=0x00007fac5817f000 nid=0x6b69 runnable [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C1 CompilerThread3" #9 daemon prio=9 os_prio=0 tid=0x00007fac5816c000 nid=0x6b68 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread2" #8 daemon prio=9 os_prio=0 tid=0x00007fac58169800 nid=0x6b67 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread1" #7 daemon prio=9 os_prio=0 tid=0x00007fac58167800 nid=0x6b66 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread0" #6 daemon prio=9 os_prio=0 tid=0x00007fac58165000 nid=0x6b65 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Signal Dispatcher" #5 daemon prio=9 os_prio=0 tid=0x00007fac58158800 nid=0x6b64 runnable [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Surrogate Locker Thread (Concurrent GC)" #4 daemon prio=9 os_prio=0 tid=0x00007fac58156800 nid=0x6b63 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Finalizer" #3 daemon prio=8 os_prio=0 tid=0x00007fac5812e000 nid=0x6b62 in Object.wait() [0x00007fac10bb0000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
	- locked <0x00000003ebb3a1f0> (a java.lang.ref.ReferenceQueue$Lock)
	at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
	at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)

"Reference Handler" #2 daemon prio=10 os_prio=0 tid=0x00007fac58129800 nid=0x6b61 in Object.wait() [0x00007fac281e3000]
   java.lang.Thread.State: WAITING (on object monitor)
	at java.lang.Object.wait(Native Method)
	at java.lang.Object.wait(Object.java:502)
	at java.lang.ref.Reference.tryHandlePending(Reference.java:191)
	- locked <0x00000003ebb3a220> (a java.lang.ref.Reference$Lock)
	at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)

"VM Thread" os_prio=0 tid=0x00007fac5811f800 nid=0x6b60 runnable 

"Gang worker#0 (Parallel GC Threads)" os_prio=0 tid=0x00007fac5801a000 nid=0x6b55 runnable 

"Gang worker#1 (Parallel GC Threads)" os_prio=0 tid=0x00007fac5801b800 nid=0x6b56 runnable 

"Gang worker#2 (Parallel GC Threads)" os_prio=0 tid=0x00007fac5801d800 nid=0x6b57 runnable 

"Gang worker#3 (Parallel GC Threads)" os_prio=0 tid=0x00007fac5801f800 nid=0x6b58 runnable 

"Gang worker#4 (Parallel GC Threads)" os_prio=0 tid=0x00007fac58021000 nid=0x6b59 runnable 

"Gang worker#5 (Parallel GC Threads)" os_prio=0 tid=0x00007fac58023000 nid=0x6b5a runnable 

"Gang worker#6 (Parallel GC Threads)" os_prio=0 tid=0x00007fac58024800 nid=0x6b5b runnable 

"Gang worker#7 (Parallel GC Threads)" os_prio=0 tid=0x00007fac58026800 nid=0x6b5c runnable 

"Concurrent Mark-Sweep GC Thread" os_prio=0 tid=0x00007fac58097800 nid=0x6b5f runnable 

"Gang worker#0 (Parallel CMS Threads)" os_prio=0 tid=0x00007fac58093800 nid=0x6b5d runnable 

"Gang worker#1 (Parallel CMS Threads)" os_prio=0 tid=0x00007fac58095800 nid=0x6b5e runnable 

"VM Periodic Task Thread" os_prio=0 tid=0x00007fac58181800 nid=0x6b6a waiting on condition 

JNI global references: 313


Found one Java-level deadlock:
=============================
"SERVER-PROCESSOR: null; PID: 467":
  waiting to lock monitor 0x00007fabb806d698 (object 0x00000003fcd8d168, a obfuscated.aoY),
  which is held by "ServerEntityWriterThread"
"ServerEntityWriterThread":
  waiting for ownable synchronizer 0x000000043323c620, (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync),
  which is held by "ServerController"
"ServerController":
  waiting to lock monitor 0x00007fabb806d698 (object 0x00000003fcd8d168, a obfuscated.aoY),
  which is held by "ServerEntityWriterThread"

Java stack information for the threads listed above:
===================================================
"SERVER-PROCESSOR: null; PID: 467":
	at org.schema.schine.network.server.ServerProcessor.run(SourceFile:564)
	- waiting to lock <0x00000003fcd8d168> (a obfuscated.aoY)
	at java.lang.Thread.run(Thread.java:745)
"ServerEntityWriterThread":
	at sun.misc.Unsafe.park(Native Method)
	- parking to wait for  <0x000000043323c620> (a java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync)
	at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireShared(AbstractQueuedSynchronizer.java:967)
	at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireShared(AbstractQueuedSynchronizer.java:1283)
	at java.util.concurrent.locks.ReentrantReadWriteLock$ReadLock.lock(ReentrantReadWriteLock.java:727)
	at obfuscated.acw.a(SourceFile:455)
	- locked <0x00000004a4e8b790> (a [B)
	at org.schema.game.common.controller.io.SegmentDataIO.a(SourceFile:943)
	at obfuscated.Su.handle(SourceFile:2062)
	at obfuscated.Sc.a(SourceFile:382)
	at org.schema.game.common.controller.SegmentBuffer.a(SourceFile:646)
	- locked <0x000000048b3655d0> (a org.schema.game.common.controller.SegmentBuffer)
	at org.schema.game.common.controller.SegmentBufferManager.a(SourceFile:513)
	- locked <0x000000043b0c14a0> (a it.unimi.dsi.fastutil.longs.Long2ObjectOpenHashMap)
	at obfuscated.Sr.writeAllBufferedSegmentsToDatabase(SourceFile:290)
	- locked <0x0000000435b5ef88> (a org.schema.game.common.controller.SegmentBufferManager)
	at obfuscated.acx.a(SourceFile:2408)
	at obfuscated.acx.a(SourceFile:107)
	at obfuscated.acA.run(SourceFile:2486)
	- locked <0x00000003fccb1b28> (a org.schema.schine.network.NetworkStateContainer)
	- locked <0x00000003fcd8d168> (a obfuscated.aoY)
	at org.schema.schine.network.server.ServerEntityWriterThread.run(SourceFile:48)
"ServerController":
	at org.schema.schine.network.server.ServerController.synchronizePrivate(SourceFile:462)
	- waiting to lock <0x00000003fcd8d168> (a obfuscated.aoY)
	at org.schema.schine.network.server.ServerController.synchronize(SourceFile:390)
	at org.schema.game.server.controller.GameServerController.update(SourceFile:1410)
	at org.schema.schine.network.server.ServerController.run(SourceFile:256)
	at java.lang.Thread.run(Thread.java:745)

Found 1 deadlock.

Related Objects

Duplicates Merged Here
T1369: Deadlock in server

Event Timeline

AndyP created this task.Apr 18 2016, 7:59 PM
AndyP created this object in space S3 Starmade.
AndyP created this object with visibility "Public (No Login Required)".
AndyP created this object with edit policy "Starmade (Project)".
Restricted Application removed a project: Issue Navigation. · View Herald TranscriptApr 18 2016, 8:01 PM
erthparadine added a comment.Apr 22 2016, 3:00 PM

Just wanted to followup. We've seen a number of additional deadlock conditions since reporting this bug. One is tagged as a duplicate to this task. I haven't submitted the additional ones. These are very disruptive to our player-base, especially since the crashes result in world rollbacks of around 15-20 minutes; lost ships, lost materials, and pilots respawning to find themselves spaced, and their ship multiple sectors away.

Anything we can offer to assist you with further analysis, I'm very happy to help provide.

I will also continue seeking feedback from the player-base, to determine if anyone can correlate their actions with these crashes.

erthparadine added a comment.EditedApr 22 2016, 3:32 PM

Here's a little more info on what pilots were doing at the time the server was most recently forcefully shutdown due to a detected deadlock: we have automated 5 minute checks (via analysis of jstack dumps). If 1st check detects a deadlock we attempt an orderly server shutdown, failing that the server's java instance is forcefully killed after 2 additional minutes. The intent of a forceful shutdown is mostly to minimize pilot impact: deadlocks seem to prevent any proceeding saving of work, until the server is restarted.

I'm trying to hone-in on a repeatable task. I'm sorry it's not more detailed, but perhaps it helps:
Nocturna: in shipyard, improving upon his "blue rose" class ship, placing reactor blocks
Sachys: idling in space, thinking. Saw a class cast error. Also indicated he lost about one hour of earlier work in a shipyard.
TechPriest: in shipyard, unclear of actual tasks

schema changed the task status from In Queue (Game) to Resolved.Aug 9 2016, 10:51 AM
Restricted Application edited projects, added Quality Assurance; removed Game Development. · View Herald TranscriptAug 9 2016, 10:51 AM
AndyP moved this task from Backlog / Unclassed to Confirmed fix on the Quality Assurance board.Feb 23 2017, 11:39 PM
AndyP closed this task as Closed.

Did not happen for a long time now.
Assuming fix works.

Restricted Application removed a project: Quality Assurance. · View Herald TranscriptFeb 23 2017, 11:39 PM
Restricted Application added a project: Engine. · View Herald TranscriptMar 10 2017, 6:14 PM