Server Crash

Status
Not open for further replies.
E

estiaan1234

New member
Hi Guys,

My Server Keeps crashing these past few days,

The 7dtd server is installed on a linux based system running a core i7 7700k with 8gb ram but the server only uses 3.5-4.5gb of ram at max I've monitored it when it crashes then the ram is at 4.5gb

on the server log i am receiving this at the end of the log

$

Receiving unhandled NULL exception

#0 0x007fd3cbdc602a in (Unknown)

#1 0x007fd3c9744b3a in (Unknown)

#2 0x007fd3c9744ba7 in (Unknown)

#3 0x007fd3c9747a9d in (Unknown)

#4 0x007fd3c9747e6a in (Unknown)

#5 0x007fd3c974a119 in (Unknown)

#6 0x007fd3c974b6c3 in (Unknown)

#7 0x000000410f2236 in (wrapper managed-to-native) System.GC:InternalCollect (int)

#8 0x000000410ffc00 in GameManager:Update ()

#9 0x007fd3c95680ad in (Unknown)

#10 0x007fd3c96d399b in (Unknown)

#11 0x007fd3c96d4848 in (Unknown)

#12 0x005632721c4e54 in (Unknown)

#13 0x005632721c0b99 in (Unknown)

#14 0x005632721a23cf in (Unknown)

#15 0x00563271f40d9a in (Unknown)

#16 0x005632720a89fa in (Unknown)

#17 0x005632720a8ab8 in (Unknown)

#18 0x005632720abec0 in (Unknown)

#19 0x005632719d543f in (Unknown)

#20 0x007fd3cbdaf830 in (Unknown)

#21 0x005632719e5403 in (Unknown)

and thats what happens before that a player just joined nothing specifically to indicate why it crashed

 
It's a bug with Unity. Known issue that I've reported to the team several times. I set my servers to restart every 12 hours, and I run into it less, but with a busy server, it will still happen occasionally.

I do not know if it is fixed in a18.3 or a19 yet because I haven't had time to load test either of them yet.

 
Had the same issue today, he was the last player to disconnect. Looks like this happened right after. Server has 16G RAM and 8vCPU for 24 slots, more than enough left over even on busiest times.

2019-12-28T01:07:56 168786.326 INF Player Genou disconnected after 526.6 minutes

2019-12-28T01:07:57 168787.349 INF Player disconnected: EntityID=6455, PlayerID='76561198067333048', OwnerID='76561198067333048', PlayerName='Genou'

2019-12-28T01:07:57 168787.350 INF [EAC] FreeUser: EntityID=6455, PlayerID='76561198067333048', OwnerID='76561198067333048', PlayerName='Genou'

2019-12-28T01:07:57 168787.350 INF [EAC] Log: [EAC Server] [info] [unregisterClient] Client: 0x24 PlayerGUID: 76561198067333048

2019-12-28T01:07:57 168787.350 INF GMSG: Player 'Genou' left the game

2019-12-28T01:07:57 168787.351 INF Exited thread NCS_Writer_36_0

2019-12-28T01:07:57 168787.351 INF Exited thread NCS_Reader_36_1

2019-12-28T01:07:57 168787.351 INF Exited thread NCS_Writer_36_1

2019-12-28T01:07:57 168787.351 INF NET: LiteNetLib: Client disconnect from: 146.255.183.11:27841 (RemoteConnectionClose)

2019-12-28T01:07:57 168787.351 INF Exited thread NCS_Reader_36_0

2019-12-28T01:07:57 168787.376 INF AIDirector: Scout horde spawn finished (all mobs spawned)

2019-12-28T01:08:05 168795.040 INF Clearing all pools

2019-12-28T01:08:09 168799.463 INF Time: 2801.30m FPS: 20.07 Heap: 2554.1MB Max: 3522.1MB Chunks: 322 CGO: 0 Ply: 0 Zom: 0 Ent: 0 (228) Items: 0 CO: 0 RSS: 4840.8MB

Receiving unhandled NULL exception

#0 0x007f5d3d691c95 in (Unknown)

#1 0x007f5d3b025b3a in (Unknown)

#2 0x007f5d3b025ba7 in (Unknown)

#3 0x007f5d3b028a9d in (Unknown)

#4 0x007f5d3b028e6a in (Unknown)

#5 0x007f5d3b02b119 in (Unknown)

#6 0x007f5d3b02c6c3 in (Unknown)

#7 0x00000040eb8c66 in (wrapper managed-to-native) System.GC:InternalCollect (int)

#8 0x00000040ec6670 in GameManager:Update ()

#9 0x007f5d3ae490ad in (Unknown)

#10 0x007f5d3afb499b in (Unknown)

#11 0x007f5d3afb5848 in (Unknown)

#12 0x0055dbcffe2e54 in (Unknown)

#13 0x0055dbcffdeb99 in (Unknown)

#14 0x0055dbcffc03cf in (Unknown)

#15 0x0055dbcfd5ed9a in (Unknown)

#16 0x0055dbcfec69fa in (Unknown)

#17 0x0055dbcfec6ab8 in (Unknown)

#18 0x0055dbcfec9ec0 in (Unknown)

#19 0x0055dbcf7f343f in (Unknown)

#20 0x007f5d3d693813 in (Unknown)

#21 0x0055dbcf803403 in (Unknown)

 
Yeah, I know how it is. I'm running 24 cores at 3.07GHz with 80GB RAM, and the client is running on a par of Evo 960's in RAID 0. There is zero data bottleneck. I can run 8 servers on this machine without even pushing it to a 50% load, and currently only have 3 active.

I imagine narrowing down what is causing the issue is not easy.

 
It's a bug with Unity. Known issue that I've reported to the team several times. I set my servers to restart every 12 hours, and I run into it less, but with a busy server, it will still happen occasionally.
I do not know if it is fixed in a18.3 or a19 yet because I haven't had time to load test either of them yet.
Click to expand...
SylenThunder, are you using any server managers or are you manually controlled the server?

How do you setup he server to reboot every few hours on a manually controlled server? on linux ofc

 
SylenThunder, are you using any server managers or are you manually controlled the server?
How do you setup he server to reboot every few hours on a manually controlled server? on linux ofc
Click to expand...
I'm using Allocs and CPM API mods, and I have CSMM for my server manager.

The servers are installed using the LGSM scripts so I have a monitor script that runs on a cron job once every two minutes that checks if the servers are up, and restarts them if they aren't.

This makes sure the server is up and running 99% of the time whether it stops from a scheduled restart, or crashes unexpectedly. I also have Discord and email alerts that will send me the log file from the crash so that I can analyze it quickly if there is something serious going on.

 
Can you give me a hand with the server restart issue. I know ♥♥♥♥ about linux, so I run my servers in Windows. Is there any way you know of to fix the issue with restarts? Like, when it just hangs on a reboot. I don't know much about scripting either. :( It's proving to be a real pain in the ass to have to manually reboot it all the time.

 
I have set it up as a cronjob to restart every night once at the moment. Google how to restart service (if you have it set up as a service) with a cronjob. That's how I did it.

 
I have set it up as a cronjob to restart every night once at the moment. Google how to restart service (if you have it set up as a service) with a cronjob. That's how I did it.
Click to expand...
To a Windows machine? Either way, I need it to happen after the server manager has shut down the server properly. And that's not a 100% fixed time. So I don't think that would work anyways.

 
Are you familiar with Windows Powershell? I would imagine (e.g. I'm thinking off the top of my head) that you could write a Powershell script to check for the Server Manager process/service running (or also if the 7D2D game processes is still running if the server manager has not shut them down yet) and if they are not running, issue a reboot command. Then run the script from task scheduler. All of these Powershell commands (and getting Task scheduler to run it) are fairly basic and can be found on the net easily, but there are some gotchas if you haven't done much powershell.

 
Are you familiar with Windows Powershell? I would imagine (e.g. I'm thinking off the top of my head) that you could write a Powershell script to check for the Server Manager process/service running (or also if the 7D2D game processes is still running if the server manager has not shut them down yet) and if they are not running, issue a reboot command. Then run the script from task scheduler. All of these Powershell commands (and getting Task scheduler to run it) are fairly basic and can be found on the net easily, but there are some gotchas if you haven't done much powershell.
Click to expand...
The server manager is off site. Either way, turns out it's fixed in 18.3 (I just found that out about 1 hour ago). So I was worried for nothing. It's a Fun Pimps problem right from day 1 of A18. But, they are fixing it. :D A friend also recommended PowerShell though. And I do know a good amount about it. If it's not fixed in 18.3, then I think we may be able to work something out in PS.

Thank you all for the replies. It's nice to see that people are willing to help out. :)

 
Status
Not open for further replies.
Back
Top