Native Linux server (with management scripts)

Alloc · Jun 3, 2014

Hi there,

as it was suggested to me I open a new thread on my management scripts and native Linux server support. This is basically following up on the thread Dedicated Server without hacky workarounds though this is in Linux Bugs where it might be overlooked.

I created a full set of management scripts for a Linux based 7dtd server. This allows basic operations like starting/stopping as well as advanced things like a few event hooks.

(This also includes native Linux engine files so you do not have to use workarounds like Wine to run 7dtd. Unfortunately these files are 32 Bit only so far but at least they can be run on 64 Bit hosts without any problems.) No longer valid, 7dtd provides "built in" 32 bit and 64 bit Linux support since A14

For the full documentation on the management scripts go to https://7dtd.illy.bz/.

Regards,

Alloc

walking_dad · Jun 3, 2014

Thank you so much for this, haven't even checked out the linux bugs forum as I assumed it would be empty.

I was waiting for a native linux build so I could set up a server without having to deal with WINE or run a Windows server, but now I can start experimenting right away. Once again, thank you!

ryvix · Jun 3, 2014

Thank you very much! I have tried to setup a dedicated server with this on Ubuntu 14.04 and it works for the most part. I had to install some of the deps but thats ok. There is also a couple issues I am having which I was wondering if you could help with.

1. When I do 7dtd.sh updateengine I get some things that look like errors. This is the output: http://pastebin.com/PUWxQwbw

What's odd is that there is no /home/buildbot on my machine so I'm not sure why it shows that.

2. In the instance log I get this line a bunch: Fallback handler could not load library /home/sdtd/engine/7DaysToDie_Data/Mono/x86/SteamworksNative

I get some others as well that say they are harmless but this one doesn't say it's harmless. Plus when installing it said something about SteamworksNative.dll not being found.

3. I cannot get the server to show up in the public servers list even though I have set it as public. I can however connect to it if I add it manually to favourites.

I couldn't find anywhere which ports I should open. I researched and found that only ports 25000-25002 UDP are required. I ran this command: ufw allow 25000:25003/udp

I can connect with that but I still don't see it in the server list. I have tried doing: ufw allow 25000:25003/tcp

But that still doesn't work. I have also tried: ufw allow 35000:35003/udp and ufw allow 35000:35003/tcp

But that still doesn't work. When the server starts it shows using another port that randomly changes and port 27036 which never changes and I have tried allowing that through tcp and udp but it still doesn't work. So maybe you could give some straight up iptables rules to setup the server from scratch or something that makes it show up in the server list?

That's about all I have noticed so far. The only other thing I'm wondering is if this will be lower performance than a straight up windows server or maybe better. The server is running Ubuntu 14.04 and has 32 gigs of RAM, SSD drives and Intel Xeon E3 1245v2 4 core/8 thread processor. Do you have any recommended player limit to set for such a server?

Thanks again!

Alloc · Jun 4, 2014

1. When I do 7dtd.sh updateengine I get some things that look like errors. This is the output: http://pastebin.com/PUWxQwbwWhat's odd is that there is no /home/buildbot on my machine so I'm not sure why it shows that.

The path shown in this error refers to the location Valve built this program. It has nothing to do with your system. Also it can be simply ignored, I don't know why it shows up on some systems (did also show on my Debian 6/Squeeze test machine, but neither on my deployment machine with Debian 7/Wheezy nor on my Fedora 20 test machine ...).

2. In the instance log I get this line a bunch: Fallback handler could not load library /home/sdtd/engine/7DaysToDie_Data/Mono/x86/SteamworksNative

Those entries are ok.

I get some others as well that say they are harmless but this one doesn't say it's harmless. Plus when installing it said something about SteamworksNative.dll not being found.

What do you mean by "when installing it"?

3. I cannot get the server to show up in the public servers list even though I have set it as public. I can however connect to it if I add it manually to favourites.

Sounds like you got a wrong combination of the Steamworks files. Could you pastebin the whole output.log from the instance you were trying to run?

I couldn't find anywhere which ports I should open. I researched and found that only ports 25000-25002 UDP are required. I ran this command: ufw allow 25000:25003/udpI can connect with that but I still don't see it in the server list. I have tried doing: ufw allow 25000:25003/tcp

But that still doesn't work. I have also tried: ufw allow 35000:35003/udp and ufw allow 35000:35003/tcp

But that still doesn't work. When the server starts it shows using another port that randomly changes and port 27036 which never changes and I have tried allowing that through tcp and udp but it still doesn't work. So maybe you could give some straight up iptables rules to setup the server from scratch or something that makes it show up in the server list?

I only have the following ports:

- in: 25000-25002/UDP

- out: 20,21,80,443/TCP

- (and DNS, NTP but that shouldn't matter

)

I think it uses HTTP for the server list so port 80 should be enough.

That's about all I have noticed so far. The only other thing I'm wondering is if this will be lower performance than a straight up windows server or maybe better. The server is running Ubuntu 14.04 and has 32 gigs of RAM, SSD drives and Intel Xeon E3 1245v2 4 core/8 thread processor. Do you have any recommended player limit to set for such a server?

I don't know about a comparison to a Windows based server but I'd suspect it to perform a little bit better as most things perform better on Linux regarding raw CPU / IO power and you obviously don't need graphics power on the server

Also don't have any numbers for required resources for a given player count, only hosting a server for me and two friends.

Regards,

Alloc

ryvix · Jun 4, 2014

Hi there,

By installing I just meant when running the boostrap.sh file.

I just created a brand new instance just to test and it has the exact same problem with not showing on the public servers list. I just tested and I can still connect to it. So maybe it's something messed with the files like you say but I don't know what. I know I had some issues with Steamguard at the start and had to disable it so I could even get the updateengine part to login to Steam. Maybe that somehow messed it up?

Here is the output.log from after I started the instance: http://pastebin.com/9KKxHm6D

I have now allowed port 80 and it makes no difference so I don't think that's it.

If I could somehow uninstall and start over that would be ok if that's what has to happen for it to work. I had it do backups. I'm just not 100% sure which files to remove and whatnot because I'm pretty sure it has put some in other places on the server.

Also, if you have a donation button somewhere for Paypal I would send you a donation =)

Thanks!

Mike06 · Jun 4, 2014

Some of the existing scripts were a bit too "Ubunty-ese" specially the service/deamon commands. That is one area on improvement. Personally I did not bother to do it as pims promised that native Linux servers was "almost ready" though that statement last a lot of credibility over the past months...

Alloc · Jun 4, 2014

By installing I just meant when running the boostrap.sh file.

Hm, shouldn't complain about Steamworks at that point as 7dtd is not run during bootstrap. If you should rerun bootstrap and get that again please show me the log

I just created a brand new instance just to test and it has the exact same problem with not showing on the public servers list. I just tested and I can still connect to it. So maybe it's something messed with the files like you say but I don't know what. I know I had some issues with Steamguard at the start and had to disable it so I could even get the updateengine part to login to Steam. Maybe that somehow messed it up?

Should not interfere here. Also disabling Steamguard should not be required, you should simply get a mail with a confirmation code which has to be entered during the update-process. (Have done so like 30 times the last week

) If there's any error showing please also send me a copy of that.

Here is the output.log from after I started the instance: http://pastebin.com/9KKxHm6D

We've got the problem in line 96:

Code:

2014.06.04 03:25:50: EntryPointNotFoundException: GameServer_LoggedOn

This should not happen anymore ... When did you first run the bootstrapper? After I created this thread or before?

If I could somehow uninstall and start over that would be ok if that's what has to happen for it to work. I had it do backups. I'm just not 100% sure which files to remove and whatnot because I'm pretty sure it has put some in other places on the server.

Basically you could delete everything within the users folder (but not the backups-folder if you used that of course

). SteamCMD probably also created a folder in the root's home, namely /root/Steam. You can also simply rerun the bootstrapper without deleting anything which will skip redownloading SteamCMD and 7dtd but do the other steps of the installation again.

Also, if you have a donation button somewhere for Paypal I would send you a donation =)

Thank you, I really appreciate that. Still I'm doing this for free because I myself use this and I also refresh/deepen my knowledge on Bash scripting

@Mike:

Some of the existing scripts were a bit too "Ubunty-ese" specially the service/deamon commands.

To be a bit nit-picky it was made for Debian in the first place

Obviously that should make it run mostly without problems on Ubuntu and other Debian derivatives too.

But by now I'm also testing the whole thing on Fedora so it should work on most systems. Basically the only thing I don't check is the startup of the server at system boot time but according to the information on the net systemd can use sysvinit-style scripts so it shouldn't be any problem either.

The only thing that I really have it depend on is a Bash and of course 32 Bit libraries (gcc, ld-lib) which is simply caused by the fact that SteamCMD is not available as 64 Bit executable.

Personally I did not bother to do it as pims promised that native Linux servers was "almost ready" though that statement last a lot of credibility over the past months...

Hm ... "over the past months"? Unfortunately it's more like "over the past years" by now

But as long as we're able to do this stuff ourselves I won't complain, they got other things to do too.

Regards,

Alloc

ryvix · Jun 4, 2014

Thank you very much for your help! I got it to work by deleting everything and starting over. I deleted those folders you mentioned and the stuff in /tmp that I found. Woohoo! =)

Alloc · Jun 4, 2014

As I thought probably just an old file somewhere

Glad it works for you now.

MajorCoward · Jun 4, 2014

Great news and excellent timing for these scripts as far as I am concerned.

I have been running a 7dtd server on Debian 7.4 since Alpha 5.

In Alpha 8.4 and 8.5 I have had very frequent server crashes. I've gone over the hardware to ensure there is no problem there, all is good.

Time to wipe the files and start fresh I think. So thank you for the effort and time you have put into this, I for one appreciate it.

pinkpagan · Jun 4, 2014

I love the addition of instances

how can I set creative mode to true?

Alloc · Jun 4, 2014

If you use the instance edit feature it's called "Item spawn menu" under "Generic Options".

limodor · Jun 4, 2014

server runs very stable no crashes but telnet seems to be buggy

SocketException: The socket has been shut downat System.Net.Sockets.Socket.Send (System.Byte[] buf, Int32 offset, Int32 size, SocketFlags flags) [0x00000] in <filename unknown>:0

at System.Net.Sockets.NetworkStream.Write (System.Byte[] buffer, Int32 offset, Int32 size) [0x00000] in <filename unknown>:0

Rethrow as IOException: Write failure

at System.Net.Sockets.NetworkStream.Write (System.Byte[] buffer, Int32 offset, Int32 size) [0x00000] in <filename unknown>:0

at System.IO.Stream.WriteByte (Byte value) [0x00000] in <filename unknown>:0

at NetTelnetServer.WriteToClient (System.String _line) [0x00000] in <filename unknown>:0

at ហ.ᡤᙃ (ᡡᙃ ᙂ) [0x00000] in <filename unknown>:0

at ហ.ᝉᙂ (System.String _line) [0x00000] in <filename unknown>:0

at ConnectionManager.RPC_ServerCommand (System.String _playerName, System.String _cmd, NetworkMessageInfo _networkInfo) [0x00000] in <filename unknown>:0

(Filename: Line: -1)

im using frontrunnerteks servermanager maybe the manager crash the telnet server i dont know

Alloc · Jun 4, 2014

Hm, the only way I ever got telnet to crash was when I did not properly disconnect, i.e. closing the connection instead of letting the server close it by sending the exit command (this *always* made it crash for me). Don't know what FRT does with his SM though

limodor · Jun 4, 2014

Hm, the only way I ever got telnet to crash was when I did not properly disconnect, i.e. closing the connection instead of letting the server close it by sending the exit command (this *always* made it crash for me). Don't know what FRT does with his SM though

not a big deal i change to webconnect.

but can anyone tryout the blacklist it does not work under linux im trying to ban myself but no luck, its not a config problem the same config under windows works got the message youre banned ....

<blacklisted steamID="765611979xxxxxxxx" unbandate="5/10/2015 12:21:07 AM"/>

TY

Alloc · Jun 4, 2014

<blacklisted steamID="765611979xxxxxxxx" unbandate="5/10/2015 12:21:07 AM"/>

Looks like TFP did not explicitly specify how that date should be formatted so it's different in the Linux build. Maybe even depending on the systems locale.

With a german locale it looks like this:

Code:

&lt;blacklisted steamID="76561198xxxxxx" unbandate="05.06.2014 01:56:34" /&gt;

smono · Jun 5, 2014

Hm, the only way I ever got telnet to crash was when I did not properly disconnect, i.e. closing the connection instead of letting the server close it by sending the exit command (this *always* made it crash for me). Don't know what FRT does with his SM though

Yeah, now it does that. In early 8.* telnet would stop letting me connect - I could connect the first time but if i didn't properly `exit` it wouldn't let me connect again.

H3llGhost · Jun 5, 2014

I only have the following ports:

- in: 25000-25002/UDP

- out: 20,21,80,443/TCP

- (and DNS, NTP but that shouldn't matter )

I think it uses HTTP for the server list so port 80 should be enough.

You don't need the outgoing http(s) ports. I didn't found usage of 20 and 21.

You have to allow the outgoing source query engine ports around 25000 to list your server. I can deliever exact ports in the next days.

Alloc · Jun 5, 2014

20/21 is listed because those are open by my firewall for updates

I just listed everything that was open. Though it looks like I got the wrong state (tried with different port combinations). Looks like it really is something between 27000 and 27099 UDP outgoing (ports used by Valve games).

Alloc · Jun 5, 2014

Monitored the traffic ... Looks like it's:

Source port: Baseport+2 (i.e. 25002 for baseport 25000)

Dest port: 27017 - 27020

Protocol: UDP

Don't know if only one of the dest ports would be enough, but that matches what Valve documents here:

Which ports do I need to open on my router or firewall for Steam?
Your network must be configured to allow Steam access to the following ports (in order from highest to lowest priority for QoS users):

Steam Client

UDP 27000 to 27015 inclusive (Game client traffic)

UDP 27015 to 27030 inclusive (Typically Matchmaking and HLTV)

TCP 27014 to 27050 inclusive (Steam downloads)

So I would recommend going for dport 27015-27030.

Regards,

Alloc

Native Linux server (with management scripts)

Fun Pimps Staff

New member

New member

Fun Pimps Staff

New member

New member

Fun Pimps Staff

New member

Fun Pimps Staff

New member

New member

Fun Pimps Staff

New member

Fun Pimps Staff

New member

Fun Pimps Staff

New member

New member

Fun Pimps Staff

Fun Pimps Staff