[Indev 17b / Linux] - High RAM Usage 7 replies to this topic - Started By Tramboc , Jan 21 2016 12:40 AM

[Tramboc]

Hi,

 

The game uses 2 GB of RAM on the main menu. Originally I was using java 7 but I upgraded to 8 and the issue persists.

 

Log:

Spoiler

Retro-Pixel Castles InDev 17b
Operating System: Linux
GPU Drivers: null
GPU Driver Version: null
Maximum JVM Memory: 853MB
Display Mode: Windowed

Thu Jan 21 00:30:47 CST 2016 INFO:Slick Build #237
Thu Jan 21 00:30:47 CST 2016 INFO:LWJGL Version: 2.9.3
Thu Jan 21 00:30:47 CST 2016 INFO:OriginalDisplayMode: 1366 x 768 x 24 @60Hz
Thu Jan 21 00:30:47 CST 2016 INFO:TargetDisplayMode: 1280 x 720 x 0 @0Hz
Thu Jan 21 00:30:47 CST 2016 INFO:Starting display 1280x720
Thu Jan 21 00:30:47 CST 2016 INFO:Use Java PNG Loader = true
Thu Jan 21 00:30:47 CST 2016 INFO:Controllers not available
Thu Jan 21 00:30:47 CST 2016 INFO:Initialising sounds..
Thu Jan 21 00:30:48 CST 2016 INFO:- Sound works
Thu Jan 21 00:30:48 CST 2016 INFO:- 64 OpenAL source available
Thu Jan 21 00:30:48 CST 2016 INFO:- Sounds source generated
Resetting SPLASH
Thu Jan 21 00:30:55 CST 2016 INFO:Starting display 1280x716
Resetting SPLASH
Failed to load limbo villagers.
Failed to load limbo resources.
Failed to load limbo villagers.
Failed to load limbo resources.
Failed to load limbo villagers.
Failed to load limbo resources.
Loading Game
Font Module: 0
Save Module: 0
Time Module: 0
Map Module: 1311
Mini Map Module: 39
Limbo resource save data failed to load, loading defaults!
Resource Module: 171
Transition Module: 1
Shadow Module: 1966
Lighting Module: 140
Projectile Module: 0
Particle Module: 83
Collision Module: 1345
Depth Module: 992
Object Module: 260
Background Module: 0
Sound Module: 3
Entity Module: 536
Essence Module: 0
Weather Module: 0
Resource Module Sync: 0
Object Module Sync: 27
Entity Module Sync: 28
Essence Module Sync: 0
TOTAL TIME: 8520

[Rayvolution]

If you go into the play mode, map editor or drawing board then exit back to the main menu, does the memory usage increase or remain the same?

 

Also, does the memory usage ever fluctuate at all, or is it "locked" at 2048~ megs?

[Tramboc]

On the main menu it fluctuates between 1700 and 1900 MB. I made a new blank map in the map editor and it hovered between 2200 MB and 2300 MB constantly. Then when I quit back to the main menu it shot up to 2800ish MB but quickly fell to a constant 2575 MB. Going back into the map editor on the same map made it pass 3 GB at which point I force quit because I only have 3.7 GB.

 

I did the same process but going into a skirmish or the world map instead and they all had the same result.

[Tramboc]

On Indev 17d; still having this issue. I think I should mention that the memory use only increases when the game loads assets.

 

Seeing as I have two crappy computers running Linux, I did a test to compare how much memory the game uses on both.

 

Both machines have linux kernel 3.16 and java 8 installed.

 

Older computer runs Ubuntu 14.04 and has 6 GB of RAM.

I ran the game through steam and kept watch on the memory use with htop.

The game runs at a nice solid 1 fps, so I just let it sit on the welcome screen. On the welcome screen it often just sat at one value, changing very very little.

 

I ran and closed the game 5 times and here are the usages on the welcome screen:

 

1st:  880 MB

2nd: 720 MB

3rd:  805 MB

4th:  764 MB

5th:  776 MB

 

And here's a log from the 5th run:

 

Spoiler

Retro-Pixel Castles InDev 17d
Operating System: Linux
GPU Drivers: null
GPU Driver Version: null
Maximum JVM Memory: 1323MB
Display Mode: Windowed

Fri Jan 29 17:58:26 CST 2016 INFO:Slick Build #237
Fri Jan 29 17:58:27 CST 2016 INFO:LWJGL Version: 2.9.3
Fri Jan 29 17:58:27 CST 2016 INFO:OriginalDisplayMode: 1680 x 1050 x 24 @60Hz
Fri Jan 29 17:58:27 CST 2016 INFO:TargetDisplayMode: 1280 x 720 x 0 @0Hz
Fri Jan 29 17:58:27 CST 2016 INFO:Starting display 1280x720
Fri Jan 29 17:58:27 CST 2016 INFO:Use Java PNG Loader = true
Fri Jan 29 17:58:27 CST 2016 INFO:Controllers not available
Fri Jan 29 17:58:28 CST 2016 INFO:Initialising sounds..
Fri Jan 29 17:58:28 CST 2016 INFO:- Sound works
Fri Jan 29 17:58:28 CST 2016 INFO:- 64 OpenAL source available
Fri Jan 29 17:58:28 CST 2016 INFO:- Sounds source generated
Resetting SPLASH
Resetting SPLASH
Failed to load limbo villagers.
Failed to load limbo resources.
Failed to load limbo villagers.
Failed to load limbo resources.
Failed to load limbo villagers.
Failed to load limbo resources.
Loading Game
Font Module: 0
Save Module: 0
Time Module: 0
Map Module: 4028
Mini Map Module: 35
Limbo resource save data failed to load, loading defaults!
Resource Module: 429
Transition Module: 0
Shadow Module: 4148
Lighting Module: 59
Projectile Module: 0
Missile Module: 0
Particle Module: 331
Collision Module: 1767
Depth Module: 1554
Object Module: 9650
Background Module: 0
Sound Module: 6
Entity Module: 418
Essence Module: 1
Weather Module: 0
Resource Module Sync: 0
Object Module Sync: 24
Entity Module Sync: 24
Essence Module Sync: 0
TOTAL TIME: 24397

 

So, it's pretty normal. I did the same process on my newer computer running Linux Mint 17 (basically ubuntu 14.04) with 4 GB of RAM.

 

1st:   2040 MB

2nd: 1884 MB

3rd:  1863 MB

4th:  1814 MB

5th:  1923 MB

 

Here's a log from the 5th run:

 

Spoiler

Retro-Pixel Castles InDev 17d
Operating System: Linux
GPU Drivers: null
GPU Driver Version: null
Maximum JVM Memory: 853MB
Display Mode: Windowed

Fri Jan 29 18:11:05 CST 2016 INFO:Slick Build #237
Fri Jan 29 18:11:06 CST 2016 INFO:LWJGL Version: 2.9.3
Fri Jan 29 18:11:06 CST 2016 INFO:OriginalDisplayMode: 1366 x 768 x 24 @60Hz
Fri Jan 29 18:11:06 CST 2016 INFO:TargetDisplayMode: 1280 x 720 x 0 @0Hz
Fri Jan 29 18:11:06 CST 2016 INFO:Starting display 1280x720
Fri Jan 29 18:11:06 CST 2016 INFO:Use Java PNG Loader = true
Fri Jan 29 18:11:06 CST 2016 INFO:Controllers not available
Fri Jan 29 18:11:06 CST 2016 INFO:Initialising sounds..
Fri Jan 29 18:11:06 CST 2016 INFO:- Sound works
Fri Jan 29 18:11:06 CST 2016 INFO:- 64 OpenAL source available
Fri Jan 29 18:11:06 CST 2016 INFO:- Sounds source generated
Resetting SPLASH
Fri Jan 29 18:11:14 CST 2016 INFO:Starting display 1280x714
Resetting SPLASH
Save object failed to be created for maps/UserMaps/test!
Save object failed to be created for maps/UserMaps/test!
Failed to load limbo villagers.
Failed to load limbo resources.
Failed to load limbo villagers.
Failed to load limbo resources.
Failed to load limbo villagers.
Failed to load limbo resources.
Loading Game
Font Module: 0
Save Module: 0
Time Module: 0
Map Module: 1331
Mini Map Module: 26
Limbo resource save data failed to load, loading defaults!
Resource Module: 311
Transition Module: 0
Shadow Module: 2052
Lighting Module: 64
Projectile Module: 0
Missile Module: 0
Particle Module: 118
Collision Module: 1585
Depth Module: 964
Sturdy Wall has been completed.
Sturdy Wall has been completed.
Sturdy Wall has been completed.
Sturdy Wall has been completed.
Sturdy Wall has been completed.
Sturdy Wall has been completed.
Sturdy Wall has been completed.
Sturdy Wall has been completed.
Sturdy Wall has been completed.
Sturdy Wall has been completed.
Sturdy Wall has been completed.
Sturdy Wall has been completed.
Sturdy Wall has been completed.
Sturdy Wall has been completed.
Sturdy Wall has been completed.
Sturdy Wall has been completed.
Sturdy Wall has been completed.
Sturdy Wall has been completed.
Sturdy Wall has been completed.
Sturdy Wall has been completed.
Sturdy Wall has been completed.
Sturdy Wall has been completed.
Sturdy Wall has been completed.
Sturdy Wall has been completed.
Sturdy Wall has been completed.
Sturdy Wall has been completed.
Sturdy Wall has been completed.
Sturdy Wall has been completed.
Sturdy Wall has been completed.
Sturdy Wall has been completed.
Sturdy Wall has been completed.
Sturdy Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Wood Wall has been completed.
Object Module: 1040
Background Module: 0
Sound Module: 3
Entity Module: 389
Essence Module: 0
Weather Module: 0
Resource Module Sync: 3
Object Module Sync: 23
Entity Module Sync: 32
Essence Module Sync: 1
TOTAL TIME: 8972

 

Okay so that wall thing is weird, not all of the logs have that. Two of them have that, and one of the two doesn't have the "Sturdy Wall" part.

 

Here's a log from the 4th run:

 

Spoiler

Retro-Pixel Castles InDev 17d
Operating System: Linux
GPU Drivers: null
GPU Driver Version: null
Maximum JVM Memory: 853MB
Display Mode: Windowed

Fri Jan 29 18:10:03 CST 2016 INFO:Slick Build #237
Fri Jan 29 18:10:03 CST 2016 INFO:LWJGL Version: 2.9.3
Fri Jan 29 18:10:03 CST 2016 INFO:OriginalDisplayMode: 1366 x 768 x 24 @60Hz
Fri Jan 29 18:10:03 CST 2016 INFO:TargetDisplayMode: 1280 x 720 x 0 @0Hz
Fri Jan 29 18:10:03 CST 2016 INFO:Starting display 1280x720
Fri Jan 29 18:10:03 CST 2016 INFO:Use Java PNG Loader = true
Fri Jan 29 18:10:03 CST 2016 INFO:Controllers not available
Fri Jan 29 18:10:04 CST 2016 INFO:Initialising sounds..
Fri Jan 29 18:10:04 CST 2016 INFO:- Sound works
Fri Jan 29 18:10:04 CST 2016 INFO:- 64 OpenAL source available
Fri Jan 29 18:10:04 CST 2016 INFO:- Sounds source generated
Resetting SPLASH
Fri Jan 29 18:10:12 CST 2016 INFO:Starting display 1280x714
Resetting SPLASH
Save object failed to be created for maps/UserMaps/test!
Save object failed to be created for maps/UserMaps/test!
Failed to load limbo villagers.
Failed to load limbo resources.
Failed to load limbo villagers.
Failed to load limbo resources.
Failed to load limbo villagers.
Failed to load limbo resources.
Loading Game
Font Module: 0
Save Module: 0
Time Module: 0
Map Module: 1325
Mini Map Module: 24
Limbo resource save data failed to load, loading defaults!
Resource Module: 313
Transition Module: 0
Shadow Module: 1901
Lighting Module: 58
Projectile Module: 0
Missile Module: 0
Particle Module: 162
Collision Module: 1385
Depth Module: 1052
Object Module: 1
Background Module: 0
Sound Module: 2
Entity Module: 322
Essence Module: 0
Weather Module: 0
Resource Module Sync: 0
Object Module Sync: 35
Entity Module Sync: 23
Essence Module Sync: 0
TOTAL TIME: 7588

 

Also, I checked the logs on the older machine and the 4th log had both "Sturdy Wall" and "Wood Wall"

So I guess that's just an unrelated bug.

 

What could cause this difference in memory usage?

 

 

[Rayvolution]

I'm honestly completely baffled by this behavior. I wonder if it could be something internal to Java? Maybe the JVM acts differently on different hardware? I would blame being on a different kernal, but you're using the same one! Unless it's something very specific to the version of Linux you're running, and not the actual kernal.

 

Can you replicate similar results with other Java based games, like Towns, Project Zomboid or Minecraft? All 3 of those use Java+LWJGL, and Towns also uses Slick2d (Something I use).

 

On the system with extremely high usage, how's the gameplay? Is the game suffering severely from the high usage, or is it just high?

[Tramboc]

I have an i5 with just the integrated intel 3000 graphics. The game runs at a nice and buttery 60 FPS with no visible performance issues. My CPU gets rather hot though, and the high memory usage just slows the system to a crawl.

I goofed around in 3079, 3089 and Minecraft for a bit, and the memory usage on those games never surpassed 900 MB

 

Now, I know nothing about java, but do the different values for "Maximum JVM Memory" on the logs for the two machines mean anything?

[Rayvolution]

Maximum Memory is just what Java decided is the absolute most it's allowed to allocate (but hasn't yet). If your memory usage goes beyond that, the game will have an "Out of Memory" crash usually.

 

Java handles memory a lot differently than most native programs, and the nomenclature can be confusing, but basically;

- Used Memory: The actual literal amount of ram being used in the game.

- Free Memory: The amount leftover that's been loaded into the JVM, but the game isn't actively using.

- Total Memory: The total amount actually currently being allocated to the JVM. So in a sense, Total memory is whats being used by the JVM, but the JVM itself might not be using it internally in the game. This should be the sum of Used+Free memory and it's typically what the OS will report as the game's memory consumption even if the game isn't using it all.

- Maximum Memory: The maximum the JVM has decided it's allowed to have. If the Used Memory tries to exceed Total Memory, Total Memory will take more memory away from the system, up to the Maximum Memory. If it needs more, likely the game will crash. Maximum Memory is really just how much it potentially could use, if it needs it.

 

There is some overhead too, so if you look at your actual memory usage from Java, it's usually a little higher than the actual "Total Memory" reported in the game. Depends on the OS though, in Window's case it's usually about 100-200mb higher.

[Tramboc]

I see, that makes sense.