View Issue Details

Jump to NotesJump to History
IDProjectCategoryView StatusDate SubmittedLast Update
0003963Dwarf FortressWorld Generation -- Generalpublic2011-02-16 13:102012-03-07 08:04
Reporterthvaz Assigned ToToady One  
PrioritynormalSeverityminorReproducibilityalways
Status resolvedResolutionfixed 
PlatformPCOSWindowsOS VersionSeven
Product Version0.31.19 
Fixed in Version0.34.03 
Summary0003963: World Generation too slow
DescriptionWorld Generation for worlds small or large are taking a lot more time than in the previous version. About 10 minutes with a Core i5 with 2.27 ghz!
Steps To ReproduceGenerate a Medium World.
TagsNo tags attached.

Relationships

related to 0005269 resolvedToady One Worldgen has alarmingly high rate of monster rampages and extremely high monarch mortality rate 
has duplicate 0005096 resolveduser6 World Gen takes a long time 
has duplicate 0005058 resolveduser6 Never Ending(and constant freezing) World Generation 
has duplicate 0005344 resolveduser6 World Generation effectively halts or slows down to unacceptable levels for long histories 

Activities

Quietust

2011-02-16 13:23

reporter   ~0015128

More importantly, worldgen seems to get exponentially slower the longer it runs.

cephalo

2011-02-17 17:33

reporter   ~0015218

Sounds to me like the economic stuff churning away. There's probably alot more going on in world gen these days.

asmodai

2011-07-31 23:03

reporter   ~0018401

Last edited: 2011-07-31 23:05

 I can definitely confirm this. You see every year that's being generated drop the speed at which it's generated visually. If you have FPS displayed you will notice it drops to 1 FPS after 160 years. It definitely seems to be quadratic or exponential growth.

For me it makes the game pretty much unplayable.

Edit: and that's with 0.31.25

darkteal

2011-08-01 01:51

reporter   ~0018405

If you don't like it, use a previous version to generate the world. Back in the day, it used to take nearly a week. (Creationist humor, anyone?)

asmodai

2011-08-01 07:14

reporter   ~0018407

Well, I am positive there's room for improvement in the generation algorithms (and that's the programmer in me speaking). I am used to generate a few worlds at first before settling on one I find appealing for one reason or another. With the latest version taking roughly 15 minutes, it makes that scenario a bit problematic. Not to mention the amount of resident memory the process now uses when it is creating this (500+ MB).

Here's a comparison I did (times are average over 3 gens on a Intel Core 2 Duo @ 2.8 GHz / 4 GB):

0.31.01 - Good (medium region takes about 1:45)
0.31.06 - Good (medium region takes about 1:45)
0.31.08 - Good (medium region takes about 2:00)
0.31.09 - Ok (medium region takes about 2:38)
0.31.10 - Ok (medium region takes about 2:55)
0.31.11 - Good (medium region takes about 2:00)
0.31.12 - Good (medium region takes about 1:55)
0.31.13 - Bad (medium region takes about 8:52)
0.31.24 - Bad (medium region takes about 15:17)

Stromko

2012-02-14 11:59

reporter   ~0019538

I've been waiting more than an hour for a medium region to be generated on a 2.8 ghz dual-core processor. It's gotten to the year 316 already (I thought I set it to stop at 300), and it will not stop or pause no matter what input I try.

snow

2012-02-14 12:11

reporter   ~0019541

Last edited: 2012-02-14 12:12

 i suggest 200 years for convenience. Last i ran to 270 years it already filled 770mb ram. I'm pretty sure it was going to crash around 1gb anyway...

I doubt toady uses the presets for his testing/playing purposes?

king doom

2012-02-14 16:04

reporter   ~0019563

Last edited: 2012-02-14 16:13

 I've been creating a new world for about eight hours now - year 297 and over five million events recorded. The longer the world generation goes on the more people there are to generate events about and they have children and so on and it seems like the amount of stuff being recorded is increasing geometrically.



Edit: world gen finished at year 300 like it was supposed to, it recorded 5005742 events.

fonikz

2012-02-14 16:54

reporter   ~0019566

It's exponentially slower than it was in 31.25. I could make a world with all the defaults in 3 minutes 46 seconds. Now, as others are reporting, it's taking several hours, I end up putting something heavy on my ENTER key to finally get it to stop and let me play.

Lac

2012-02-15 14:25

reporter   ~0019681

For completeness I'll cf a Toady One quote: "Yeah, world gen is slower. I can still squeeze something out of it. It's mostly the goods being shuffled around and processed as far as I can tell."

VDOgamez

2012-02-16 17:47

reporter   ~0019883

On my Windows 7 computer, it keeps triggering the "not responding" error messages, which sometimes will screw it up. And when I realize that it's not going to make it to the end year I have set, I can't make it abort because it's freezing up and not taking keypresses. I know the game is single threaded, but I wish that there was some extra thread at least for letting me quit when the generator freezes. Despite having an i7 with 16 GB of RAM, it takes at least an hour to even get to the 250 year range, and crashes soon after that. It can go a bit longer if I shrink the world size down and set stricter population limits, but the world isn't much fun if there's nobody there. I don't know how I'll ever make it to the 1050 years the default settings seem to expect.

MaXMC

2012-02-19 01:09

reporter   ~0020101

So it's finally time for DF to go Multi-threaded...

DarthCloakedDwarf

2012-02-19 01:37

reporter   ~0020103

I've noticed that it goes slower the longer history it has.

xaldin

2012-02-21 07:59

reporter   ~0020382

Last edited: 2012-02-21 08:00

 Since mine was flagged duplicate I'll post the information here:

Essentially werecurses are the key problem. If you set them to 0 it can do a year per second on a modern system. Werecurses bring even high end systems to a halt after a couple hundred years of generation. See 0005344

NW_Kohaku

2012-02-21 10:07

reporter   ~0020395

Hmm... this "worldgen too slow" is from 0.31.19, though, not the new version, so werecritters wouldn't have even been in during this report.

I made a report, myself, but it was specifically about the millions of werecreature attcks taking place in worldgen - http://www.bay12games.com/dwarves/mantisbt/view.php?id=5269

thvaz

2012-02-21 12:24

reporter   ~0020403

Since 31.19 generation of medium worlds or larger was really slow. 34.01 just made it worse.

xaldin

2012-02-21 22:52

reporter   ~0020433

Worldgen has been 'slow'er each version. This one that i reported and had closed as a duplicate of this essentially is worldgen stopping/crashing for all intents caused by werecreature growth.

Ticket handling should have flagged yours or mine as a dup and attached them together into one since 5269 is really closer to what 5344 was about. I just didn't want the testing lost as it gives Toady a place to start looking, assuming this is ever addressed.

NW_Kohaku

2012-02-22 22:59

reporter   ~0020521

I am trying to start a suggestion thread to get some people brainstorming some solutions to slow worldgens. See here: http://www.bay12forums.com/smf/index.php?topic=102293.0

thvaz

2012-03-07 02:10

reporter   ~0021205

Last edited: 2012-03-07 02:27

 Someone still think the world generation is too slow? As of 34.05, I think it's fine now.

user6

2012-03-07 08:04

  ~0021215

Thanks for the update. I'll mark this one fixed -- reusing an old report for a new problem was probably not the best idea anyway. If new problems arise, we can handle it in a new report.

Issue History

Date Modified Username Field Change
2011-02-16 13:10 thvaz New Issue
2011-02-16 13:23 Quietust Note Added: 0015128
2011-02-17 17:33 cephalo Note Added: 0015218
2011-03-06 05:20 thvaz Tag Attached: Intentional/Expected?
2011-03-06 05:20 thvaz Tag Attached: Needs Confirmation
2011-07-31 23:03 asmodai Note Added: 0018401
2011-07-31 23:05 asmodai Note Edited: 0018401
2011-08-01 01:51 darkteal Note Added: 0018405
2011-08-01 07:14 asmodai Note Added: 0018407
2012-02-14 11:59 Stromko Note Added: 0019538
2012-02-14 12:09 user6 Tag Detached: Intentional/Expected?
2012-02-14 12:09 user6 Tag Detached: Needs Confirmation
2012-02-14 12:11 snow Note Added: 0019541
2012-02-14 12:12 snow Note Edited: 0019541
2012-02-14 16:04 king doom Note Added: 0019563
2012-02-14 16:13 king doom Note Edited: 0019563
2012-02-14 16:54 fonikz Note Added: 0019566
2012-02-15 07:09 user6 Relationship added has duplicate 0005096
2012-02-15 14:25 Lac Note Added: 0019681
2012-02-15 14:47 user6 Relationship added has duplicate 0005058
2012-02-16 17:47 VDOgamez Note Added: 0019883
2012-02-19 01:09 MaXMC Note Added: 0020101
2012-02-19 01:37 DarthCloakedDwarf Note Added: 0020103
2012-02-20 16:17 user6 Relationship added has duplicate 0005344
2012-02-21 07:59 xaldin Note Added: 0020382
2012-02-21 08:00 user6 Note Edited: 0020382
2012-02-21 10:07 NW_Kohaku Note Added: 0020395
2012-02-21 11:37 user6 Relationship added related to 0005269
2012-02-21 12:24 thvaz Note Added: 0020403
2012-02-21 22:52 xaldin Note Added: 0020433
2012-02-22 22:59 NW_Kohaku Note Added: 0020521
2012-03-07 02:10 thvaz Note Added: 0021205
2012-03-07 02:27 thvaz Note Edited: 0021205
2012-03-07 08:04 user6 Note Added: 0021215
2012-03-07 08:04 user6 Status new => resolved
2012-03-07 08:04 user6 Fixed in Version => 0.34.03
2012-03-07 08:04 user6 Resolution open => fixed
2012-03-07 08:04 user6 Assigned To => Toady One