[mkgmap-dev] splitter improvements

Wed Nov 14 13:25:40 GMT 2012

Hi Gerd,

i just tried it once again using splitter-r231.
This is the error, that occurs:

23.000.000 ways processed... id=175802045
24.000.000 ways processed... id=184296766
Stats for MultiTileProcessor pass 2 endMap Pass2 end
SparseBitSet problemRels 173576 (917000  bytes)
SparseBitSet neededWays 11057443 (42951840  bytes)
SparseBitSet neededNodes 73769812 (212038560  bytes)
Number of stored relations: 173576
starting to collect coordinates for 73.769.812 special nodes
Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
        at it.unimi.dsi.fastutil.longs.LongArrayList.<init>(LongArrayList.java:104)
        at uk.me.parabola.splitter.MultiTileProcessor.endMap(MultiTileProcessor.java:194)
        at uk.me.parabola.splitter.Main.processMap(Main.java:603)
        at uk.me.parabola.splitter.Main.writeAreas(Main.java:499)
        at uk.me.parabola.splitter.Main.split(Main.java:218)
        at uk.me.parabola.splitter.Main.start(Main.java:144)
        at uk.me.parabola.splitter.Main.main(Main.java:133)

-------------------------------------------------------------------------------------------------------------

Additionally i compared the two problem-candidates-lists:
Using my own germany+iceland-dataset the list has a size of 2663KB.
In case of the germany+-dataset the list size is 179797KB (!!) :O

I think, this explains why there is not enough memory available... ;)

Kind regards, Uli