[mkgmap-dev] splitter improvements

Mon Nov 12 22:11:53 GMT 2012

Hi,

On Mon, Nov 12, GerdP wrote:

> Hi Thorsten,
> 
> that's strange, the newer version should require less memory, esp. in that
> part
> of the program. Did you use exactly the same input files and parameters?

Yes, I did, and verfied it two times.

> I will check if D A CH is somehow special, please let me know your
> parameters.

java -jar /usr/share/java/splitter-r224.jar --mapid=71200001 --max-nodes=1000000 --overlap=0 --keep-complete=true --geonames-file=osmmaps/scripts/cities/DACH.txt --description=TK-DACH-Tile --output=pbf --output-dir=build/DACH/tiles data/osm/DACH.osm.pbf
cache=
description=TK-DACH-Tile
geonames-file=osmmaps/scripts/cities/DACH.txt
keep-complete=true
mapid=71200001
max-areas=255
max-nodes=1000000
max-threads=4 (auto)   
mixed=false
no-trim=false
output=pbf
output-dir=build/DACH/tiles
overlap=0
problem-file=
resolution=13
split-file=
status-freq=120
write-kml=

> Please try again with r231, which I've just committed. 

I will do so tomorrow.

  Thorsten

> Ciao,
> Gerd
> 
> 
> 
> Thorsten Kukuk wrote
> > Hi,
> > 
> > On Sat, Nov 10, GerdP wrote:
> > 
> >> I've just committed r229.
> >> 
> >> I've fixed all reported errors regarding --keep-complete and found some
> >> nice
> >> performance improvements for Hennings special case (planet as input,
> >> split-file with > 800 tiles, many of them overlapping each other)
> >> and some general improvements regarding memory requirements.
> > 
> > Could it be that r229 needs much more memory than r224?
> > 
> > r224 had no problems, but with r229 I get for the same input file:
> > java.lang.OutOfMemoryError: Java heap space
> >         at java.lang.Integer.valueOf(Unknown Source)
> >         at
> > uk.me.parabola.splitter.DataStorer$WriterMapper.put(DataStorer.java:171)
> >         at
> > uk.me.parabola.splitter.DataStorer.putWriterIdx(DataStorer.java:99)
> >         at
> > uk.me.parabola.splitter.MultiTileProcessor.addOrMergeWriters(MultiTileProcessor.java:603)
> >         at
> > uk.me.parabola.splitter.MultiTileProcessor.processWay(MultiTileProcessor.java:145)
> >         at
> > uk.me.parabola.splitter.BinaryMapParser.parseWays(BinaryMapParser.java:170)
> > 
> > It's a DACH extract.
> > 
> >   Thorsten
> > 
> > -- 
> > Thorsten Kukuk, Project Manager/Release Manager SLES
> > SUSE LINUX Products GmbH, Maxfeldstr. 5, D-90409 Nuernberg
> > GF: Jeff Hawn, Jennifer Guild, Felix Imendörffer, HRB 16746 (AG Nürnberg)
> > _______________________________________________
> > mkgmap-dev mailing list
> 
> > mkgmap-dev at .org
> 
> > http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
> 
> 
> 
> 
> 
> --
> View this message in context: http://gis.19327.n5.nabble.com/splitter-improvements-tp5735230p5735453.html
> Sent from the Mkgmap Development mailing list archive at Nabble.com.
> _______________________________________________
> mkgmap-dev mailing list
> mkgmap-dev at lists.mkgmap.org.uk
> http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
-- 
Thorsten Kukuk, Project Manager/Release Manager SLES
SUSE LINUX Products GmbH, Maxfeldstr. 5, D-90409 Nuernberg
GF: Jeff Hawn, Jennifer Guild, Felix Imendörffer, HRB 16746 (AG Nürnberg)