[mkgmap-dev] splitter exception with SRTM data for USA

Thu Apr 11 14:19:31 BST 2013

Hi Thorsten,

it seems that your data has reached a limit in the data structure used in
splitter.
This happens when you have a huge number of consecutive ids.
Can you configure the way how the ids for the points are generated?
A simple change would be to use 
1  3 5 7 .. 
instead of
1 2 3 4 ...

If that doesn't help: Can you tell me how to create the data or can you post
a link?

Gerd

Thorsten Kukuk wrote
> Hi,
> 
> I generated SRTM data for the USA with phygthmap and wanted to try
> to split it now for compiling with mkgmap. But while this worked fine
> for all other countries, in this case I get always the following
> exception:
> 
> MAP occupancy: 2.350.000.000, number of area dictionary entries: 3994 of
> 65535
> Map details: bytes/overhead 401.218.630 / 166.809.090, overhead includes
> 19 arrays with 8 MB
> 2.350.000.000 nodes processed... id=2526831732
> MAP occupancy: 2.360.000.000, number of area dictionary entries: 4000 of
> 65535
> Map details: bytes/overhead 402.878.606 / 166.808.202, overhead includes
> 19 arrays with 8 MB
> 2.360.000.000 nodes processed... id=2536831732
> Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException:
> 524288
>         at
> uk.me.parabola.splitter.SparseLong2ShortMapInline.putChunk(SparseLong2ShortMapInline.java:448)
>         at
> uk.me.parabola.splitter.SparseLong2ShortMapInline.saveCurrentChunk(SparseLong2ShortMapInline.java:191)
>         at
> uk.me.parabola.splitter.SparseLong2ShortMapInline.put(SparseLong2ShortMapInline.java:218)
>         at
> uk.me.parabola.splitter.ProblemListProcessor.processNode(ProblemListProcessor.java:167)
>         at
> uk.me.parabola.splitter.BinaryMapParser.parseDense(BinaryMapParser.java:113)
>         at crosby.binary.BinaryParser.parse(Unknown Source)
>         at crosby.binary.BinaryParser.handleBlock(Unknown Source)
>         at crosby.binary.file.FileBlock.process(Unknown Source)
>         at crosby.binary.file.BlockInputStream.process(Unknown Source)
>         at uk.me.parabola.splitter.Main.processMap(Main.java:792)
>         at uk.me.parabola.splitter.Main.genProblemLists(Main.java:582)
>         at
> uk.me.parabola.splitter.Main.partitionAreasForProblemListGenerator(Main.java:613)
>         at uk.me.parabola.splitter.Main.split(Main.java:244)
>         at uk.me.parabola.splitter.Main.start(Main.java:157)
>         at uk.me.parabola.splitter.Main.main(Main.java:146)
> 
> Any ideas? It's splitter r300.
> 
> Splitter version unknown compiled 2013-04-10T21:31:05+0000
> boundary-tags=use-exclude-list
> cache=
> description=TK-USA-Tile
> geonames-file=osmmaps/scripts/cities/USA.txt
> keep-complete=true
> mapid=71510001
> max-areas=1024
> max-nodes=5000000
> max-threads=4 (auto)
> mixed=false
> no-trim=false
> output=pbf
> output-dir=build/usa/tiles-srtm
> overlap=0
> polygon-file=
> precomp-sea=data/sea/current
> problem-file=
> problem-report=
> resolution=13
> split-file=
> status-freq=120
> stop-after=dist
> write-kml=
> 
> 
> -- 
> Thorsten Kukuk, Project Manager/Release Manager SLES
> SUSE LINUX Products GmbH, Maxfeldstr. 5, D-90409 Nuernberg
> GF: Jeff Hawn, Jennifer Guild, Felix Imendörffer, HRB 16746 (AG Nürnberg)
> _______________________________________________
> mkgmap-dev mailing list

> mkgmap-dev at .org

> http://lists.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

--
View this message in context: http://gis.19327.n5.nabble.com/splitter-exception-with-SRTM-data-for-USA-tp5756629p5756638.html
Sent from the Mkgmap Development mailing list archive at Nabble.com.