[mkgmap-dev] Splitter output files are nearly empty

Wed May 4 09:50:41 BST 2011

Hi,
I notice there is an extra - after /bin/osmosis --rx is that an error?

Markus_g
-----Original Message-----
From: mkgmap-dev-bounces at lists.mkgmap.org.uk
[mailto:mkgmap-dev-bounces at lists.mkgmap.org.uk] On Behalf Of Lambertus
Sent: Wednesday, 4 May 2011 1:19 AM
To: Development list for mkgmap
Subject: [mkgmap-dev] Splitter output files are nearly empty

Recently I've upgraded upgraded all my Garmin map making tools to the 
latest versions:
Osmosis 0.39
Splitter r171
Mkgmap r1926

Since then I'm having a problem while splitting the planet file: all 
output files are empty (~160 bytes).

In de commandline output I notice two things for which I seek input:
- What does "***** Full GC *****" mean?
- Is input from stdin still functional/supported for splitter?

Below is the commandline and output.

Commandline:
bunzip2 -d -c -k /home/lambertus/planet.openstreetmap.org/world.osm.bz2 
| ~/garmin/utils/osmosis/bin/osmosis --rx - --tf reject-ways building=* 
--tf reject-nodes type=communication --tf reject-ways admin_level=8 --tf 
reject-ways admin_level=9 --tf reject-ways admin_level=10 --wx file='-'
| java -Xmx7500m -ea -jar ~/garmin/utils/splitter/splitter.jar --no-trim 
--cache=cache --mapid=63240001 --max-nodes=1400000 --write-kml=world.kml 
--geonames-file=/home/lambertus/garmin/utils/cities15000.zip /dev/stdin

Commandline output (where [...] are multiple similar lines removed for 
readability):

cache=cache
description=
geonames-file=/home/lambertus/garmin/utils/cities15000.zip
legacy-mode=false
mapid=63240001
max-areas=255
max-nodes=1400000
max-threads=4 (auto)
mixed=false
no-trim=true
output-dir=
overlap=2000
resolution=13
split-file=
status-freq=120
write-kml=world.kml
Elapsed time: 0s   Memory: Current 119MB (2MB used, 117MB free) Max 6666MB
Time started: Mon May 02 23:00:41 CEST 2011
Map is being split for resolution 13:
  - area boundaries are aligned to 0x800 map units
  - areas are multiples of 0x1000 map units wide and high
Processing /dev/stdin
May 2, 2011 11:00:42 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Osmosis Version 0.39
May 2, 2011 11:00:43 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Preparing pipeline.
May 2, 2011 11:00:43 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Launching pipeline execution.
May 2, 2011 11:00:43 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Pipeline executing, waiting for completion.
Elapsed time: 2m 0s   Memory: Current 119MB (4MB used, 115MB free) Max 
6666MB
A <bounds/> tag was found. Area covered is (-90.0,-180.0) to (90.0,180.0)
2,500,000 nodes processed...
[...]
117,500,000 nodes processed...
***** Full GC *****
Elapsed time: 18m 0s   Memory: Current 135MB (106MB used, 29MB free) Max 
6666MB
[...]
267,500,000 nodes processed...
***** Full GC *****
Elapsed time: 38m 0s   Memory: Current 152MB (121MB used, 31MB free) Max 
6666MB
[...]
412,500,000 nodes processed...
***** Full GC *****
Elapsed time: 58m 0s   Memory: Current 154MB (122MB used, 32MB free) Max 
6666MB
[...]
567,500,000 nodes processed...
***** Full GC *****
Elapsed time: 1h 18m 0s   Memory: Current 152MB (122MB used, 30MB free) 
Max 6666MB
[...]
717,500,000 nodes processed...
***** Full GC *****
Elapsed time: 1h 38m 0s   Memory: Current 156MB (122MB used, 34MB free) 
Max 6666MB
[...]
875,000,000 nodes processed...
***** Full GC *****
Elapsed time: 1h 58m 0s   Memory: Current 151MB (121MB used, 30MB free) 
Max 6666MB
[...]
1,060,000,000 nodes processed...
Elapsed time: 2h 22m 0s   Memory: Current 152MB (128MB used, 24MB free) 
Max 6666MB
1,062,500,000 nodes processed...
in 1 file
Time: Tue May 03 01:22:59 CEST 2011
Exact map coverage is (-90.0,-180.0) to (90.0,180.0)
Trimmed and rounded map coverage is (-84.990234375,-180.0) to 
(85.078125,180.0)
Splitting nodes into areas containing a maximum of 1,400,000 nodes each...
Area (-84.990234375,-180.0) to (16.083984375,-89.47265625) contains 
748,264 nodes. DONE!
[...]
Area (50.009765625,132.1875) to (85.078125,180.0) contains 858,788 
nodes. DONE!
1158 areas:
Area 63240001 covers (0x201000,0xffbed000) to (0x20d000,0xffbff000)
[...]
Area 63241158 covers (0xffc39000,0xff800000) to (0xb7000,0xffc06000) 
GT-Guatemala City
Writing KML file to ./world.kml
Writing out split osm files Tue May 03 01:23:04 CEST 2011
Processing 1158 areas in 5 passes, 232 areas at a time
Starting pass 1 of 5, processing 232 areas (63240001 to 63240232)
Making SparseMultiMap
Making SparseMultiMap
Processing /dev/stdin
org.xmlpull.v1.XmlPullParserException: only whitespace content allowed 
before start tag and not a (position: START_DOCUMENT seen a... @1:1)
	at org.xmlpull.mxp1.MXParser.parseProlog(MXParser.java:1519)
	at org.xmlpull.mxp1.MXParser.nextImpl(MXParser.java:1395)
	at org.xmlpull.mxp1.MXParser.next(MXParser.java:1093)
	at 
uk.me.parabola.splitter.AbstractXppParser.parse(AbstractXppParser.java:62)
	at uk.me.parabola.splitter.Main.processMap(Main.java:399)
	at uk.me.parabola.splitter.Main.writeAreas(Main.java:355)
	at uk.me.parabola.splitter.Main.split(Main.java:188)
	at uk.me.parabola.splitter.Main.start(Main.java:116)
	at uk.me.parabola.splitter.Main.main(Main.java:105)
coords occupancy
MAP occupancy: 0
ways occupancy
MAP occupancy: 0
Thread worker-1 has finished
Thread worker-2 has finished
Thread worker-0 has finished
Starting pass 2 of 5, processing 232 areas (63240233 to 63240464)
Making SparseMultiMap
Making SparseMultiMap
Processing /dev/stdin
org.xmlpull.v1.XmlPullParserException: only whitespace content allowed 
before start tag and not m (position: START_DOCUMENT seen m... @1:1)
	at org.xmlpull.mxp1.MXParser.parseProlog(MXParser.java:1519)
	at org.xmlpull.mxp1.MXParser.nextImpl(MXParser.java:1395)
	at org.xmlpull.mxp1.MXParser.next(MXParser.java:1093)
	at 
uk.me.parabola.splitter.AbstractXppParser.parse(AbstractXppParser.java:62)
	at uk.me.parabola.splitter.Main.processMap(Main.java:399)
	at uk.me.parabola.splitter.Main.writeAreas(Main.java:355)
	at uk.me.parabola.splitter.Main.split(Main.java:188)
	at uk.me.parabola.splitter.Main.start(Main.java:116)
	at uk.me.parabola.splitter.Main.main(Main.java:105)
coords occupancy
MAP occupancy: 0
ways occupancy
MAP occupancy: 0
Thread worker-0 has finished
Thread worker-1 has finished
Thread worker-2 has finished
Starting pass 3 of 5, processing 232 areas (63240465 to 63240696)
Making SparseMultiMap
Making SparseMultiMap
Processing /dev/stdin
org.xmlpull.v1.XmlPullParserException: start tag not allowed in epilog 
but got t (position: END_TAG seen ...<tag k="abutters" 
v="residential"/>\n    <t... @2:7)
	at org.xmlpull.mxp1.MXParser.parseEpilog(MXParser.java:1588)
	at org.xmlpull.mxp1.MXParser.nextImpl(MXParser.java:1393)
	at org.xmlpull.mxp1.MXParser.next(MXParser.java:1093)
	at 
uk.me.parabola.splitter.AbstractXppParser.parse(AbstractXppParser.java:62)
	at uk.me.parabola.splitter.Main.processMap(Main.java:399)
	at uk.me.parabola.splitter.Main.writeAreas(Main.java:355)
	at uk.me.parabola.splitter.Main.split(Main.java:188)
	at uk.me.parabola.splitter.Main.start(Main.java:116)
	at uk.me.parabola.splitter.Main.main(Main.java:105)
coords occupancy
MAP occupancy: 0
ways occupancy
MAP occupancy: 0
Thread worker-1 has finished
Thread worker-2 has finished
Thread worker-0 has finished
Starting pass 4 of 5, processing 232 areas (63240697 to 63240928)
Making SparseMultiMap
Making SparseMultiMap
Processing /dev/stdin
org.xmlpull.v1.XmlPullParserException: start tag not allowed in epilog 
but got t (position: END_TAG seen ...<tag k="maintenance" 
v="gritting"/>\n    <t... @2:7)
	at org.xmlpull.mxp1.MXParser.parseEpilog(MXParser.java:1588)
	at org.xmlpull.mxp1.MXParser.nextImpl(MXParser.java:1393)
	at org.xmlpull.mxp1.MXParser.next(MXParser.java:1093)
	at 
uk.me.parabola.splitter.AbstractXppParser.parse(AbstractXppParser.java:62)
	at uk.me.parabola.splitter.Main.processMap(Main.java:399)
	at uk.me.parabola.splitter.Main.writeAreas(Main.java:355)
	at uk.me.parabola.splitter.Main.split(Main.java:188)
	at uk.me.parabola.splitter.Main.start(Main.java:116)
	at uk.me.parabola.splitter.Main.main(Main.java:105)
coords occupancy
MAP occupancy: 0
ways occupancy
MAP occupancy: 0
Thread worker-1 has finished
Thread worker-0 has finished
Thread worker-2 has finished
Starting pass 5 of 5, processing 230 areas (63240929 to 63241158)
Making SparseMultiMap
Making SparseMultiMap
Processing /dev/stdin
org.xmlpull.v1.XmlPullParserException: only whitespace content allowed 
before start tag and not g (position: START_DOCUMENT seen g... @1:1)
	at org.xmlpull.mxp1.MXParser.parseProlog(MXParser.java:1519)
	at org.xmlpull.mxp1.MXParser.nextImpl(MXParser.java:1395)
	at org.xmlpull.mxp1.MXParser.next(MXParser.java:1093)
	at 
uk.me.parabola.splitter.AbstractXppParser.parse(AbstractXppParser.java:62)
	at uk.me.parabola.splitter.Main.processMap(Main.java:399)
	at uk.me.parabola.splitter.Main.writeAreas(Main.java:355)
	at uk.me.parabola.splitter.Main.split(Main.java:188)
	at uk.me.parabola.splitter.Main.start(Main.java:116)
	at uk.me.parabola.splitter.Main.main(Main.java:105)
coords occupancy
MAP occupancy: 0
ways occupancy
MAP occupancy: 0
Thread worker-0 has finished
Thread worker-1 has finished
Thread worker-2 has finished
Time finished: Tue May 03 01:23:04 CEST 2011
Total time taken: 8543s
May 3, 2011 2:11:43 AM org.openstreetmap.osmosis.core.Osmosis run
INFO: Pipeline complete.
May 3, 2011 2:11:43 AM org.openstreetmap.osmosis.core.Osmosis run
INFO: Total execution time: 11460683 milliseconds.

lambertus at server:~/garmin/world$ ls -lh build
total 5.3M
-rw-r--r-- 1 lambertus lambertus  159 2011-05-03 01:23 63240001.osm.gz
[...]
_______________________________________________
mkgmap-dev mailing list
mkgmap-dev at lists.mkgmap.org.uk
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev