[mkgmap-dev] Splitter only writes points, not ways on huge file?

Fri May 28 11:11:09 BST 2021

Asia.poly is attached - I did not save the splitter.log - doing this right
now (but will take some hours - splitting this huge file takes a lot of
time)

The log starts with:
Splitter version 597 compiled 2020-01-30T14:10:47+0000
boundary-tags=use-exclude-list
cache=
description=
geonames-file=
handle-element-version=remove
ignore-osm-bounds=false
keep-complete=true
mapid=75400000
max-areas=2048
max-nodes=12000000
max-threads=7
mixed=false
no-trim=true
num-tiles=
output=pbf
output-dir=
overlap=auto
polygon-desc-file=
polygon-file=
precomp-sea=
problem-file=
problem-report=
resolution=13
route-rel-values=
search-limit=200000
split-file=
status-freq=120
stop-after=dist
wanted-admin-level=5
write-kml=
Elapsed time: 0s   Memory: Current 1012MB (7MB used, 1005MB free) Max
25000MB
Time started: Fri May 28 12:06:59 CEST 2021
Map is being split for resolution 13:
 - area boundaries are aligned to 0x800 map units (0.0439453125 degrees)
 - areas are multiples of 0x800 map units wide and high
Processing asia10m_.osm.pbf
Bounding box -179.99990000000003 -13.011650000000001 179.99990000000003
84.52666
10,000,000 nodes parsed... id=19999999
20,000,000 nodes parsed... id=29999999
30,000,000 nodes parsed... id=39999999
40,000,000 nodes parsed... id=49999999
50,000,000 nodes parsed... id=59999999
60,000,000 nodes parsed... id=69999999
70,000,000 nodes parsed... id=79999999
80,000,000 nodes parsed... id=89999999
90,000,000 nodes parsed... id=99999999
100,000,000 nodes parsed... id=109999999

On Fri, 28 May 2021 at 12:25, Gerd Petermann <
gpetermann_muenchen at hotmail.com> wrote:

> Hi Felix,
>
> the pbf file really contains only nodes.
> Can you attach the splitter log file and the asia.poly, please?
>
> Gerd
>
> ________________________________________
> Von: mkgmap-dev <mkgmap-dev-bounces at lists.mkgmap.org.uk> im Auftrag von
> Felix Hartmann <extremecarver at gmail.com>
> Gesendet: Freitag, 28. Mai 2021 11:18
> An: Development list for mkgmap
> Betreff: Re: [mkgmap-dev] Splitter only writes points, not ways on huge
> file?
>
> Hi Gerd,
> sorry - fixed. I attached the file. I could also put the whole 60GB file
> for analysis. But do not know if you could download such a huge file or
> analyse it better.
> https://openmtbmap.org/75400407.osm.pbf
>
> Felix
>
> On Fri, 28 May 2021 at 09:03, Gerd Petermann <
> gpetermann_muenchen at hotmail.com<mailto:gpetermann_muenchen at hotmail.com>>
> wrote:
> Hi Felix,
>
> the link to the pbf file seems to be wrong?  I get an 404
>
> Gerd
>
> ________________________________________
> Von: mkgmap-dev <mkgmap-dev-bounces at lists.mkgmap.org.uk<mailto:
> mkgmap-dev-bounces at lists.mkgmap.org.uk>> im Auftrag von Felix Hartmann <
> extremecarver at gmail.com<mailto:extremecarver at gmail.com>>
> Gesendet: Freitag, 28. Mai 2021 07:56
> An: Development list for mkgmap
> Betreff: [mkgmap-dev] Splitter only writes points, not ways on huge file?
>
> I used phyghtmap to create a huge file (60GB) of 10m equidistance osm.pbf
> contourlines data.
>
> phyghtmap --jobs=2 --polygon=/home/contourlines/bounds/asia.poly
> --step=10  --no-zero-contour --void-range-max=-420
> --output-prefix="Asia10m" --line-cat=500,100--start-node-id=10000000
> --start-way-id=10000000 --source=view1,srtm1,view3,srtm3
> --max-nodes-per-way=230 --max-nodes-per-tile=0 --pbf
>
> I am not fully sure that this pbf file is correct, but I created it
> exactly the same way as smaller countries. Maybe its also phyghtmap going
> wrong. But I doubt it with phyghtmaps incremental approach of just
> constantly writing out data.
>
> When splitting it with splitter - and opening up one of the osm.pbf files
> in JOSM - I noticed it contains only the contourline nodes, no lines.
> I think the Asia continent file spans 360 degrees - so maybe that causes
> problems with splitter?
>
>
>
> I have uploaded a splitted file here:
> https://openmtbmap.org/75400407.osm.pbf
> If you load it in Josm, you will notice it is alll the points but no
> lines...
>
> --
> Felix Hartman - Openmtbmap.org & VeloMap.org
>
> _______________________________________________
> mkgmap-dev mailing list
> mkgmap-dev at lists.mkgmap.org.uk<mailto:mkgmap-dev at lists.mkgmap.org.uk>
> https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
>
>
> --
> Felix Hartman - Openmtbmap.org & VeloMap.org
>
> _______________________________________________
> mkgmap-dev mailing list
> mkgmap-dev at lists.mkgmap.org.uk
> https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
>

-- 
Felix Hartman - Openmtbmap.org & VeloMap.org
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.mkgmap.org.uk/pipermail/mkgmap-dev/attachments/20210528/e66de5b5/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: asia.poly
Type: application/octet-stream
Size: 917 bytes
Desc: not available
URL: <http://www.mkgmap.org.uk/pipermail/mkgmap-dev/attachments/20210528/e66de5b5/attachment.obj>