[mkgmap-dev] Splitter r570

Wed Jan 11 17:35:32 GMT 2017

Hi all,

I've merged the junit branch and the memory_opt2 branch into trunk.

There are no changes in the user interface. The unit test framework was changed to junit (as with mkgmap),
but this is only important for developers of splitter.
A new ant target run.func-tests performs some functional tests. I'll add more in the next days.

The major improvements from the memory_opt2 branch:
- a smaller memory footprint, esp. when splitting large files like europe or planet with a rather small --max-nodes value
- still you'll see thesame or slightly better throughput compared to r560

Some numbers;

Split planet with --max-nodes=1000000

The stats after Problem-list-generator :

r560:

coord Map: 3.670.470.372 stored long/int pairs require ca. 1.0 bytes per pair. 67931848 chunks are used, the avg. number of values in one 64-chunk is 54.
coord Map details: bytes ~3.523 MB, including 35 array(s) with 8 MB

way Map: 385.087.014 stored long/int pairs require ca. 1.15 bytes per pair. 7019031 chunks are used, the avg. number of values in one 64-chunk is 54.
way Map details: bytes ~423 MB, including 4 array(s) with 8 MB

Problem-list-generator pass(es) took 879042 ms

r:570:
coord Map: 3.670.470.372 stored long/int pairs require ca. 0.48 bytes per pair. 67931848 chunks are used, the avg. number of values in one 64-chunk is 54.
coord Map details: bytes ~1.710 MB, including 35 array(s) with 8 MB

way Map: 385.087.014 stored long/int pairs require ca. 0.75 bytes per pair. 7019031 chunks are used, the avg. number of values in one 64-chunk is 54.
way Map details: bytes ~276 MB, including 4 array(s) with 8 MB

...

Problem-list-generator pass(es) took 829059 ms

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.mkgmap.org.uk/pipermail/mkgmap-dev/attachments/20170111/801189cd/attachment.html>