[mkgmap-dev] mkgmap-dev Digest, Vol 162, Issue 25

Mon Jan 17 13:45:43 GMT 2022

Hi John,
a lot of things were changed since v4286.
I have no idea what can cause a 30% slower execution. Are you sure about this?
Maybe you just ran both versions once and the older worked with filled disk cache?

Gerd

________________________________________
Von: mkgmap-dev <mkgmap-dev-bounces at lists.mkgmap.org.uk> im Auftrag von John Thorn <johnrthorn at gmail.com>
Gesendet: Sonntag, 16. Januar 2022 14:18
An: mkgmap-dev at lists.mkgmap.org.uk
Betreff: Re: [mkgmap-dev] mkgmap-dev Digest, Vol 162, Issue 25

Hi Gerd et al,

Downloaded 4865 and ran it to make a .GMAP with no changes to data nor options

Compared with running v4286 (which works for me so I still use) :

MDR is now 43092K was 47347K

Runtime (reading .MP files) seemed slower, maybe 30% slower

Some .RGN files are bigger : now 5855K was 5823K, for example.

Searching in Basecamp runs with no problems.

Keep up the good work!

John

On Sun, 16 Jan 2022 at 12:00, <mkgmap-dev-request at lists.mkgmap.org.uk<mailto:mkgmap-dev-request at lists.mkgmap.org.uk>> wrote:
Send mkgmap-dev mailing list submissions to
        mkgmap-dev at lists.mkgmap.org.uk<mailto:mkgmap-dev at lists.mkgmap.org.uk>

To subscribe or unsubscribe via the World Wide Web, visit
        https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
or, via email, send a message with subject or body 'help' to
        mkgmap-dev-request at lists.mkgmap.org.uk<mailto:mkgmap-dev-request at lists.mkgmap.org.uk>

You can reach the person managing the list at
        mkgmap-dev-owner at lists.mkgmap.org.uk<mailto:mkgmap-dev-owner at lists.mkgmap.org.uk>

When replying, please edit your Subject line so it is more specific
than "Re: Contents of mkgmap-dev digest..."
Today's Topics:

   1. Please try and report results of Huffman compression
      (Gerd Petermann)
   2. Re: Please try and report results of Huffman      compression (7770)
   3. Re: Please try and report results of Huffman      compression
      (Gerd Petermann)

---------- Forwarded message ----------
From: Gerd Petermann <GPetermann_muenchen at hotmail.com<mailto:GPetermann_muenchen at hotmail.com>>
To: "mkgmap-dev at lists.mkgmap.org.uk<mailto:mkgmap-dev at lists.mkgmap.org.uk>" <mkgmap-dev at lists.mkgmap.org.uk<mailto:mkgmap-dev at lists.mkgmap.org.uk>>
Cc:
Bcc:
Date: Sat, 15 Jan 2022 15:59:24 +0000
Subject: [mkgmap-dev] Please try and report results of Huffman compression
Hi all,

during the last weeks Ticker and I decoded Garmin's String compression of the global index for the PC (the *_mdr.img) .
In the mdr2 branch I've coded support for that in mkgmap and I think its ready for a first beta test.

It works with codepages 1250 ..1258 or 65001.
I've no idea how the 2-byte pages work, but Garmin seems to support that, too. Maybe I'll work on this later.

The branch version produces around 200 lines of diagnostic output to show what happens when compression is enabled.
This will be changed to debug level later.

The encoding is enabled by default, special option --x-no-mdr15-compression can be used to turn it off.

Note that the size of the *_mdr.img file will be smaller (which is esp. intersting for those who get close to the 2G limit)
Note also that a zipped *_mdr.img can and will be larger since zip cannot remove as much redundancy.
Note also that this branch includes the changes from the faster-mp branch and introduces a few changes
which are relavant for --lower-case maps.

How to test?
Install the map in MapSource and check if you see any unexpected characters in the result lists or maybe even crashes while searching.
If so, please try the same input files with the --x-no-mdr15-compression to verify if this is caused by compression or maybe other changes.

Please don't yet publish the maps, but let me know if you see anything unexpected. Some changes reg. lower-case in this branch are still experimental.

The binary is here:
https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4865.zip

If you see errors which are caused by compression, please attach the diagnostic output.

@Ticker: Please review the source.

Gerd

---------- Forwarded message ----------
From: 7770 <7770 at foskan.eu<mailto:7770 at foskan.eu>>
To: "mkgmap-dev at lists.mkgmap.org.uk<mailto:mkgmap-dev at lists.mkgmap.org.uk>" <mkgmap-dev at lists.mkgmap.org.uk<mailto:mkgmap-dev at lists.mkgmap.org.uk>>
Cc:
Bcc:
Date: Sat, 15 Jan 2022 18:53:37 +0100
Subject: Re: [mkgmap-dev] Please try and report results of Huffman compression
Hi.
https://files.mkgmap.org.uk/detail/544

ALLVARLIG (MultiPolygonRelation): folder/77700046.osm.pbf: Internal error:
Failed to render MultiPolygonRelation 2970267
that was with --latin1

mkgmap version 4839 works well.

Regards
Karl

On lördag 15 januari 2022 16:59:24 CET Gerd Petermann wrote:
> Hi all,
>
> during the last weeks Ticker and I decoded Garmin's String compression of
> the global index for the PC (the *_mdr.img) . In the mdr2 branch I've coded
> support for that in mkgmap and I think its ready for a first beta test.
>
> It works with codepages 1250 ..1258 or 65001.
> I've no idea how the 2-byte pages work, but Garmin seems to support that,
> too. Maybe I'll work on this later.
>
> The branch version produces around 200 lines of diagnostic output to show
> what happens when compression is enabled. This will be changed to debug
> level later.
>
> The encoding is enabled by default, special option --x-no-mdr15-compression
> can be used to turn it off.
>
> Note that the size of the *_mdr.img file will be smaller (which is esp.
> intersting for those who get close to the 2G limit) Note also that a zipped
> *_mdr.img can and will be larger since zip cannot remove as much
> redundancy. Note also that this branch includes the changes from the
> faster-mp branch and introduces a few changes which are relavant for
> --lower-case maps.
>
> How to test?
> Install the map in MapSource and check if you see any unexpected characters
> in the result lists or maybe even crashes while searching. If so, please
> try the same input files with the --x-no-mdr15-compression to verify if
> this is caused by compression or maybe other changes.
>
> Please don't yet publish the maps, but let me know if you see anything
> unexpected. Some changes reg. lower-case in this branch are still
> experimental.
>
> The binary is here:
> https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4865.zip
>
> If you see errors which are caused by compression, please attach the
> diagnostic output.
>
> @Ticker: Please review the source.
>
> Gerd
> _______________________________________________
> mkgmap-dev mailing list
> mkgmap-dev at lists.mkgmap.org.uk<mailto:mkgmap-dev at lists.mkgmap.org.uk>
> https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

---------- Forwarded message ----------
From: Gerd Petermann <gpetermann_muenchen at hotmail.com<mailto:gpetermann_muenchen at hotmail.com>>
To: "mkgmap-dev at lists.mkgmap.org.uk<mailto:mkgmap-dev at lists.mkgmap.org.uk>" <mkgmap-dev at lists.mkgmap.org.uk<mailto:mkgmap-dev at lists.mkgmap.org.uk>>
Cc:
Bcc:
Date: Sun, 16 Jan 2022 09:38:14 +0000
Subject: Re: [mkgmap-dev] Please try and report results of Huffman compression
Hi all,

see https://www.mkgmap.org.uk/websvn/revision.php?repname=mkgmap&rev=4866
and https://www.mkgmap.org.uk/websvn/revision.php?repname=mkgmap&rev=4867

Please use https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4867.zip for further tests.

Gerd

________________________________________
Von: 7770 <7770 at foskan.eu<mailto:7770 at foskan.eu>>
Gesendet: Samstag, 15. Januar 2022 18:53
An: mkgmap-dev at lists.mkgmap.org.uk<mailto:mkgmap-dev at lists.mkgmap.org.uk>
Cc: Gerd Petermann
Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression

Hi.
https://files.mkgmap.org.uk/detail/544

ALLVARLIG (MultiPolygonRelation): folder/77700046.osm.pbf: Internal error:
Failed to render MultiPolygonRelation 2970267
that was with --latin1

mkgmap version 4839 works well.

Regards
Karl

On lördag 15 januari 2022 16:59:24 CET Gerd Petermann wrote:
> Hi all,
>
> during the last weeks Ticker and I decoded Garmin's String compression of
> the global index for the PC (the *_mdr.img) . In the mdr2 branch I've coded
> support for that in mkgmap and I think its ready for a first beta test.
>
> It works with codepages 1250 ..1258 or 65001.
> I've no idea how the 2-byte pages work, but Garmin seems to support that,
> too. Maybe I'll work on this later.
>
> The branch version produces around 200 lines of diagnostic output to show
> what happens when compression is enabled. This will be changed to debug
> level later.
>
> The encoding is enabled by default, special option --x-no-mdr15-compression
> can be used to turn it off.
>
> Note that the size of the *_mdr.img file will be smaller (which is esp.
> intersting for those who get close to the 2G limit) Note also that a zipped
> *_mdr.img can and will be larger since zip cannot remove as much
> redundancy. Note also that this branch includes the changes from the
> faster-mp branch and introduces a few changes which are relavant for
> --lower-case maps.
>
> How to test?
> Install the map in MapSource and check if you see any unexpected characters
> in the result lists or maybe even crashes while searching. If so, please
> try the same input files with the --x-no-mdr15-compression to verify if
> this is caused by compression or maybe other changes.
>
> Please don't yet publish the maps, but let me know if you see anything
> unexpected. Some changes reg. lower-case in this branch are still
> experimental.
>
> The binary is here:
> https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4865.zip
>
> If you see errors which are caused by compression, please attach the
> diagnostic output.
>
> @Ticker: Please review the source.
>
> Gerd
> _______________________________________________
> mkgmap-dev mailing list
> mkgmap-dev at lists.mkgmap.org.uk<mailto:mkgmap-dev at lists.mkgmap.org.uk>
> https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

_______________________________________________
mkgmap-dev mailing list
mkgmap-dev at lists.mkgmap.org.uk<mailto:mkgmap-dev at lists.mkgmap.org.uk>
https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev