Compactness

Summary

Original Pbf File = 66.12 GB

	FlatMap	Pbf (no meta, locations on ways)
uncompressed	72.125.314.843	84.920.749.729
compressed bz2	55.907.932.608	54.290.110.221

Measurements:

planet.pbf = planet-140122.pbf so this was January 2022

66.117.018.734 planet.pbf

This is the original planet file. Its compactness origins from efficient encoding (varint, delta) and blockwise compression. To distinguish the 2 sources of compactness we unpack the blocks so that only the effect of encoding remains. Nearby we also remove metadata, which is not yet supported in FlatMap and also due to European law is often avoided anyway. This gives us

92.566.916.103 planet-nometa-raw.pbf

Next we apply the locations-on-ways design which for large files causes compaction:

84.920.749.729 planet-nometa-raw-low.pbf

We now apply full file compression on this file, to see that the blockwise file compression as practiced with pbf has the same effect as full file compression:

54.290.110.221 planet-nometa-raw.pbf.bz2

The FlatMap file is:

72.125.314.843 planet.fm
48.361.037.199 planet.fm.7z
55.907.932.608 planet.fm.bz2