[Tile-serving] [osm2pgsql-dev/osm2pgsql] osm2pgsql to pmtiles / Looking for a simple way to generate community map and data projects (Discussion #2463)

[Tobias]

Maybe someone already has this set up and can share something.
And if not, maybe this is something to think about…

**Kontext:**
It is very easy to host static websites (GitHub Pages etc.) and static files (S3 etc.). It is a lot harder to host a tile server (etc.).
We have more and more OSM Community projects that create topic-specific data for vector maps and exports.
Right now, the tooling that osm2pgsql provides for this is still quite complex (for good reasons and optimized for those reasons).
Constraint: To keep things simple, I am only looking for data updates maybe every 6-12 hours or daily, but not minutely.

**Question:**
What is the simplest setup I can run to create daily PMtiles for a data set using osm2pgsql to handle my data processing?

**Examples:**

- **TILDA** https://github.com/FixMyBerlin/tilda-geo
  Daily PBF > Osmium tag filter > osm2pgsql > DB > DB-Functions (for Generalization) > Martin > Vectortile Endpoints > Filesystem Cache
  This system works great for TILDA but is way too complex for a hobby project.

- **OpenRailwayMap Vector** https://github.com/hiddewie/OpenRailwayMap-vector
  I did not investigate the system in detail but it looks like they use Martin to create mbtiles and then create pmtiles from them.

- **Streuobstwiesen** Karte https://github.com/ohrie/portal-streuobst, https://portal-streuobst.de/karte/#6/51.166/10.452
   AFAIK [the process is](https://github.com/ohrie/portal-streuobst/tree/main/data-processing) PBF > Osmium > Gdal > Tippecanoe

- Americana https://wiki.openstreetmap.org/wiki/OpenStreetMap_Americana
   Uses Planetiler.

**Ideal setup ideas:**

- Ideally, I would like to use PMtiles, which I can just put somewhere and reference from my vector map.
- Ideally, I would like to use [tippecanoe ](https://github.com/felt/tippecanoe) to create the PMtiles because for most projects, the Tippecanoe magic of generalization is enough to get a usable result.
- Ideally, there would be a way to pass the data from OSM2PGSQL directly to Tippecanoe or with a minimal and storage-efficient intermediate step.
- It would be perfect if there were a way to run the OSM2PGSQL process without relying on a database at all; or one that I can create self-contained in the processing Docker image and that can be deleted after the PMtile files are created.

**Output formats**

Some of those processes above only focus on the vector tile output (using different methods). That is a very valid constraint to simplify the process when the result is "just" a visual map. But many of the projects I see coming up can and should also consider the exportable data form their pipeline part of their assets. This is the great thing we have when running the current osm2pgsql setup, we already have the database to export from. This is an aspect we could ideally preserve. The question is, how to do this in a file based mindset. Pmtiles are not the right format here, but GeoParquet files look like a good candidate to fill this gap.

---

I know quite a few pieces of this puzzle are not how things are now. But we will be seeing many new vector-based map projects in the near future, and many of them could run a similar pipeline. It would be great if more OSM projects would use a similar approach so contributing will be easy, and the projects work under similar constraints but also have similar capabilities.

-- 
Reply to this email directly or view it on GitHub:
https://github.com/osm2pgsql-dev/osm2pgsql/discussions/2463
You are receiving this because you are subscribed to this thread.

Message ID: <osm2pgsql-dev/osm2pgsql/repo-discussions/2463 at github.com>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/tile-serving/attachments/20260407/52c5e4e0/attachment.htm>