[OSM-dev] History statistics

[Ab_fab]

I think the memory problems occured during the osm-history-importer [1]
process

Some people were successfull in building the database for limited areas,
but France is extract is huge in comparison.
Is there a way to limit RAM usage for such large files during import ?

[1] https://github.com/MaZderMind/osm-history-renderer

2012/7/16 Jochen Topf <jochen at remote.org>

> On Mon, Jul 16, 2012 at 01:28:50PM +0200, Aurélien FILEZ wrote:
> > I'm searching history statistics of the french territory contributions in
> > order to make some graphics about :
> > - Number of "named roads"
> > - Numbers of "house numbers"
> > - Number of kilometers of different types of roads (highway, primary,
> > secondary, tertiary, residential).
> >
> > I tried OSMIUM with the last avalable france.osh.pbf, but data are too
> many
> > data and cause bad allocs errors on a 8 Gb memory server.
>
> What exactly did you do?
>
> If you use the RangeFromHistory handler to filter out one specific date in
> the
> history and then the Statistics handler, you should be able to generate
> some
> statistics, though not exactly the kind of statistics you are asking for.
> But
> you can use the Statistics handler as a model on how to write your own.
>
> You'd have to tun the thing several times, each time filtering out a
> different
> date with RangeFromHistory.
>
> Or you write your own handler that directyl works on history data, but
> thats
> a bit more tricky.
>
> In any case it should not need 8GB for all of this. You might have used the
> MmapAnon node storage instead of SparseTable handler. This explains the
> different options:
> http://wiki.openstreetmap.org/wiki/Osmium/Storing_Node_Positions
>
> Jochen
> --
> Jochen Topf  jochen at remote.org  http://www.remote.org/jochen/
> +49-721-388298
>
>
> _______________________________________________
> dev mailing list
> dev at openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev
>



-- 
ab_fab <http://wiki.openstreetmap.org/wiki/User:Ab_fab>
"Il n'y a pas de pas perdus"
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/dev/attachments/20121015/b84e5f9f/attachment.html>