[OSM-talk] [OSM-dev] Managing large XML files aka osm.xml

[Andy Allan]

On Jan 2, 2008 4:37 PM, Stefan de Konink <skinkie at xs4all.nl> wrote:
> On Wed, 2 Jan 2008, Artem Pavlenko wrote:
>
> > David Siegel implemented support for libxml2 parser in Mapnik, check
> > it out :
>
> I was able to load the entiere planet.osm into MonetDB4 (XML), but
> incompare to the SQL version it is not optimal. And one may wonder why he
> wants to use an text representation instead of a processed binary!
>
> For plain XML processing people should probably stick with MSXML for the
> time being. The performance of it is probably the best one out there. We
> did some XSLT processing based on the tiles at home stuff, and it is not
> funny that an 8 times as powerful machine gets beaten.
>
>
> I wonder how much time it will take for each run on an 8GB machine
> processing the current planet.osm (61GB).

This isn't to do with xml parsing of the planet.osm. This is to do
with using entities within the mapnik rules file, e.g. osm.xml from
http://svn.openstreetmap.org/applications/rendering/mapnik/ which in
itself is 2222 lines long and very verbose.

Cheers,
Andy