[OSM-dev] XAPI and other solutions

[yvecai]

Hi all,
I already replied Pierre-Alain on the french list, but it maybe useful 
for others too.
For an extract of cross-country trails at [1], I use a world planet file 
updated by osmosis as a file with daily diffs whenever I feel like too. 
Find the script attached.
Then Osmfilter [2] do the filtering, as in my case Osmosis is not able 
to filter relations recursively enough.
Planet update is ~4 hours, filtering ~2hours on a 4Go ram machine.
By the way, same result on a 7200rpm disk or SSD disk. I guess ram and 
compression are the bottlenecks.

Yves
[1] www.pistes-nordiques.org
[2] http://wiki.openstreetmap.org/wiki/Osmfilter

On 24. 04. 11 20:59, Martijn van Exel wrote:
> Hi Pierre,
>
> As far as XAPI servers go I have given up for now, although MapQuest 
> is running a more reliable instance[1] that may be useful, although 
> they employ Ian's Java implementation as well so the same bbox 
> limitations likely apply.
>
> I am, in fact, working on a similar project in the Netherlands and for 
> an up-to-date data feed for CCTV cameras I use the process described 
> here[2]. I'd love to compare that to your approach, we can probably 
> benefit from each other's work.
>
> Best
> Martijn
>
> [1] http://developer.mapquest.com/web/products/open/xapi
> [2] 
> https://docs.google.com/document/pub?id=1paaYsOakgJEYP380R70s4SGYq8ME3ASl-mweVi1DlQ4
>
> On Sat, Apr 23, 2011 at 9:57 PM, Pierre-Alain Dorange 
> <pdorange at mac.com <mailto:pdorange at mac.com>> wrote:
>
>     Hi, i'm a french contributor and i look for advice for a project.
>
>     I'm processing free french city official data (from insee,
>     official stat
>     agency) and i have to match those city with osm city (place=*) to
>     geolocalize it on a map.
>     The project is to present cctv surveillance in the country (see
>     demo at
>     [1]).
>
>     To get those data and preprocess them i used XAPI to retrive all nodes
>     with tag place=* :
>
>     The result is fine but XAPI servers are randomly running and data
>     seems
>     old. New Java XAPI servers do not accept the bounding box : too large.
>
>     What are the best way to retrieve OSM raw data (xml format would be
>     preferable) to update regulary the project's data ?
>
>     Thanks.
>
>     [1] project demo
>     http://www.leretourdelautruche.com/map/cctv/cctv_map.php
>
>     These map show city global data (user contributions) and
>     individual cctv
>     camera localisation (from OSM man_made=surveillance) when you zoom
>     to a
>     city with cctv mapped (ie. Strasbourg) :
>     <http://www.leretourdelautruche.com/map/cctv/cctv_map.php?zoom=15&lat=48
>     .5831&lon=7.75238&layers=B0T
>     <http://www.leretourdelautruche.com/map/cctv/cctv_map.php?zoom=15&lat=48%0A.5831&lon=7.75238&layers=B0T>>
>
>     --
>     Pierre-Alain Dorange
>     OSM experiences : <http://www.leretourdelautruche.com/map/>
>
>
>     _______________________________________________
>     dev mailing list
>     dev at openstreetmap.org <mailto:dev at openstreetmap.org>
>     http://lists.openstreetmap.org/listinfo/dev
>
>
>
>
> -- 
> Martijn van Exel
> http://about.me/mvexel
>
>
> _______________________________________________
> dev mailing list
> dev at openstreetmap.org
> http://lists.openstreetmap.org/listinfo/dev

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/dev/attachments/20110424/9a396ddb/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: planet_update.sh
Type: application/x-sh
Size: 4820 bytes
Desc: not available
URL: <http://lists.openstreetmap.org/pipermail/dev/attachments/20110424/9a396ddb/attachment-0002.sh>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: filter.sh
Type: application/x-sh
Size: 1267 bytes
Desc: not available
URL: <http://lists.openstreetmap.org/pipermail/dev/attachments/20110424/9a396ddb/attachment-0003.sh>