[HOT] Downlaoding OSM data with timestamp field and Source field

[Imre Samu]

Hi Samuel,

>makes the script to timeout.

you can "tune" the overpass query a little, but sometimes the servers
overcrowded ..

- On the script you can modify the timeout parameter
            [out:json][timeout:625];
- and you can modify the overpass-server to other  ( stronger or less
crowded instance ) [  Settings / General settings /  Server: "
http://overpass.osm.rambler.ru/cgi/" ]
(  http://overpass.osm.rambler.ru/cgi/  =  (8 cores, 64 GB RAM).   :
 information: http://wiki.openstreetmap.org/wiki/Overpass_API  )

I have tried to load all higway tag from Nigeria , but probably this query
 is to big   for overpass.. .

sometimes help - to   create a lot of smaller query -  like: You can create
a query for  every  highway value.
*  highway=primary  in "Nigeria"”      ( timeout 425 , + meta ) ->
http://overpass-turbo.eu/s/bwK
*  highway=secondary  in "Nigeria"   ( timeout 425 , + meta ) ->
http://overpass-turbo.eu/s/bwL
*  ...


But if you want processing  "big" data , my prefered method ( on linux ) :
- downloading the raw data :
http://download.geofabrik.de/africa/nigeria.html  ( nigeria-latest.osm.pbf,
)
- and load with "osm2pgsql"  ( http://wiki.openstreetmap.org/wiki/Osm2pgsql
)   to PostgreSQL    with ( --extra-attributes ) option.
    "To use the osm_user, osm_uid, osm_version, and osm_timestamp tags, you
must use the osm2pgsql option --extra-attributes when importing."

- and analyze with  SQL  ( like:
https://github.com/openstreetmap/osm2pgsql/blob/master/docs/analysis.md )

Probably  this is working on windows - but I not tested ..  (
http://learnosm.org/en/osm-data/osm2pgsql/  )    .


cheers,
   Imre





2015-09-18 13:39 GMT+02:00 Samuel Aiyeoribe <olubunmi4ever at yahoo.co.uk>:

> Thanks Imre and Giovanni,
>
> Imre:
>
> I have tried out your method on overpass and it work but the issue i am
> having has to do with the extent of the size of the data which makes the
> script to timeout.
>
> When i tried extracting highway for the whole of Nigeria it timed out, i
> reduced it to a State it timed out too but when i reduced it to a lower
> geography it worked. I need the data for a larger geography, do you think
> if a have a faster internet the script can run before it timed out or do i
> try other browsers as i currently use chrome.
>
> Will appreciate your advice.
>
> Giovanni:
>
> I can't figure out the api method, can you please explain better
>
>
> Thanks
> Samuel
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/hot/attachments/20150918/f904a546/attachment.html>