[Openstreetmap] How do we handle large amount of GPS points?

[Matt Amos]

On Saturday 04 December 2004 21:45, Petter Reinholdtsen wrote:
> Next step is to write the GPX import tool to store the points into
> your database.  Unless someone is already working on this, I will
> have a look later.  But I suspect the import should be done
> locally, as the amount of data is huge, and it will take forever to
> insert 7 million GPS points using XML-RPC over the Internet.

i agree it should be done locally to the server, as the GPX file will 
be a more compact storage form than XML-RPC. also, the web uploader 
could quite easily read .gpx.gz/bz2 files.

my thinking was that people would upload to a web site, which would 
validate the file against the schema for gpx, do a number of basic 
checks on the usability (i.e: lack of noise and fubar'ed points) of 
the file and then import it to the database.

but i havent started working on this yet (still getting gpx files out 
of my SiRF program ;-)), so please have a look later!

> (I tried to import the files into qgis, but ran out of memory. :(
> ))

it seems to me that qgis is very memory hungry, even on quite small 
files.

cya,

matt
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 190 bytes
Desc: not available
URL: <http://lists.openstreetmap.org/pipermail/talk/attachments/20041205/13cfe790/attachment.pgp>