[OSM-dev] geofabrik snapshots: Cannot read germany

[Andreas Kalsch]

I read all data using dumping and copy (fastest way).

1) For the PBF version this failed, because of 2 errors (!) in the nodes dump. 2 timestamps were 
malformed like this: "2005-08-01 21:11:38)0200" instead of "2005-08-01 21:11:38+0200"
So all tables were populated but the nodes table. From the Postgres docs:

"COPYstops operation at the first error. This should not lead to problems in the event of aCOPY TO, 
but the target table will already have received earlier rows in aCOPY FROM. These rows will not be 
visible or accessible, but they still occupy disk space."

It seems that there is no way to ignore malformed CSV lines. I think using triggers is a bad idea 
because it will degrade performance.

2) Today I have tried the same with the OSM.BZ2 version. But the bz2 is malformed, I cannot 
decompress it.

I would try to read the whole planet, if my current server setup would allow it. So I am very 
thankful that geofabrik provides the dumps, and I hope this helps to make your service better.

Smaller dumps of the Bundesländer seem to work. Now I will give the europe dump a try.

Andi






-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/dev/attachments/20101213/1409881d/attachment.html>