[osmosis-dev] write-pgsql-dump results in incomplete nodes.txt

[Tobias Wendorff]

Hi there,

for the German dev server, I'm trying to import the whole planet
(I'm using the experimental PBF versions) into a snapshot
database using write-pgsql-dump.

Everything is set up the correct way and works like expected
when using small extracts from Geofabrik (Europe or Germany).
The system has enough memory and very fasts disks.

Whenver I tried to generate the dump files from a planet,
notes.txt gets corrupted. The file is 118-128 GB and all other
files seem to be fine, but the ending of notes.txt looks like
this:

"1350872705      1 32308 2011-07-06 02:09:49+0200        8644204 
0101000020E6100000EB573A1F1E696040AC74779D0D1B4140
1350872706      1 32308 2011-07-06 02:09:49+0200        8644204 
0101000020E610000052836918BE66604059A48977801B4140
1350872707      1 32308 2011-07-06 02:09:49+0200        8644204 
0101000020E6100000A227655243686040240F441669184140
1350872708      1 32308 2011-07-0"

or like the geom looks like that:
"0101000020E6100000C4A2D8C00CCC31408DED5AE784A94840
0101000020E61000009E1A796A3FD131402FBF78AB53AC4840
0101000020E61000005840FC57B1CB3140EE9007C7D1A94840
0101000020E6100000ECADDC6685CB3140F0BF3A3366A94840
0101000020E61000006625F785A1CB3140C93EC8B260A94840
0101000020E61000003B42BC64D2CB31400B50093EBCA94840
0101000020E6100000A8F809B144D131402AF40BC050AC4840
0101000020E61000007B51161978CB31404E4C721B68A94840
0101000020E610000056DD7E541ECC31405D548B8862A94840
0101000020E61000005E83BEF4F6CB314065236B685EA94840
0101000020E61000005E7FB7E5C8CB3140F74201DBC1A94840
0101000020E6100000AA3B6068BFCB3140" (incomplete)

I tried the actual and the previous planet.osm.pbf, same result
on both. Is it a problem of pbf? I'm currently running the
conversion by plain OSM-XML, but it's very slow of course...

Oh, the error also occures when creating bboxes or linestrings
(on ways) and the system doesn't run out of ressource. Nobody
is on the machine (Dual Opteron, 16 GB RAM, 6x SCSI on RAID-0).
OS is Debian Squeeze with latest SUN JRE and osmosis 0.39
(I've also tried latest osmosis snapshot).

Can you help me? What information do you need?

Best regards,
Tobias