Yeah, I will use planet.rb. I turned on general query logging on mysql, but it didn't show any errors. I'll keep poking around and let you know if I find a fix.<br><br>-Al<br><br><div><span class="gmail_quote">On 8/2/07,
<b class="gmail_sendername">Brett Henderson</b> <<a href="mailto:brett@bretth.com">brett@bretth.com</a>> wrote:</span><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
I don't think I've seen that specific error but I get timeout errors<br>when trying to dump large data sets. The --read-mysql task still needs<br>work. I've just imported a full planet into my test databases and am
<br>planning to get it working over the next couple of days.<br><br>Can you use planet.rb to dump the database in the meantime?<br><br>Osmosis and planet.rb use a different technique for dumping. Osmosis<br>attempts to generate consistent snapshots of the database at a specific
<br>point in time which is essential for initialising replication. I assume<br>planet.rb simply reads the "current" tables one after the other which<br>leads to inconsistencies between nodes, segments and ways when run
<br>against a live database. The snapshot queries run by Osmosis against<br>the larger history tables are more difficult to tune, particularly for<br>ways where three tables are involved.<br><br>If you are the only one accessing the database,
planet.rb should (note I<br>haven't tested any of this) be suitable.<br><br>Osmosis has four tasks for mysql replication; snapshot dumps, snapshot<br>loads, change derivation and change application. The only one not<br>
working properly is the dump task, it is high on my priority list.<br><br>Al Wold wrote:<br>> Has anyone seen this error? It seems to happen once I get a decent<br>> amount of data into my db. It worked this morning when I had a small
<br>> subset of my county's TIGER data, but now I imported the full county<br>> and it won't dump successfully. It also happened with v0.5, so it<br>> isn't a new thing.<br>><br>> I definitely think mysql is to blame, but there isn't much on google
<br>> about this error.<br>><br>> -Al<br>><br>> Exception in thread "Thread-1-read-mysql"<br>> com.bretth.osmosis.OsmosisRuntimeException : Unable to move to next<br>> record.<br>> at
<br>> com.bretth.osmosis.mysql.impl.EntityReader.readNextValue(EntityReader.java:79)<br>> at<br>> com.bretth.osmosis.mysql.impl.EntityReader.next(EntityReader.java:144)<br>> at<br>> com.bretth.osmosis.mysql.MysqlReader.processWays
(MysqlReader.java:129)<br>> at com.bretth.osmosis.mysql.MysqlReader.run(MysqlReader.java:168)<br>> at java.lang.Thread.run(Thread.java:619)<br>> Caused by: com.mysql.jdbc.CommunicationsException : Communications
<br>> link failure due to underlying exception:<br>><br>> ** BEGIN NESTED EXCEPTION **<br>><br>> java.io.EOFException<br>> MESSAGE: Can not read response from server. Expected to read 4 bytes,<br>> read 1 bytes before connection was unexpectedly lost.
<br>><br>> STACKTRACE:<br>><br>> java.io.EOFException: Can not read response from server. Expected to<br>> read 4 bytes, read 1 bytes before connection was unexpectedly lost.<br>> at com.mysql.jdbc.MysqlIO.readFully
(MysqlIO.java :1997)<br>> at com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:2411)<br>> at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:2916)<br>> at com.mysql.jdbc.MysqlIO.checkErrorPacket
(MysqlIO.java :885)<br>> at com.mysql.jdbc.MysqlIO.nextRow(MysqlIO.java:1360)<br>> at<br>> com.mysql.jdbc.RowDataDynamic.nextRecord(RowDataDynamic.java:366)<br>> at com.mysql.jdbc.RowDataDynamic.next
(RowDataDynamic.java:355)<br>> at com.mysql.jdbc.ResultSet.next(ResultSet.java:7302)<br>> at<br>> com.bretth.osmosis.mysql.impl.EntityReader.readNextValue(EntityReader.java:72)<br>> at
com.bretth.osmosis.mysql.impl.EntityReader.next(<br>> EntityReader.java:144)<br>> at<br>> com.bretth.osmosis.mysql.MysqlReader.processWays(MysqlReader.java:129)<br>> at com.bretth.osmosis.mysql.MysqlReader.run
(MysqlReader.java:168)<br>> at java.lang.Thread.run(Thread.java :619)<br>><br>><br>> ** END NESTED EXCEPTION **<br>><br>><br>><br>> Last packet sent to the server was 435582 ms ago.<br>> at
com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:2622)<br>> at com.mysql.jdbc.MysqlIO.checkErrorPacket (MysqlIO.java:2916)<br>> at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:885)<br>> at
com.mysql.jdbc.MysqlIO.nextRow(MysqlIO.java:1360)<br>> at<br>> com.mysql.jdbc.RowDataDynamic.nextRecord(RowDataDynamic.java :366)<br>> at com.mysql.jdbc.RowDataDynamic.next(RowDataDynamic.java:355)
<br>> at com.mysql.jdbc.ResultSet.next(ResultSet.java:7302)<br>> at<br>> com.bretth.osmosis.mysql.impl.EntityReader.readNextValue(EntityReader.java<br>> :72)<br>> ... 4 more<br>><br>
<br><br><br>_______________________________________________<br>dev mailing list<br><a href="mailto:dev@openstreetmap.org">dev@openstreetmap.org</a><br><a href="http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev">
http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev</a><br></blockquote></div><br>