[OSM-dev] Minute Diffs Broken

[Brett Henderson]

Karl Newman wrote:
> Okay, so I'm 5 days behind on my email (although scanning through more 
> recent subjects doesn't show any new activity about this), and maybe 
> this problem has been solved already. Apologies if so, but I want to 
> capture my thoughts while they're fresh. Please take this with a huge 
> grain of salt and don't be harsh with me, because I don't know the 
> details of the API workings (but I did read this entire thread).
> Some ideas to solve the root problem of Osmosis minute diffs missing 
> elements, which appears to be because the timestamp is dated from when 
> the transaction is opened instead of when it is committed:
> 1. If the transaction commit delay is caused by slow network 
> connections, stream the diff upload to a temp file and wait until it 
> finishes before passing it off to a rails daemon. The downside is 
> increased disk I/O, which may or may not be significant.
> 2. If the delay is caused by precondition verification or other rails 
> operations, then create the timestamp (in rails) once all data has 
> been received and preconditions verified, just prior to inserting all 
> the rows. This may not be possible without a major restructuring of 
> the code, though... (like if it does precondition checks and inserts 
> in sections for nodes, then ways, then relations, for example).
The problem still exists.  You can look at current audit reports here:
http://planet.openstreetmap.org/minute/audit/