[OSM-dev] Minute Diffs Broken

Florian Lohoff flo at rfc822.org
Tue Oct 6 15:03:47 BST 2009


Hi,

On Tue, May 05, 2009 at 08:32:44AM +1000, Brett Henderson wrote:
> Hi Everybody,
> 
> Unfortunately the minute diffs appear to be regularly missing data.  In 
> the last 8 hours at least 3 changesets have been missed.  The ones I've 
> noticed are 1076325, 1076998, 1077469.  These have been detected by 
> comparing the normal minute diffs against another minute diff process 
> running half an hour later.  I don't know what is causing these 
> changesets to be applied to the database so slowly, whether it's just 
> their size or some other factor I don't know.  I don't know if this is 
> something that can be fixed, or whether the current osmosis extraction 
> method is too time-sensitive and simply broken.
> 
> At some stage over the next day or so I'll try to publish the audit 
> results automatically so that the problems are at least visible.
> 
> The hourly and daily diffs should be more reliable because they run with 
> a 30 and 40 minute delay respectively although theoretically there's no 
> guarantee that they're correct either.
> 
> So, any suggestions on how to fix this?
> 
> I've been trying to avoid requiring any changes to the main database in 
> order to keep things simple but perhaps it's unavoidable.  One way 
> around the problem would be to introduce delta table(s) in the main 
> database populated by triggers on the existing history tables and 
> containing the ids and timestamps of changes.  Osmosis could read those 
> tables and delete records as it processes them.  It's a major change though.
> 
> This isn't an ideal forum for coming up with solutions, but I thought it 
> was important to ensure people are aware of the problem.  I'll try to 
> spend some time on IRC over the next few days.  Whatever the solution, I 
> won't have the time (or skills) to do it on my own.

Is this fixed or at least somebody has an idea how to fix this? Its
been 6 Months since i switched to hourly updates which did not suffer
from this problem although i'd like my applications to be more current.

Flo
-- 
Florian Lohoff                                         flo at rfc822.org
"Es ist ein grobes Missverständnis und eine Fehlwahrnehmung, dem Staat
im Internet Zensur- und Überwachungsabsichten zu unterstellen."
- - Bundesminister Dr. Wolfgang Schäuble -- 10. Juli in Berlin 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 189 bytes
Desc: Digital signature
URL: <http://lists.openstreetmap.org/pipermail/dev/attachments/20091006/ae7d9bae/attachment.pgp>


More information about the dev mailing list