[OSM-dev] Minute Diffs Broken
Florian Lohoff
flo at rfc822.org
Tue Oct 6 15:03:47 BST 2009
Hi,
On Tue, May 05, 2009 at 08:32:44AM +1000, Brett Henderson wrote:
> Hi Everybody,
>
> Unfortunately the minute diffs appear to be regularly missing data. In
> the last 8 hours at least 3 changesets have been missed. The ones I've
> noticed are 1076325, 1076998, 1077469. These have been detected by
> comparing the normal minute diffs against another minute diff process
> running half an hour later. I don't know what is causing these
> changesets to be applied to the database so slowly, whether it's just
> their size or some other factor I don't know. I don't know if this is
> something that can be fixed, or whether the current osmosis extraction
> method is too time-sensitive and simply broken.
>
> At some stage over the next day or so I'll try to publish the audit
> results automatically so that the problems are at least visible.
>
> The hourly and daily diffs should be more reliable because they run with
> a 30 and 40 minute delay respectively although theoretically there's no
> guarantee that they're correct either.
>
> So, any suggestions on how to fix this?
>
> I've been trying to avoid requiring any changes to the main database in
> order to keep things simple but perhaps it's unavoidable. One way
> around the problem would be to introduce delta table(s) in the main
> database populated by triggers on the existing history tables and
> containing the ids and timestamps of changes. Osmosis could read those
> tables and delete records as it processes them. It's a major change though.
>
> This isn't an ideal forum for coming up with solutions, but I thought it
> was important to ensure people are aware of the problem. I'll try to
> spend some time on IRC over the next few days. Whatever the solution, I
> won't have the time (or skills) to do it on my own.
Is this fixed or at least somebody has an idea how to fix this? Its
been 6 Months since i switched to hourly updates which did not suffer
from this problem although i'd like my applications to be more current.
Flo
--
Florian Lohoff flo at rfc822.org
"Es ist ein grobes Missverständnis und eine Fehlwahrnehmung, dem Staat
im Internet Zensur- und Überwachungsabsichten zu unterstellen."
- - Bundesminister Dr. Wolfgang Schäuble -- 10. Juli in Berlin
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 189 bytes
Desc: Digital signature
URL: <http://lists.openstreetmap.org/pipermail/dev/attachments/20091006/ae7d9bae/attachment.pgp>
More information about the dev
mailing list