[Imports] Fwd: [Talk-us] Import of EPA data

[jamesmikedupont at googlemail.com]

The delete is running right now,
I dont need to even check ahead of time, because if someone has
changed the version, then it will come back as a conflict from the
delete request.

The only thing i needed to do was this :

for each changeset $id
PERL :
 my $filename="${id}.osm";
 if (! -f $filename)
    {
	my $cmd = "wget
http://www.openstreetmap.org/api/0.6/changeset/${id}/download
--output-document=$filename";
	system $cmd;
    }

and then for each file convert from OSMchange format to josm format :
PERL :
while (<>)
{
    s/osmChange/osm/g;
    s/\<\/?create>//g;
    print "$_";
}

mike

On Fri, Dec 18, 2009 at 5:27 PM, jamesmikedupont at googlemail.com
<jamesmikedupont at googlemail.com> wrote:
> Yes, I am working on the update script as we speak.
> But I offered to delete the data from the beginning.
> Also, I can do this in josm and have done it already.
>
> If there are changes then I will just leave them. Only version 1 will
> be deleted.
> mike
>
> On Fri, Dec 18, 2009 at 5:05 PM, Chris Hunter <chunter952 at gmail.com> wrote:
>> Gotcha.  Sorry, I thought you were wanting to keep the data in the map and
>> programmatically update it.
>>
>>  It's gonna be impossible to use the rollback script at this point, but
>> since there are only nodes in the dataset the algorithem  isn't that
>> complex.
>>
>> 1 Query the changeset for all node IDs
>> 2 Query the database for the version number of the resulting nodes
>> 3 If version = 1, delete node else flag for user review
>>
>> Of course since my C & bash skills are rusty as all get out and all my SQL
>> experience is with mySQL (pun intended) I have no idea how much of a hit the
>> server will take running step 2.
>>
>> DiverCTH (Chris)
>>
>> P.S. I don't know if anyone else has said it yet, but welcome aboard.  Glad
>> to see we haven't scared you off.
>
> Thanks. I have lots of experience in FLOSS projects and know that
> tempers can get excited when you cannot see the person who you are
> yelling at.
>
> It is important to also realise that being open means that many
> embarrasing things are out in the open.
>
> The most important thing in such a project is to have a long term
> commitment to making things better, I have that.
>
> I am happy to do what I can.
>
> mike
>
>>
>> Chris
>>
>> On Fri, Dec 18, 2009 at 10:51 AM, jamesmikedupont at googlemail.com
>> <jamesmikedupont at googlemail.com> wrote:
>>>
>>> Listen,
>>>
>>> I support the idea of deleting the data. Should I do it? Its there an
>>> easier way to delete a whole changeset?
>>>
>>> I am still working on the processing, and will continue on this
>>> outside of the OSM database.
>>>
>>> It my a mistake to just import the data,
>>> but as I said, I am willing to put the work into cleaning it up.  I am
>>> commited to making sure that we have a solution to this.
>>>
>>> My internet was cut off for the past two days, when all the data is
>>> downloaded I will be able to tell you what is in the EPA dataset.
>>>
>>> I wont be importing it directly but setting up a database.
>>>
>>> Now, it should be easy enough, once the data is there, to also do
>>> checks and updates.
>>> From a programming point of view, we should be able to tell if an ID
>>> has changed, and as long as the IDS are present to be able to update
>>> the data as needed in OSM.
>>>
>>> mike
>>>
>>
>>
>