<div>
<br>
Hey, that is great -- and Cheers!<br><br>When you get back, it would be interesting to find out, what kinda of results you get from a two stage extraction, using the same commands,<br><br>java.exe -jar osmosis.jar" --rx "planet-latest.osm.bz2"
enableDateParsing="YES" --lp interval="600" --bb left="-108" right="-36"
top="90" bottom="0" --wx "segment_earth.osm"<br><br>and then,<br><br>java.exe -jar osmosis.jar" --rx "segment_earth.osm"
enableDateParsing="YES" --lp interval="600" --bb left="-75" right="-73"
top="42" bottom="40" --wx "new_york_area.osm" <br>^^^ this is what is yielding a 27 MB file from the 2.5 GB segment_earth.osm slice, when according to my test doing this above same command & parameters against a planet.osm yielded almost a 1.3 GB file :|<br><br>I mean, it is pretty clear I got a very slimmed down segment_earth.osm extraction.... left="-108" right="-36"
top="90" bottom="0", is a pretty big cross-section which yielded 2.5 GB. Which is totally confusing since I got 1.3 GB from left="-75" right="-73"
top="42" bottom="40", ... a tiny 2 degree cross segment! This is driving me nuts! haha<br><br>BTW, can you perform this test on a Windows Machine like I am? :))<br><br><br>
<blockquote style="border-left: 2px solid rgb(16, 16, 255); margin-left: 5px; padding-left: 5px;">----- Original Message -----<br>
From: "Brett Henderson" <brett@bretth.com><br>
To: "Fire Girl" <firegirl@amorous.com><br>
Subject: Re: [OSM-dev] Osmosis woes, something not right - can someone pls. see why?<br>
Date: Fri, 25 Jul 2008 17:12:50 +1000<br>
<br>
</firegirl@amorous.com></brett@bretth.com><div dir="ltr">I don't have access to a full planet at the moment. It's friday evening and about to head out for drinks so may not get to it tonight ... but I'll try it out in the morning and see if I can get it working.<br>
<br><div class="gmail_quote">2008/7/25 Fire Girl <<a href="mailto:firegirl@amorous.com">firegirl@amorous.com</a>>:<br><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
<div>
Correct-o, yes, I have a smaller than expected New York sub-slice, from segment_earth.osm. The segment_earth.osm I initially created, is 2.4 GB.... and from that, I tried extracting smaller 2 degree extraction, new_york.osm which ended up about 27MB!<br>
<br>Sorry for my confusion, what I meant to say was I tried this extraction from a OSM and a .BZ2 version of the segment_earth file.... both attempts ended up with the same result.<br><br>Now, I am running the same extraction from the planet.osm file, and the process is still creating the new_york.osm slice.... and it is almost 1GB so far.... so it looks like things are going well. I am so confused, because my syntax appears correct, and I am getting -some- kind of data when I created the initial segment_earth.osm, which I illustrated how I am getting that stage. I do think 2.4 GB is pretty small for that scope of coordinates,<br>
<br>2.4GB, segment_earth was left="-108" right="-36"
top="90" bottom="0" .... don't you think? I would suspect that should be way over 10GB at least.<br><br>I hope my Windows based Osmosis tool is doing the right thing..... I am getting good data when I run against planet.osm.... it's just my huge-sub-sliced extraction is not fairing so well when I try pulling smaller size segements from it. :( ??<br>
<br>i appreciate your time with this so far.... the only thing I can think of, since my syntax seems to work against the planet.osm file, is maybe such extraction is not feasable.... i hope someone can confirm my analysis if psble.<div>
<div></div><div class="Wj3C7c"><br><br><br>
<br>
<blockquote style="border-left: 2px solid rgb(16, 16, 255); margin-left: 5px; padding-left: 5px;">----- Original Message -----<br>
From: "Brett Henderson" <br>
To: "Fire Girl" <br>
Subject: Re: [OSM-dev] Osmosis woes, something not right - can someone pls. see why?<br>
Date: Fri, 25 Jul 2008 16:37:53 +1000<br>
<br>
<div dir="ltr">I just noticed you said the 27MB file was truncated. Do you mean it didn't get closed with an </osm> tag at the end? Or do you mean it was smaller than expected?<br><br>One other thing that might be worth mentioning. The osmosis bzip2 support is very slow. It might be worth recompressing files as gzip if you wish to improve performance. It will take up some more disk space but will run *much* faster.<br>
<br><div class="gmail_quote">On Fri, Jul 25, 2008 at 4:30 PM, Brett Henderson <<a href="mailto:brett@bretth.com" target="_blank">brett@bretth.com</a>> wrote:<br><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
<div dir="ltr">Hmm dunno. It certainly looks like you're doing the right thing ... there's no reason why this shouldn't work. Osmosis doesn't care much about the size of the file.<br><br>Are you sure you're running osmosis against the correct segment_earth.osm file? I notice you had both a compressed (bz2 file) and uncompressed version of the command line at the end of your email. Could you have run the new york extraction against an old version?<br>
<br><div class="gmail_quote">2008/7/25 Fire Girl <<a href="mailto:firegirl@amorous.com" target="_blank">firegirl@amorous.com</a>>:<br><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
<div><div></div><div>
Hi, I wanted to thank others who have help me understand OSM better! Marco, Andy, and others recently.<br><br>Here is where I am having a gaffe.... Ok, when I run this command on Osmosis, against the Planet OSM file,<br>
<br>java.exe -jar osmosis.jar" --rx "planet-latest.osm.bz2" enableDateParsing="YES" --lp interval="600" --bb left="-75" right="-73" top="42" bottom="40" --wx "new_york_area.osm"<br>
<br>It generates a huge OSM for New York Area, which is complete.<br><br>However... If I run this command against the Planet OSM file,<br><br>java.exe -jar osmosis.jar" --rx "planet-latest.osm.bz2"
enableDateParsing="YES" --lp interval="600" --bb left="-108" right="-36"
top="90" bottom="0" --wx "segment_earth.osm"<br>
<br>It creates a 2.4 GB file. But, I don't think it is complete. Because, if I thereafter, try to extract the New York Slice from this file, I get a truncated 27MB file with hardly anything in it. The Lat/Lon coodinates match the above extraction right? Am I doing something wrong.... or can I simply not extract such a huge sub-slice before slicing it down further? <br>
<br>running,<br><br>java.exe -jar osmosis.jar" --rx "segment_earth.osm" enableDateParsing="YES" --lp interval="600" --bb left="-75" right="-73" top="42" bottom="40" --wx "new_york_area.osm"<br>
java.exe -jar osmosis.jar" --rx "segment_earth.osm.bz2"
enableDateParsing="YES" --lp interval="600" --bb left="-75" right="-73"
top="42" bottom="40" --wx "new_york_area.osm"<br>
<br>generates a 27MB file from this.<br><br>What is up? :)<br><font color="#888888"><br>
--
<div> Be Yourself @ <a href="http://mail.com" target="_blank">mail.com</a>!<br>
Choose From 200+ Email Addresses<br>
Get a <b>Free</b> Account at <a href="http://www.mail.com/Product.aspx" target="_blank">www.mail.com</a>!</div>
</font><br></div></div>_______________________________________________<br>
dev mailing list<br>
<a href="mailto:dev@openstreetmap.org" target="_blank">dev@openstreetmap.org</a><br>
<a href="http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev" target="_blank">http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev</a><br>
<br></blockquote></div><br></div>
</blockquote></div><br></div>
</blockquote>
</div></div></div><div><div></div><div class="Wj3C7c">
<br>
--
<div> Be Yourself @ <a href="http://mail.com" target="_blank">mail.com</a>!<br>
Choose From 200+ Email Addresses<br>
Get a <b>Free</b> Account at <a href="http://www.mail.com/Product.aspx" target="_blank">www.mail.com</a>!</div>
</div></div><br>_______________________________________________<br>
dev mailing list<br>
<a href="mailto:dev@openstreetmap.org">dev@openstreetmap.org</a><br>
<a href="http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev" target="_blank">http://lists.openstreetmap.org/cgi-bin/mailman/listinfo/dev</a><br>
<br></blockquote></div><br></div>
</blockquote>
</div>
<BR>
--
<div> Be Yourself @ mail.com!<br>
Choose From 200+ Email Addresses<br>
Get a <b>Free</b> Account at <a href="http://www.mail.com/Product.aspx" target="_blank">www.mail.com</a>!</div>