<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">Jon and Frederik: good hunch, the Austrian import failed with:<div><br></div><div><span class="Apple-style-span" style="font-size: 12px; ">--------------------------------</span></div><div>#> osm2pgsql --database world --username gis --password --verbose austria.osm.bz2</div><div>... (cut) ...</div><div><div>Reading in file: austria.osm.bz2</div><div>Processing: Node(6760k) Way(0k) Relation(0k)planet_osm_point - bad result during COPY, data 430058975 \N \N \N \N \N \N \N \N \N \N \N \N \N \</div><div>N \N \N \N \N \N \N \N bus_stop \N \N \N \N \N \N \N \N \N \N \N Altöttinger Straße/Aldi \N \N \</div><div>N \N \N \N \N \N \N \N \N \N \N \N \N \N \N \N \N \N \N SRID=900913;POINT(1398018.41536173 6112460.23312236)</div><div>... (cut) ...</div><div><span class="Apple-style-span" style="font-size: 12px; ">--------------------------------</span></div><div><br></div><div>I double checked the database: everything, including my GIS templates and the working database are UTF8:</div><div><br></div><div><span class="Apple-style-span" style="font-size: 12px; ">--------------------------------</span></div><div>#> psql -U gis -l</div><div>... (cut) ...</div><div>world | gis | UTF8 | en_US.UTF-8 | en_US.UTF-8 |</div><div><span class="Apple-style-span" style="font-size: 12px; ">--------------------------------</span><br><div><br class="webkit-block-placeholder"></div><div>
<div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; ">Also, I just noticed that when it fails it also crashes the whole PostgreSQL server requiring a `service postgresql restart` to get going again. This started when I began using the --verbose switch. Failed imports with and without --slim and without --verbose just fail but leave the database alone.</div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><br></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; ">The log file in /var/log/pgsql is empty (0 bytes).</div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><br></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; ">Matt & Peter: good catch, it was a typo. I have 8.4.3 from the pgdg84 repository which I setup with:</div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><br></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; ">--------------------------------</div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; ">#> rpm -ivh http://yum.pgsqlrpms.org/reporpms/8.4/pgdg-centos-8.4-2.noarch.rpm</div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; ">--------------------------------<br></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><br></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; ">— Seth</div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><br class="khtml-block-placeholder"></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font class="Apple-style-span" color="#808080" face="Verdana" size="2"><b style="color: rgb(128, 128, 128); font-family: Verdana; font-size: 10px; font-weight: bold; ">Seth Voltz </b><b style="color: rgb(128, 128, 128); font-family: Verdana; font-size: 10px; font-weight: bold; ">| CTO | Shift Inc.<br style="color: rgb(128, 128, 128); font-family: Verdana; font-size: 10px; font-weight: bold; "></b></font><font class="Apple-style-span" color="#808080" face="Verdana" size="2"><a href="mailto:seth.voltz@shiftresearch.com">seth.voltz@shiftresearch.com</a> | <a href="http://www.shiftresearch.com">www.shiftresearch.com</a></font><br><font class="Apple-style-span" color="#808080" face="Verdana" size="2"><br style="color: rgb(128, 128, 128); font-family: Verdana; font-size: 10px; "></font><font class="Apple-style-span" color="#808080" face="Verdana" size="2">voice: (774) 262-9092</font></div><div style="margin-top: 0in; margin-right: 0in; margin-left: 0in; margin-bottom: 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif; "><span style="font-size: 7.5pt; font-family: Verdana, sans-serif; color: gray; ">_________________________________________________<o:p></o:p></span></div><div style="margin-top: 0in; margin-right: 0in; margin-left: 0in; margin-bottom: 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif; "><span style="font-size: 7.5pt; font-family: Verdana, sans-serif; color: rgb(127, 127, 127); ">This email and any attachments thereto may contain private, confidential, and privileged<o:p></o:p></span></div><div style="margin-top: 0in; margin-right: 0in; margin-left: 0in; margin-bottom: 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif; "><span style="font-size: 7.5pt; font-family: Verdana, sans-serif; color: rgb(127, 127, 127); ">material for the sole use of the intended recipient. Any review, copying, or distribution of<o:p></o:p></span></div><div style="margin-top: 0in; margin-right: 0in; margin-left: 0in; margin-bottom: 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif; "><span style="font-size: 7.5pt; font-family: Verdana, sans-serif; color: rgb(127, 127, 127); ">this email (or any attachments thereto) by others is strictly prohibited. If you are not the<o:p></o:p></span></div><div style="margin-top: 0in; margin-right: 0in; margin-left: 0in; margin-bottom: 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif; "><span style="font-size: 7.5pt; font-family: Verdana, sans-serif; color: rgb(127, 127, 127); ">intended recipient, please contact the sender immediately and permanently delete the original<o:p></o:p></span></div><div style="margin-top: 0in; margin-right: 0in; margin-left: 0in; margin-bottom: 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif; "><span style="font-size: 7.5pt; font-family: Verdana, sans-serif; color: rgb(127, 127, 127); ">and any copies of this email and any attachments thereto.</span></div><div style="margin-top: 0in; margin-right: 0in; margin-left: 0in; margin-bottom: 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif; "><font class="Apple-style-span" color="#7F7F7F" face="Verdana, sans-serif" size="2"><span class="Apple-style-span" style="font-size: 10px; "><br></span></font></div></span></div></span></div></div><br class="Apple-interchange-newline">
</div>
<br><div><div>On Apr 15, 2010, at 1:49 PM, Jon Burgess wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><div>On Thu, 2010-04-15 at 12:01 -0700, Seth Voltz wrote:<br><blockquote type="cite">-----BEGIN PGP SIGNED MESSAGE-----<br></blockquote><blockquote type="cite">Hash: SHA256<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">I've searched high and low for a solution to this problem and have found nothing that works. I have successfully imported a CloudMade extract of California into my PostGIS database and rendered tiles from it using the Mapnik scripts. Able to confirm basic functionality, I decided to move up to a full planet import. I have tried 3 planet files (100317, 100401 and 100407) with the same error at different points for each file and sometimes different places for the same file on different runs. No import is able to get past the nodes import. From searching on the forums it at first seemed the error was being caused by duplicate data in the Planet file and running without --slim would bypass the problem. Here is the latest run on the 100401 planet export without slim mode:<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">- ---------------------------------------------------<br></blockquote><blockquote type="cite">Reading in file: planet-100401.osm.bz2<br></blockquote><blockquote type="cite">Processing: Node(61870k) Way(0k) Relation(0k)planet_osm_point - bad result during COPY, data 86767681 \N \N \N \N \N \N \N \N \N \N \N \N \N \N \N \N \N \N \N \N \N \N \N \N \N \N \N \N \N \N \N \N \N Unterdürnbach \N \N \N \N \N \N village \N \N \N \N \N \N \N \N \N \N \N \N \N \N SRID=900913;POINT(1767106.17982627 6203496.15919218)<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Error occurred, cleaning up<br></blockquote><blockquote type="cite">#> <br></blockquote><blockquote type="cite">- ---------------------------------------------------<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Running with slim mode on yields the same errors earlier in the document (around 32000k if memory serves)<br></blockquote><br>Odd, I don't think I have ever seen that error before. The presence of<br>that "ü" in the output makes me wonder if this is an encoding issue.<br>Your database using should be UTF-8:<br><br>$ psql -l<br> List of databases<br> Name | Owner | Encoding | Collation | Ctype | Access<br>privileges <br>-----------+----------+----------+-------------+-------------+-----------------------<br> gis | jburgess | UTF8 | en_GB.UTF-8 | en_GB.UTF-8 | <br><br>If it is not UTF-8 then you will need to create it again, e.g.<br><br>$ createdb -E UTF8 -O <username> gis<br><br>If that does not work then perhaps you should look in the postgresql<br>server log to see if that includes a more verbose error message.<br><br><span class="Apple-tab-span" style="white-space:pre"> </span>Jon<br><br><br><blockquote type="cite">My installation is CentOS 5.4 with the latest SVN (20912) osm2pgsql. PostgreSQL 5.4.3 and postgis 1.3.6-1 were installed via Yum from the PGDG84 repository.<br></blockquote><blockquote type="cite"><br></blockquote><blockquote type="cite">Thanks in advance for any help.<br></blockquote><blockquote type="cite">— Seth<br></blockquote><br><br></div></blockquote></div><br></div></div></body></html>