[OSM-talk] Installing your own tileserver on Ubuntu

[Joseph Reeves]

Hi Kai,

> The pre-rendered tiles are stored in /var/lib/mod_tile/default. You can
> simply delete those files and they will automatically get rerendered the
> next time you view them.

Great, thanks, that's working great.

> I have seen that you appear to need to restart renderd (sudo
> /etc/init.d/renderd restart) after a new import, as it otherwise appears to
> still use old data (It is kind of odd, so I might have the wrong impression
> here).

Sorry, I should've said in my previous email - I was assuming this to
be the case. Out of interest, is there any log output from renderd?
I'm running this on a netbook so tiles take a while to be produced; it
would be interesting to see some logs so that I know it's all working
as I expect.

> However, what you are trying to do is as far as I know not supported by
> osm2pgsql. Although it seems to be a much requested feature, I don't think
> osm2pgsql currently handles importing of multiple extracts. The --append
> option doesn't really do what you would think it does.

I tried the append flag and got an error about an already existing way
- it would be good if osm2pgsql would simply ignore any ways that
already exist in the database. I re-ran osm2pgsql without the --slim
option, however, and the import was successful. I currently have
Bulgaria and Romania working on my netbook :)

Am trying to re-import Turkey now, then onwards with bits of Europe!
If it all works out do you mind if I do a bit of wiki fiddling on your
instructions?

Thanks again,

Joseph



On 18 October 2011 16:06, Kai Krueger <kakrueger at gmail.com> wrote:
> Hi,
>
> On 10/18/11 8:26 AM, Joseph Reeves wrote:
>>
>> hi Kai,
>>
>> Thanks a lot for this, it seems to be working well for me. I've got a
>> question, although I accept that it might be a osm2pgsql query.
>>
>> I followed the instructions and imported Turkey into my db - this
>> worked fine and I was happily rendering maps of the country. Since
>> then I have used the same osm2pgsql command to import Bulgaria and
>> Romania, but this seems to be causing issues:
>>
>> At the moment, only northern Romania is rendering as expected - for
>> Turkey and Bulgaria I'm only seeing either pre-rendered tiles or new
>> tiles based on nothing more than the coastline data. As far as I can
>> tell, the only data currently in my db is for northern Romania.
>>
>> How best to check this? Is there a way to remove the pre-rendered
>> tiles and create new ones from the contents of my db? Is there a
>> different command I should be running to append data to an existing
>> database?
>
> The pre-rendered tiles are stored in /var/lib/mod_tile/default. You can
> simply delete those files and they will automatically get rerendered the
> next time you view them. You can also "touch" the planet import time stamp
> file (unfortunately I can't remember the exact location and name of the file
> atm). mod_tile checks the time stamp of the rendered tiles. If it is older
> than the time stamp of the planet import, it will assume the data has
> changed and attempt to rerender the tiles.
>
> I have seen that you appear to need to restart renderd (sudo
> /etc/init.d/renderd restart) after a new import, as it otherwise appears to
> still use old data (It is kind of odd, so I might have the wrong impression
> here).
>
> However, what you are trying to do is as far as I know not supported by
> osm2pgsql. Although it seems to be a much requested feature, I don't think
> osm2pgsql currently handles importing of multiple extracts. The --append
> option doesn't really do what you would think it does.
>
> Osm2pgsql can currently either import a fresh extract, deleting the previous
> copy of your db, or it can "append" diff files. It can't append a second
> extract.
>
> What you could potentially do is to change the extract file into a change
> file by changing the xml header and inserting a <modified> tag at the right
> place. However diff processing is currently one or two orders of magnitude
> slower than initial import mode, so doing that is likely to be prohibitively
> expensive.
>
> Kai
>
>>
>> Thanks again, Joseph
>>
>>
>>
>>
>> On 9 October 2011 23:13, Kai Krueger<kakrueger at gmail.com>  wrote:
>>>
>>> Hello everyone,
>>>
>>> with the recent need to crack down on tile scrapers and apps to not over
>>> tax the main OSM tileservers and hosting, there has been a lot of talk
>>> trying to convince people to set up their own tileserver.
>>>
>>> Although that is of cause by far not the only hurdle to set up your own
>>> tileserver, one barrier is perhaps the perceived complicated procedure
>>> to set up all the elements necessary. Although there are a number of
>>> decent howtos already available on the wiki (perhaps even to many, each
>>> containing slightly different advice...), it is perhaps still more
>>> effort than people want to get into.
>>>
>>> In the hope to make this process even simpler, I have created a bunch of
>>> packages for Ubuntu containing all the necessary software, as well as
>>> glue packages to deal with the necessary setup and interaction between
>>> the different components.
>>>
>>> The packages aren't perfect yet, but hopefully sufficiently helpful
>>> already to be of use to others who are interested in playing around with
>>> their own tileserver.
>>>
>>> A simple standard tileserver can now be setup in 5 commands in a
>>> terminal:
>>>
>>> sudo add-apt-repository ppa:kakrueger/openstreetmap
>>> sudo apt-get install libapache2-mod-tile
>>> wget http://download.geofabrik.de/osm/north-america/us/colorado.osm.pbf
>>> osm2pgsql -C 1500 colorado.osm.pbf
>>> sudo /etc/init.d/renderd restart
>>>
>>> At the end you should have a working tileserver based on mod_tile and
>>> renderd with the standerd OSM-mapnik stylesheet.
>>>
>>> You can test it out by opening the installed slippymap at
>>> http://localhost/osm/slippymap.html
>>>
>>> You will of cause want to replace the above lines with the downloading
>>> and importing of an extract with the extract you care about.
>>>
>>> Although for smaller areas hardware requirements aren't too bad, they
>>> quickly go up beyond what can be handled by a standard desktop computer.
>>> My rough guestimate of what a typical desktop / laptop can handle is
>>> about an extract of 100 - 300 Mb (no more than an hours worth of
>>> import). This covers most of the US and German states, as well as many
>>> of the other less densely mapped countries.
>>>
>>> If you are more serious about your tileserver, you will need to tune the
>>> various configuration settings, but just to play around and for personal
>>> use, the default settings should work reasonable.
>>>
>>> More information can be found on yet another wiki-page... (
>>> http://wiki.openstreetmap.org/wiki/Ubuntu_tile_server )
>>>
>>> Any comments or feedback are welcome,
>>>
>>> Kai
>>>
>>> _______________________________________________
>>> talk mailing list
>>> talk at openstreetmap.org
>>> http://lists.openstreetmap.org/listinfo/talk
>>>
>
>