[Tilesathome] tah problems with multiple computers

[Sebastian Spaeth]

Sven wrote:
> Hi,
> 
> there seems to be a severe bug in tilesGen.pl or on the server side.
> Today I got access to 10 machines which I used for t at h generation. I
> configured them to store their finished .zip-files into a common
> directory (UploadToDirectory and UseHostnameInZipname) and use a
> loop_uploader. But then after some time I got messages like this:
> 
> ERROR: Is your client broken or have you just uploaded like crazy? "You
> have more than 150 active requests. Check your client."

This is nothing to do with the upload queue (which is not extremly long, 
although it seems so in the munin stats). You'll probably get this error 
when you have (I think) 20 files in your UploadToDirectory directory. 
This is to prevent clients from pushing too much stale data there when 
the server can't cope.

Also with 10 machines and 1 user account, it is rather easy to reach 150 
active requests (all those that are still in the upload queue on your 
Upload directory or in the Incoming server directory still count as active)

Either using a 2nd user accout will help, or just accepting the fact 
that you can render quicker than the server can take it and leave it at 
that. It's not a fatal warning.

And we are moving to a different server very soon, hopefully we'll be 
able to push up the prformance there a bit...

spaetz
> A lot of request show up in "Recently finished requests", but quite a
> lot (150) of processed requests stayed in "Current active requests", like:
> 1152,810 12-17 3 1 hour, 5 minutes 10956 1 hour, 4 minutes captionless
> 1153,810 12-17 3 1 hour, 5 minutes 40879 1 hour, 4 minutes tile,maplint
> 1154,810 12-17 3 1 hour, 5 minutes 40879 1 hour, 4 minutes tile,captionless
> 1603,2237 12-17 3 1 hour, 5 minutes 62257 1 hour, 3 minutes
> tile,captionless
> 1290,2482 12-17 3 1 hour, 5 minutes 10956 1 hour, 3 minutes maplint
> 1168,810 12-17 3 1 hour, 4 minutes 65198 1 hour, 4 minutes captionless
> 1187,810 12-17 3 1 hour, 3 minutes 10956 1 hour, 3 minutes maplint
> 1232,810 12-17 3 1 hour 48316 59 minutes maplint
> 
> Then I stopped most of the machines and tried to regenerate those
> requests manually with "./tilesGen.pl xy 1220 809 12" and so on and
> "./tilesGen.pl upload" (which finished in nearly no time). For this
> special request I had to do this procedure 3 times!!! before the request
> was noticed/processed on the tah server and moved to finished requests.
> 
> But it seems that some tiles made it into t at h filesystem (e.g. see
> http://tah.openstreetmap.org/Browse/details/tile/12/3628/1613/) even if
> they still are marked as "active request".
> 
> Btw.
> - I noticed that when a lowzoom request could not be completed because
> an error in inkscape occoured or something else, it is not given back to
> the server.
> 
> - It would be a good idea to add a sig-handler to tilesGen.pl, so that
> if s.o. pressed CRTL-C the request is given back to the server.
> 
> Best regards,
>  Sven
> 
> 
> 
> 
> _______________________________________________
> Tilesathome mailing list
> Tilesathome at openstreetmap.org
> http://lists.openstreetmap.org/listinfo/tilesathome