[Tile-serving] [openstreetmap/mod_tile] Update S3 API to use AWS authorization signature protocol V4 (#143)

Eric Stadtherr notifications at github.com
Thu Oct 6 22:08:19 UTC 2016


This is an extension of openstreetmap/mod_tile#122 that modifies the libs3 API calls to use libs3 v3.0, which implements V4 of the AWS authorization signature protocol. It therefore depends on bji/libs3#50, which adds V4 signature support to libs3.

You can view, comment on, or merge this pull request online at:

  https://github.com/openstreetmap/mod_tile/pull/143

-- Commit Summary --

  * started working on S3 storage backend
  * added libs3 autoconf support, completed initial store_s3 implementation
  * allow case where default host name for s3 access isn't specified in connection string
  * add url-decoding to s3 connection string
  * add url detection for s3 storage
  * add new storage module to apache module build
  * fix error logging
  * added s3 testing to unit test, got s3 working with metatiles
  * add environment variable support to S3 credential configuration
  * don't chdir when forking - this allows systemd to configure the working directory
  * let systemd handle stdout/stderr too
  * clean up some uninitialized values
  * fix more uninitialized values to make valgrind happy
  * fix buffer write quantity computation
  * removed some debug to help performance
  * cleanup of logging
  * added S3 reference to README
  * improved autoconf support for libs3 - now allows library location to be specified to configure
  * fix library search path when specifying an alternate location for libs3 library
  * add environment variable support to bucket name and basepath
  * improve error logging upon bind failure
  * fix compilation error when specifying non-standard libs3 directory
  * refined debug logging
  * add s3 connection string description to example configuration file
  * fix double-free of storage object
  * made the s3 storage module a little less chatty
  * tweaks to logging
  * reduced logging
  * fix errors in S3 usage
  * update to newer libs3 version that supports AWS Signature V4
  * fix compile warning
  * fix uninitialized memory
  * improve logging of different tile URL cases
  * fix uninitialized property field and spelling error

-- File Changes --

    M Makefile.am (15)
    M configure.ac (40)
    M includes/metatile.h (29)
    M includes/store_file.h (5)
    M includes/store_file_utils.h (1)
    A includes/store_s3.h (16)
    M mod_tile.conf (1)
    M readme.txt (4)
    M src/daemon.c (9)
    M src/gen_tile_test.cpp (308)
    M src/metatile.cpp (1)
    M src/store.c (6)
    M src/store_file.c (9)
    A src/store_s3.c (605)

-- Patch Links --

https://github.com/openstreetmap/mod_tile/pull/143.patch
https://github.com/openstreetmap/mod_tile/pull/143.diff

-- 
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
https://github.com/openstreetmap/mod_tile/pull/143
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/tile-serving/attachments/20161006/af26cd67/attachment.html>


More information about the Tile-serving mailing list