ecmchow/drone-s3-cache

By ecmchow

Updated about 2 years ago

Drone CI S3 Cache plugin

Image
Integration & delivery
Developer tools
0

10K+

ecmchow/drone-s3-cache repository overview

drone-s3-cache

Customized Drone CI plugin for caching build artifacts to S3 compatible storage backends. For the usage information and a listing of the available options please take a look at the official docs.

Customized by ecmchow https://github.com/ecmchow/drone-s3-cache

Customization

This plugin is modified to support additional S2 (an extension of Snappy) & ZSTD (Zstandard) compression.

Same as official plugin, you may use filename property to specify your artifact filename and control its compression with file extension.

kind: pipeline
type: docker
name: Build

steps:
- name: restore
  image: ecmchow/drone-s3-cache
  settings:
    # no compression by default
    filename: cache.tar.gz # GZIP compression
    filename: cache.tar.sz # S2 compression
    filename: cache.tar.zst # ZSTD compression

Choosing compression

For reference, a NodeJS project with 3.0GB of node_modules running on a 8 core runner with 10gbe network. Cache is uploaded to and downloaded from a single MinIO instance

CompressionSizeDownload+restore timeBuild+upload time
None (TAR archive only)3.0 GiB10s17s
GZIP589.2 MiB16s1m 7s
S2749.0 MiB4s6s
ZSTD544.4 MiB5s11s
  • Use S2 compression for best overall performance
  • Use ZSTD compression if you need best compression ratio to save storage space

Tag summary

Content type

Image

Digest

sha256:e5f817ab8

Size

8.3 MB

Last updated

about 2 years ago

docker pull ecmchow/drone-s3-cache:1.6.1