@S3Proxy

Allow S3 applications to access other storage backends, e.g., local file system, Backblaze B2, Google Cloud Storage, Microsoft Azure, OpenStack Swift.

github.com/gaul/s3proxy
Joined November 2016
  • Tweets42
  • Following5
  • Followers27
S3Proxy 4.1.0 released with support for object versioning for GCS, S3, and transient and server-side encryption for Azure, S3, and transient: github.com/gaul/s3proxy/rele…

Release S3Proxy 4.1.0 · gaul/s3proxy

Authenticate against Swift's tempauth as well as Keystone Fix ListObjectsV2 start-after on the azureblob backend, #938 Handle conditional deletes natively on the aws-s3, filesystem, and transie...

github.com
1
19
S3Proxy 4.0.0 released with improved Azure ETag compatibility, native conditional PutObjects, server-side multipart copies, and removal of Apache jclouds: github.com/gaul/s3proxy/rele…

Release S3Proxy 4.0.0 · gaul/s3proxy

Answer binary/octet-stream for an object stored without a Content-Type, #179 Build Docker image on a custom JRE, #401 Copy multipart parts server-side when possible, #76 Evaluate the policy a form ...

github.com
1
1
24
S3Proxy 3.3.0 released with a new openstack-swift-sdk storage backend, improved CRC and SHA checksums, and streaming azureblob-sdk PutObjects: github.com/gaul/s3proxy/rele…

Release S3Proxy 3.3.0 · gaul/s3proxy

Add openstack-swift-sdk storage backend, #1095 Enforce part checksums in CompleteMultipartUpload, #656 Fix ListObjects hiding user objects with UUID-shaped keys, #1089 Fix v4 signatures when using ...

github.com
1
24
S3Proxy 3.2.0 released with an SFTP bridge, improved support for checksums, and deprecation of Apache jclouds providers: github.com/gaul/s3proxy/rele… @AzmyBlog @captainpacket @tejas_nx

Release S3Proxy 3.2.0 · gaul/s3proxy

Accept x-amz-checksum-{crc32,crc32c,sha1,sha256} headers, #765 Add /healthz endpoint for health monitoring, #763 Bridge S3-only clients to SFTP storage, #1042 Change storage backend defaults from d...

github.com
1
1
50
S3Proxy 3.1.0 released with a new google-cloud-storage-sdk storage backend, token-based authentication in the aws-s3-sdk storage backend, and extended attribute fixes for filesystem-nio2: github.com/gaul/s3proxy/rele…

Release S3Proxy 3.1.0 · gaul/s3proxy

Add google-cloud-storage-sdk storage backend, #757 Handle filesystems without extended attribute support in filesystem-nio2 storage backend Handle missing MD5 during object listing, #963 Support me...

github.com
2
1
59
We all loved #MinIO for building neat demos locally that need S3…and then they went and shuttered the project. I took a look at some of the alternatives, including @S3Proxy, @SeaweedFS, @RustFSofficial , #Garage, and @ApacheOzone. 👉 rmoff.net/2026/01/14/alterna…

Alternatives to MinIO for single-node local S3

rmoff.net
2
23
79
7,875
S3Proxy retweeted
klaudworks
@klaudworksJan 6
I recently started contributing to s3proxy. Shipped all 4 PRs for version 3.0.0. 🥳
S3Proxy@S3ProxyJan 6
S3Proxy 3.0.0 released with a new aws-s3-sdk provider and OpenTelemetry Prometheus metrics: github.com/gaul/s3proxy/rele… @klaudworks

Release S3Proxy 3.0.0 · gaul/s3proxy

Add aws-s3-sdk provider, #940 Add OpenTelemetry Prometheus metrics with configurable port/host, #946 Deprecate aws-s3, azureblob, filesystem, s3, and transient storage backends Use aws-s3-sdk, azu...

github.com
1
1
102
S3Proxy 3.0.0 released with a new aws-s3-sdk provider and OpenTelemetry Prometheus metrics: github.com/gaul/s3proxy/rele… @klaudworks

Release S3Proxy 3.0.0 · gaul/s3proxy

Add aws-s3-sdk provider, #940 Add OpenTelemetry Prometheus metrics with configurable port/host, #946 Deprecate aws-s3, azureblob, filesystem, s3, and transient storage backends Use aws-s3-sdk, azu...

github.com
1
1
1
211
S3Proxy 2.9.0 released with support for multipart upload for azureblob-sdk and a PrefixBlobStore to map buckets into a prefix: github.com/gaul/s3proxy/rele…

Release S3Proxy 2.9.0 · gaul/s3proxy

Add PrefixBlobStore, #907 Fix Content-Range response for EncryptedBlobStore, #921 Implement atomic conditional PutObject for azureblob-sdk, #902 Implement multipart upload for azureblob-sdk, #904 ...

github.com
1
74
S3Proxy 2.8.0 released with support for conditional PutObject, payload checksums, and NoCacheBlobStore middleware to disable conditional GetObject: github.com/gaul/s3proxy/rele…

Release S3Proxy 2.8.0 · gaul/s3proxy

Add NoCacheBlobStore, #849 Emulate conditional PutObject, #732, #831 Fix EncryptedBlobStore error handling, #848 Replace fileupload2 dependency with Jetty Support payload checksums, #806 Thanks @k...

github.com
1
61
S3Proxy 2.7.0 released with a new latency blobstore middleware and improved S3 compatibility: github.com/gaul/s3proxy/rele…

Release S3Proxy 2.7.0 · gaul/s3proxy

Add latency blobstore middleware, #836 Allow null localIdentity with bucket locators, #781 Fix EncryptedBlobStore support for S3 compatible backends without ETag suffix, #825 Force Jetty header cac...

github.com
1
70
S3Proxy 2.6.0 released with AWS IRSA support, many bug fixes, and security fixes for the filesystem storage backends: github.com/gaul/s3proxy/rele…

Release S3Proxy 2.6.0 · gaul/s3proxy

Change Docker storage backend to filesystem-nio2 Fix insecure path traversal in filesystem and filesystem-nio2, #769 Ignore new AWS checksum headers, #765 Run s3-tests against Minio in CI, #744 Sup...

github.com
1
122
S3Proxy 2.4.0 released with a new Azure SDK provider, a Java NIO.2 provider, a user metadata replacer middleware, and many bug fixes: github.com/gaul/s3proxy/rele…

Release S3Proxy 2.4.0 · gaul/s3proxy

Add azureblob-sdk storage backend which supports other authentication mechanisms Add middleware to replace user metadata Add transient-nio2 storage backend Allow setting service-path config when ru...

github.com
1
128
Try the new Azure SDK-based storage backend: github.com/gaul/s3proxy/pull…. This may resolve issues found with the existing Apache jclouds-based storage backend.

Add azureblob-sdk provider backed by Azure SDK by gaul · Pull Request #696 · gaul/s3proxy

This may replace the jclouds azureblob provider. The implementation lacks some error codes and options. Fixes #606.

github.com
1
25
S3Proxy 2.3.0 released with a new storage class middleware and many bug fixes. github.com/gaul/s3proxy/rele…

Release S3Proxy 2.3.0 · gaul/s3proxy

Allow x-amz-user-agent header Add middleware to override storage class Adds feature allowing Access-Control-Expose-Headers configuration Configure maximum-timeskew with environment variable Fix tim...

github.com
2
1
160
S3Proxy 2.2.0 released with improved filesystem performance with many objects, a new regex middleware, and many bug fixes. github.com/gaul/s3proxy/rele…

Release S3Proxy 2.2.0 · gaul/s3proxy

Add DELETE and HEAD methods for CORS and CORS headers for all responses, #565 Add regex middleware, #495 Atomically replace objects in filesystem putBlob, apache/jclouds#162 Change Docker base imag...

github.com
1
3
156
S3Proxy 2.1.0 released with modern Jetty support and many bug fixes. github.com/gaul/s3proxy/rele…

Release S3Proxy 2.1.0 · gaul/s3proxy

Add Access-Control-Allow-Credentials header, #416 Clear system property for credentials for file paths, #546 Ensure all errors are logged at debug level, #543 Fixed marker being saved under wrong k...

github.com
1
2
156
Performance inconsistencies between remote disks is a real challenge in production. In this article, we explain how we were able to enhance the performance of ClickHouse with Remote Disk configuration on Azure using s3proxy. engineering.contentsquare.co…

Making ClickHouse on Azure Blob Storage fast with s3proxy - Contentsquare Engineering Blog

At Contentsquare, we are operating our data pipeline on two prominent cloud providers: AWS and Azure. While this approach offers remarkable flexibility to our customers in choosing their preferred…

engineering.contentsquare.com
1
1
1
291
S3Proxy retweeted
MinIO
@Minio12 Mar 2022
Why we are deprecating the MinIO gateway: hubs.li/Q015VF4n0 @aws #S3 @azure
1
1
1
S3Proxy 2.0.0 released with a new transparent encryption middleware, JUnit 5.0 support, improved Java 17 compatibility, and several storage backend compatibility fixes. github.com/gaul/s3proxy/rele…

Release S3Proxy 2.0.0 · gaul/s3proxy

configure Jetty to use legacy compliance improve compatibility with ExAws improve compatibility with Java 17 micro-optimize request signing and parsing middleware to transparently encrypt data publ...

github.com
2
1
Load more