142. Escape from S3

We discuss common use cases and challenges for copying data between S3 buckets and S3-compatible object storage services. We share our experience building an open source Node.js CLI tool called S3-Migrate to efficiently migrate data with separate source and destination credentials. We cover performance considerations like streaming, chunk sizes, concurrency and parallelism. AWS Bites is brought to you in association with fourTheorem. If you need a friendly partner to support you and work with you to de-risk any AWS migration or development project, check them out at ⁠⁠⁠fourtheorem.com⁠⁠⁠ In this episode, we mentioned the following resources: s3-migrate CLI tool: DigitalOcean Spaces Object Storage: Cloudflare R2: Backblaze B2: Wasabi Cloud Storage: Linode / Akamai Object Storage: MinIO (Self-hosted S3-compatible storage): Basecamp / Hey’s move away from S3: AWS re:Post - How to move objects between S3 buckets: AWS Labs - Utility for S3 Migration: s3s3mirror (Java-based tool): rclone S3 Support: knox-copy (Ruby-based, deprecated): Flexify.io (paid cloud migration service): Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on X/Twitter, BlueSky or LinkedIn:- ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ | ⁠⁠ | ⁠⁠ - ⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ | ⁠⁠ | ⁠⁠

You can listen to 142. Escape from S3 online on Radio and Podcast. Open the player on this page to stream the available audio.

142. Escape from S3 is an episode from AWS Bites by AWS Bites.

This episode is 00:30:44 long.

This episode was published on Apr 3, 2025.

Yes. Use the heart button on the episode page to add it to your favorite episodes list.

Yes. This page shows related episodes from AWS Bites when more episodes are available from the podcast feed.