Amazon S3 Baseline Performance

Overview

• Amazon S3 is designed to scale and provide high performance, with low latency and high throughput.
• By default, S3 provides very high request rates and low latency (100-200ms for the first byte out of S3).

Performance Metrics

• PUT/COPY/POST/DELETE Requests: Up to 3,500 requests per second per prefix.
• GET/HEAD Requests: Up to 5,500 requests per second per prefix.

Prefix Explanation

• A prefix in S3 is the path before the filename.
• There's no limit to the number of prefixes in a bucket.
• Example Prefix: /folder1/sub1/ for an object located at s3://yourbucket/folder1/sub1/file

S3 Request Rate Example

• Object: file
• Four objects with different prefixes (/folder1/sub1/, /folder1/sub2/, etc.)
• Each prefix can independently support the max request rate.
• With four prefixes, you could theoretically achieve 22,000 GET/HEAD requests per second when spread evenly.

S3 Performance Optimization

Multi-part Upload

• Recommended for files over 100 MB.