Amazon EFS Migration Operations

Key Concepts

• EFS (Elastic File System): A managed NFS-based file system for scalable shared storage across AWS services.
• In-Place Operations: Modifications directly within the existing EFS file system.
  • Enabling lifecycle policy
  • Changing throughput mode
  • Creating access points
• DataSync: AWS service dedicated to replicating data between storage locations, used for migrations requiring:
  • Encryption changes
  • • Performance mode changes (e.g., Max IO)

The differences:

• Throughput Modes (good for Big file)
  • Bursting: Throughput scales with the amount of data stored, providing a baseline level of performance along with bursts for higher usage periods. Suitable for a wide range of workloads.
  • Provisioned: You specify a fixed throughput level, ensuring consistent performance regardless of data volume. Best for workloads with predictable throughput needs.
• Performance Modes (good for a lot of files)
  • General Purpose: Optimized for latency-sensitive workloads requiring a balance of throughput and low latency. This is the most common and versatile mode.
  • Max I/O: Designed for highly parallel, throughput-intensive workloads that can tolerate higher latencies for individual operations. Ideal for big data analytics, machine learning, etc.

Example - Migrating to Encrypted EFS

1. Source: Unencrypted EFS file system.
2. Destination: Encrypted EFS file system.
3. Tool: AWS DataSync.
4. Steps:
   • Create DataSync task for EFS to EFS transfer.
   • Configure source and destination EFS locations.
   • Execute task (synchronizes data).
   • Update EC2 instances to mount new encrypted EFS.
   • Delete old unencrypted EFS.

Extras:

what is the use case of migration fo EFS via AWS DataSync?

Here's a breakdown of the primary use cases for migrating EFS file systems using AWS DataSync:

1. Encryption Changes:

• Transition to Encrypted EFS: If you have an existing unencrypted EFS file system and need to move your data to one with encryption enabled (either at-rest or in-transit), DataSync allows for seamless migration while preserving file metadata and permissions.
• Changing Encryption Keys: If you require a different encryption key for your EFS file system, DataSync facilitates this change.