Disk and Network Storages
- Activities:
- Creating the disks and attaching the disks to vms (vm disks)
- Creating the network disks and attaching the disks to vms
- Third party disk
- File systems
- Performance and sizing
- Increasing disk sizes and making it usable in Virtual machines
- Backups and backup retentions
- Replicating or recreating disks in other regions
- Disk Encryptions
Creating Disks and Attaching them to EC2 instances in AWS
- Create an ec2 instance with ubuntu with only root disk
- In AWS, the disk and ec2 instance should belong to the same zone,
- Lets create a disk of size 1 GB in same zone as ec2
- Now Attach the disk the ec2 instance
-
To effective deal with mounting, go through following linux topics
- lsblk
- mkfs
- mount
- fstab
- disk partitions
- extending partition
Diffferent Volume Types
- General purpose 2
- General Puprose 3
- Provisioned IOPS io1
- Provisioned IOPS io2
- Cold HDD
- Throughput optimized HDD
- Magnetic
Here is a comparison of the various AWS EBS volume types with respect to IOPS, Throughput, Minimum Size, and Maximum Size:
| Volume Type | IOPS | Throughput | Min Size | Max Size |
|---|---|---|---|---|
| General Purpose SSD (gp2) | 100 to 16,000 IOPS (3 IOPS per GiB, burst up to 3,000 IOPS for smaller volumes) | Up to 250 MiB/s (burst) | 1 GiB | 16 TiB |
| General Purpose SSD (gp3) | Baseline of 3,000 IOPS, provisionable up to 16,000 IOPS | Baseline of 125 MiB/s, provisionable up to 1,000 MiB/s | 1 GiB | 16 TiB |
| Provisioned IOPS SSD (io1) | Up to 256,000 IOPS depending on instance type and size | Up to 4,000 MiB/s depending on configuration | 4 GiB | 16 TiB |
| Provisioned IOPS SSD (io2) | Up to 256,000 IOPS depending on instance type and size | Up to 4,000 MiB/s depending on configuration | 4 GiB | 16 TiB |
| Throughput Optimized HDD (st1) | Baseline: 40 MiB/s per TiB; Burst: up to 500 MiB/s | Burst throughput: up to 500 MiB/s; baseline scales with volume size | 125 GiB | 16 TiB |
| Cold HDD (sc1) | Baseline: lower than st1; Burst: up to 250 MiB/s | Burst throughput: up to 250 MiB/s; baseline scales with volume size | 125 GiB | 16 TiB |
| Magnetic (Standard) | Very low and inconsistent performance | Limited throughput; not recommended for new workloads | N/A | Up to 3 TiB |
Key Observations:
- SSD-backed volumes (gp2, gp3, io1, io2) are optimized for high IOPS and consistent performance. They are ideal for transactional workloads.
- HDD-backed volumes (st1, sc1) are optimized for throughput-intensive workloads. They perform best with large sequential I/O operations.
- Magnetic disks are legacy storage options and are not recommended for new workloads due to their limited performance capabilities.
