Directory and Table Buckets
- These are two new types of buckets added.
- Directory Buckets: They use file paths rather than prefixes, This is useful for data lakes
- Table Buckets: This is based on Apache Iceberg to store the data in tabular formats for quick retireval
- They are used for storing semistructure data in large volume Data Pipelines.
Cross region Replications
- When the data is added to one bucket either all content or some selected content based on prefixes can be synced to other buckets in other regions
- Navigate to Management -> Replication Rules
Storage in Azure
-
Azure Storage Account is a service offered by Azure which handles
- blob storage
- Table Storage
- File Shares
- Queue Storage
-
In Azure Blob Storage has 3 types
- Page Blob: Hard disks
- Block Blob: blobs (like s3 objects)
- Append Blod: for log files
-
Azure Global Infra:
- Azure has two types of regions
- regions
- regions with zones
- Azure has two types of regions
- Azure Storage Accounts
- Storage Account types
- Azure Storage Redundancy
- Durability And Availability
- Access Tiers
