Applications typically use Object storage for their massive unstructured data. AWS S3 (Simple Storage Service) is a prime example of object storage. Each data is kept as an object which means the file and its metadata are kept together as an object. It doesn’t provide a directory tree like a file storage but allows you to retrieve objects based on their keys.
Main characteristics of object storage:
- Data is kept as objects.
- It’s infinitely scalable.
- Data is kept together with its metadata.
- Data is identified with a unique identifier, not a path.
- S3 in AWS is an example service.
For example, object storage can be used to store images for a social media app. You can store thousands of pictures as independent objects in the cloud, which the app can then retrieve using unique keys.
File Storage
File storage organizes and represents data as a hierarchy of files in folders, just like the file system in our computers. Amazon Elastic File System (EFS) is an example service of the file storage type. It offers a traditional file storage structure with a directory, sub-directories, and files, making it easy for applications to read and write data.
Main characteristics of file storage:
- Data is kept as a file hierarchy.
- It’s scalable but not as much as object storage.
- Data is accessed through a path, not a unique identifier.
- EFS in AWS is an example service.
File storage can be used for content management, web serving, and many other enterprise applications where a standard filesystem structure is required.
Block Storage
Block storage splits the data into blocks and then stores those blocks as separate pieces of data. Each block of data is stored with a unique address but with no additional information (metadata). Amazon Elastic Block Store (EBS) is an example of block storage.
Primary characteristics of block storage:
- Data is split into equally sized ‘blocks’.
- Each block is saved individually.
- Delivers high performance.
- EBS in AWS is an example service.
Block storage comes in handy when you need more control and versatility, such as when running a database or an application that requires the file system to manage its data.
To summarize, the right data storage depends on the use case and specific requirements. File storage is great for applications that need a hierarchical, folder-like storage system. Object storage could be best for storing large amounts of unstructured data, like audio and video files. Block storage could be the best choice for apps and databases that require fine-tuned control.
As an AWS Certified Solutions Architect – Associate, being able to identify the best storage solution for a specific use case is an essential aspect of designing secure, efficient, and cost-effective cloud environments.
Practice Test
True or False: Object storage is a scalable solution that does not support metadata.
- True
- False
Answer: False
Explanation: Object storage supports metadata, allowing users to assign and manage attributes for items.
Which of the following are characteristics of block storage?
- A. Tightly coupled with the operating system
- B. Distributed data storage
- C. Easily scalable
- D. Fine-grained control over data
Answer: A, D
Explanation: Block storage is closely linked to an operating system, providing low-level control of the data. However, it’s not designed for easy scaling or distributed data storage.
True or False: File storage is a structured data storage that uses a hierarchical structure.
- True
- False
Answer: True
Explanation: File storage uses directories and folders in a hierarchical approach to structure and organize data.
Which storage type is best suited to storing static content for web applications?
- A. Block Storage
- B. File Storage
- C. Object Storage
- D. All of the above
Answer: C. Object Storage
Explanation: Object storage is ideal for storing static web content as it can scale and distribute data across regions and devices.
What storage type is most suitable for database systems?
- A. Block Storage
- B. File Storage
- C. Object Storage
- D. All of the Above
Answer: A. Block Storage
Explanation: Block Storage provides fine-grained and low-level control over data, making it suitable for database systems.
In what type of storage does each block of data act as an individual hard drive?
- A. Object Storage
- B. File Storage
- C. Block Storage
- D. Hybrid Storage
Answer: C. Block Storage
Explanation: Block Storage treats each block as independent storage, like an individual hard drive.
What are the typical use cases of File Storage?
- A. Data Warehouses
- B. Content Management
- C. Websites
- D. AI & Machine Learning
Answer: B. Content Management
Explanation: File storage is structured and hierarchical in nature, typically used in systems where organized data access is necessary, like Content Management Systems.
Is it true that block storage has multi-user capabilities?
- A. True
- B. False
Answer: B. False
Explanation: Block storage is a single-user storage system, providing only one user at a time access to its data.
Which of the following characteristics describes object storage?
- A. Inexpensive and easily scalable
- B. Less durable and more complex
- C. High performance and low latency
- D. High performance but is not designed to be easily scalable
Answer: A. Inexpensive and easily scalable
Explanation: Object storage is designed to be a cost-effective, highly scalable and durable digital data storage service.
Which of the following storage types is better suited for big data and analytics workflows?
- A. Block Storage
- B. File Storage
- C. Object Storage
- D. Hybrid Storage
Answer: C. Object Storage
Explanation: Object storage enables horizontal scaling and is ideal for tasks like big data analytics which require such scalability.
Interview Questions
What is object storage in AWS and what is its main use case?
Object storage in AWS is delivered through Amazon S3, which stores data as objects within resources called buckets. It’s mainly used for storing unstructured data such as photos, videos, log files, backups and container images due to its unlimited scalability.
What service in AWS provides file level storage?
Amazon EFS (Elastic File System) provides file level storage in AWS. It’s designed to provide scalable, elastic, concurrent with some AWS services, and encrypted file storage for use with both AWS Cloud services and on-premises resources.
What is the main characteristic of block storage in AWS?
Block storage in AWS is provide through Amazon EBS (Elastic Block Store). The main characteristic of block storage is that it offers low latency and high throughput for workloads that require smooth and consistent operations, such as booting operating systems or running transactional databases.
What are the durability characteristics of S3 object storage?
Amazon S3 is designed for durability of 99.999999999% of objects. It achieves this by automatically creating and storing copies of all S3 objects across multiple systems.
What are the main differences between file and block storage?
File storage organizes and represents data as a hierarchy of files in folders whereas block storage involves storing data in raw storage volumes called blocks, which can be treated as individual hard drives. The main difference between the two lies in their organization and accessibility.
What type of storage does Amazon RDS use in AWS and why?
Amazon RDS uses block storage types because they are better suited for Database storage and operations as it allows for higher performance and low-latency operations that are often required by databases.
In what formats can objects be stored in AWS S3?
Objects can be stored in any format in AWS S3. This includes common formats like text files, photos, and videos to less common formats like proprietary application or database backups.
Which AWS service would you use to deploy a data warehouse in the cloud?
Amazon Redshift is the best service for deploying a data warehouse as it’s based on columnar storage which allows data to be read and aggregated quickly, boosting performance for data warehousing and analytics.
What are the consistency characteristics of S3 Object Storage?
S3 provides strong read-after-write consistency for PUTS of new objects and eventual consistency for overwrite PUTS and DELETES.
Which storage service in AWS would fit the requirement of providing shared file storage for Lambda function?
Amazon EFS (Elastic File System) would fulfill this requirement as it provides a common data source for AWS Lambda functions to process and analyze.
Which AWS service would you not use for long term data archiving and backup?
Amazon EBS is not the best service for long term data archiving and backup since it’s designed for temporary block storage for EC2 instances. Instead, Amazon S3 Glacier or S3 Deep Archive would be better for long term data archiving and low cost backup.
How does Amazon S3 deliver high durability for object storage?
Amazon S3 delivers high durability by automatically distributing data across at least three physical facilities that are geographically separated within an Amazon S3 Region.
What type of storage is Amazon EBS?
Amazon EBS is a high performance block storage service designed for use with Amazon EC2 instances for both throughput and transaction intensive workloads at any scale.
How is data organised in Amazon EFS (Elastic File System)?
Amazon EFS organizes data in a traditional hierarchical directory tree, maintaining this structure regardless of the volume of storage used.
What are the access approaches to Amazon S3 Bucket?
Amazon S3 Buckets can be accessed through the AWS Management Console, AWS Command Line Interface, AWS SDKs, and REST API.