This article has multiple issues. Please help improve it or discuss these issues on the talk page . (Learn how and when to remove these template messages)(Learn how and when to remove this template message)
Type of site
|Registration||Required (included in free tier layer)|
|Launched||March 14, 2006|
Amazon S3 or Amazon Simple Storage Service is a service offered by Amazon Web Services (AWS) that provides object storage through a web service interface.Amazon S3 uses the same scalable storage infrastructure that Amazon.com uses to run its global e-commerce network. Amazon S3 can be employed to store any type of object which allows for uses like storage for Internet applications, backup and recovery, disaster recovery, data archives, data lakes for analytics, and hybrid cloud storage. AWS launched Amazon S3 in the United States on March 14, 2006, then in Europe in November 2007.
Although Amazon Web Services (AWS) does not publicly provide the details of S3's technical design, Amazon S3 manages data with an object storage architecturewhich aims to provide scalability, high availability, and low latency with 99.999999999% durability and between 99.95% to 99.99% availability (though there is no service-level agreement for durability).
The basic storage units of Amazon S3 are objects which are organized into buckets. Each object is identified by a unique, user-assigned key.Buckets can be managed using either the console provided by Amazon S3, programmatically using the AWS SDK, or with the Amazon S3 REST application programming interface (API). Objects can be managed using the AWS SDK or with the Amazon S3 REST API and can be up to five terabytes in size with two kilobytes of metadata. Additionally, objects can be downloaded using the HTTP GET interface and the BitTorrent protocol.
Requests are authorized using an access control list associated with each object bucket and support versioning which is disabled by default.Note that since buckets are typically the size of an entire file system mount in other systems, this access control scheme is very coarse-grained, i.e. you cannot have unique access controls associated with individual files. Bucket names and keys are chosen so that objects are addressable using HTTP URLs:
http://s3.amazonaws.com/bucket/key(for a bucket created in the US East (N. Virginia) region)
http://s3.dualstack.region.amazonaws.com/bucket/key(for requests using IPv4 or IPv6)
http://bucket.s3.dualstack.region.amazonaws.com/key(for requests using IPv4 or IPv6)
http://bucket.s3-website-region.amazonaws.com/key(if static website hosting is enabled on the bucket)
http://bucket.s3-website.region.amazonaws.com/key(if static website hosting is enabled on the bucket)
http://bucket.s3-accelerated.amazonaws.com/key(where the filetransfer exits Amazons network at the last possible moment so as to give the fastest possible transfer speed and lowest latency)
http://bucket/key(where bucket is a DNS CNAME record pointing to bucket.s3.amazonaws.com)
Amazon S3 can be used to replace significant existing (static) web-hosting infrastructure with HTTP client accessible objects.The Amazon AWS authentication mechanism allows the bucket owner to create an authenticated URL which is valid for a specified amount of time.
Every item in a bucket can also be served as a BitTorrent feed. The Amazon S3 store can act as a seed host for a torrent and any BitTorrent client can retrieve the file. This can drastically reduce the bandwidth cost for the download of popular objects. While the use of BitTorrent does reduce bandwidth, AWS does not provide native bandwidth limiting and, as such, users have no access to automated cost control. This can lead to users on the free-tier of Amazon S3, or small hobby users, amassing dramatic bills. AWS representatives have stated that a bandwidth limiting feature was on the design table from 2006 to 2010,but in 2011 the feature is no longer in development.
A bucket can be configured to save HTTP log information to a sibling bucket; this can be used in data mining operations.
There are various User Mode File System (FUSE)-based file systems for Unix-like operating systems (Linux, etc.) that can be used to mount an S3 bucket as a file system such as S3QL. The semantics of the Amazon S3 file system are not that of a POSIX file system, so the file system may not behave entirely as expected.
Amazon S3 provides the option to host static HTML websites with index document support and error document support.Websites hosted on S3 may designate a default page to display and another page to display in the event of a partially invalid URL, such as a 404 error, which provide useful content to visitors of a URL containing a CNAME record hostname rather than a direct Amazon S3 bucket reference when the URL does not contain a valid S3 object key, such as when a casual user initially visits a URL that is a bare non-Amazon hostname.
Amazon S3 allows users to enable or disable logging. If enabled, the logs are stored in Amazon S3 buckets which can then be analyzed. These logs contain useful information such as:
Logs can be analyzed and managed using third-party tools like S3Stat, Cloudlytics, Qloudstat, AWStats, and Splunk.
Amazon S3 provides an API for developers.The AWS console provides tools for managing and uploading files but it is not capable of managing large buckets or editing files. Third-party websites like S3edit.com or software like Cloudberry Explorer, ForkLift and WebDrive have the capability to edit files on Amazon S3.
Amazon S3 offers four different storage classes that offer different levels of durability, availability, and performance requirements.
|Client Backup||Haystack Software LLC||Arq backup|
|Client Backup||CloudBerry Lab||CloudBerry Backup|
|Client Backup||Novosoft LLC||Handy Backup|
|MySQL Backup||Oracle||MySQL Enterprise Backup|
|Oracle Database Backup||Oracle||Oracle Secure Backup Cloud Manager|
|Server Backup||Atempo||Digital Archive (ADA)|
|Server Backup||Asigra||Asigra Cloud Backup|
|Cloud Storage||Wasabi||Wasabi Hot Storage|
|Cloud Storage Gateway||CTERA Networks||C00 Series|
|Cloud Storage Gateway||Avere||FXT Series|
|Cloud Storage Gateway||EMC||CloudArray|
|Cloud Storage Gateway||Microsoft||StorSimple|
|Cloud Storage Gateway||Nasuni||NF Series|
|Cloud Storage Gateway||NetApp||Altavault|
|Cloud Storage Gateway||Panzura||Global File System|
|Sync & Share||Storage Made Easy||SME|
|Hybrid Storage||Cloudian||Cloudian HyperStore|
|Hybrid Storage||SeaweedFS||Seaweed File System|
|Hybrid Storage||NooBaa||NooBaa Storage|
|Hybrid Storage||Western Digital||ActiveScale|
|Hybrid Storage||SwiftStack||SwiftStack 1space|
|On-Premises Storage||OpenIO||OpenIO SDS|
|On-Premises Storage||Pure Storage||FlashBlade|
|On-Premises Storage||Scality||RING Storage|
|Open Source||Zenko.io||Open Source S3 Server|
The broad adoption of Amazon S3 and related tooling has given rise to competing services based on the S3 API. These services use the standard programming interface; however, they are differentiated by their underlying technologies and supporting business models.A cloud storage standard (like electrical and networking standards) enables competing service providers to design their services and clients using different parts in different ways yet still communicate and provide the following benefits:
Examples of competing Amazon S3-compliant storage implementations:
Amazon Web Services introduced AmazonS3 in 2006.
Amazon S3 is reported to store more than 2 trillion objects as of April 2013 [update] . This is up from 10 billion objects as of October 2007, 14 billion objects in January 2008, 29 billion objects in October 2008, 52 billion objects in March 2009, 64 billion objects in August 2009, and 102 billion objects in March 2010. . In November 2017 AWS added default encryption capabilities at bucket level.
NetApp, Inc. is an American hybrid cloud data services and data management company headquartered in Sunnyvale, California. It has ranked in the Fortune 500 since 2012. Founded in 1992 with an IPO in 1995, NetApp offers hybrid cloud data services for management of applications and data across cloud and on-premises environments.
Amazon Web Services (AWS) is a subsidiary of Amazon that provides on-demand cloud computing platforms and APIs to individuals, companies, and governments, on a metered pay-as-you-go basis. In aggregate, these cloud computing web services provide a set of primitive abstract technical infrastructure and distributed computing building blocks and tools. One of these services is Amazon Elastic Compute Cloud (EC2), which allows users to have at their disposal a virtual cluster of computers, available all the time, through the Internet. AWS's version of virtual computers emulate most of the attributes of a real computer, including hardware central processing units (CPUs) and graphics processing units (GPUs) for processing; local/RAM memory; hard-disk/SSD storage; a choice of operating systems; networking; and pre-loaded application software such as web servers, databases, and customer relationship management (CRM).
Cloud storage is a model of computer data storage in which the digital data is stored in logical pools. The physical storage spans multiple servers, and the physical environment is typically owned and managed by a hosting company. These cloud storage providers are responsible for keeping the data available and accessible, and the physical environment protected and running. People and organizations buy or lease storage capacity from the providers to store user, organization, or application data.
Amazon Elastic Compute Cloud (EC2) is a part of Amazon.com's cloud-computing platform, Amazon Web Services (AWS), that allows users to rent virtual computers on which to run their own computer applications. EC2 encourages scalable deployment of applications by providing a web service through which a user can boot an Amazon Machine Image (AMI) to configure a virtual machine, which Amazon calls an "instance", containing any software desired. A user can create, launch, and terminate server-instances as needed, paying by the second for active servers – hence the term "elastic". EC2 provides users with control over the geographical location of instances that allows for latency optimization and high levels of redundancy.
The Rackspace Cloud is a set of cloud computing products and services billed on a utility computing basis from the US-based company Rackspace. Offerings include Cloud Storage, virtual private server, load balancers, databases, backup, and monitoring.
This is a comparison of online backup services.
IBM Cloud Object Storage is a service offered by IBM for storing and accessing unstructured data. The object storage service can be deployed on-premise, as part of IBM Cloud Platform offerings, or in hybrid form. The offering can store any type of object which allows for uses like data archiving and backup, web and mobile applications, and as scalable, persistent storage for analytics. Interaction with Cloud Object Storage is based on Rest APIs.
AppScale is a software company offering cloud infrastructure software and services to enterprises, government agencies, contractors and 3rd party service providers. The company commercially supports one software product, AppScale ATS, a managed hybrid cloud infrastructure software that emulates the core AWS APIs. In 2019, the company ended commercial support for its’ open-source serverless computing platform AppScale GTS, however its’ source code remains freely available to the open-source community.
Google Cloud Storage is a RESTful online file storage web service for storing and accessing data on Google Cloud Platform infrastructure. The service combines the performance and scalability of Google's cloud with advanced security and sharing capabilities. It is an Infrastructure as a Service (IaaS), comparable to Amazon S3 online storage service. Contrary to Google Drive and according to different service specifications, Google Cloud Storage appears to be more suitable for enterprises.
A cloud storage gateway is a network appliance or server which resides at the customer premises and translates cloud storage APIs such as SOAP or REST to block-based storage protocols such as iSCSI or Fibre Channel or file-based interfaces such as NFS or SMB.
Amazon Relational Database Service is a distributed relational database service by Amazon Web Services (AWS). It is a web service running "in the cloud" designed to simplify the setup, operation, and scaling of a relational database for use in applications. Administration processes like patching the database software, backing up databases and enabling point-in-time recovery are managed automatically. Scaling storage and compute resources can be performed by a single API call as AWS does not offer an ssh connection to RDS instances.
Zmanda Cloud Backup (ZCB) is an online backup software by open source backup company Zmanda which enables users to back up their data to cloud storage. The software uses the Amazon S3 service from Amazon Web Services or Google Cloud Storage as the cloud storage service but also supports private cloud solutions such as OpenStack Swift or Walrus by Eucalyptus via the open source ZCloud API. As of March 2011, the software runs only on Windows platforms. For non-Windows platforms the company offers the open source Advanced Maryland Automatic Network Disk Archiver with Amazon S3 as the storage location.Zmanda was acquired by BETSOL on Feb 27, 2018.
A cloud database is a database that typically runs on a cloud computing platform, and access to the database is provided as-a-service.
Amazon Glacier is an online file storage web service that provides storage for data archiving and backup.
Object storage is a computer data storage architecture that manages data as objects, as opposed to other storage architectures like file systems which manages data as a file hierarchy, and block storage which manages data as blocks within sectors and tracks. Each object typically includes the data itself, a variable amount of metadata, and a globally unique identifier. Object storage can be implemented at multiple levels, including the device level, the system level, and the interface level. In each case, object storage seeks to enable capabilities not addressed by other storage architectures, like interfaces that can be directly programmable by the application, a namespace that can span multiple instances of physical hardware, and data-management functions like data replication and data distribution at object-level granularity.
Cloudian, Inc. is a US enterprise data storage company headquartered in San Mateo, California, with offices in Europe and Asia. It produces Amazon S3-compatible object storage software, scale-out file services software, and pre-configured hardware appliances.
AWS Lambda is an event-driven, serverless computing platform provided by Amazon as a part of Amazon Web Services. It is a computing service that runs code in response to events and automatically manages the computing resources required by that code. It was introduced in November 2014.
Block-level storage is a concept in cloud-hosted data persistence where cloud services emulate the behaviour of a traditional block device, such as a physical hard drive. It is a form of network-attached storage (NAS).
This is a timeline of Amazon Web Services, which offers a suite of cloud computing services that make up an on-demand computing platform.
Amazon Neptune is a managed graph database product by Amazon.com. It is used as a web service and is part of Amazon Web Services. It was announced on November 29, 2017. Amazon Neptune supports popular graph models property graph and W3C's RDF, and their respective query languages Apache TinkerPop Gremlin and SPARQL, including other Amazon Web Services products.