What is the S3 protocol that we are talking about every day? This article takes you to understand the story behind S3

With the continuous development of the information age , Data is growing faster than ever , Most of the data is unstructured ： video 、 E-mail 、 file 、 The data backup 、 Monitoring flow 、 Genomics, etc .

The data size is no longer what it used to be kb、mb, Is more of a gb、tb, even to the extent that pb Level , Object storage comes into being , Object storage systems are designed for  PB  Level data .

What is object storage ？

Object storage , Also known as object-based storage , Is a method of addressing and manipulating data storage into discrete units , Objects are stored in a single repository , And will not be nested as a file in a folder in another folder .

Object storage was developed in  1990  The mid - , Mainly to solve the scalability problem , The traditional file and block storage developed in the early stage does not have the ability to handle the large amount of data generated today （ Data that is usually unstructured and difficult to organize ） The ability of , Because file and block storage use hierarchies , So as data storage grows from gigabytes and terabytes to  PB  Even more , Data access will slow down .

Object storage can be expanded quickly and easily as needed , Even in the face of great  PB  and  EB  So is the load , No matter how many objects are stored , They are all placed in a single namespace , It can be distributed in various hardware and geographical locations , And the system can continue to access any object in this growing pool , Without any impact on performance .

In object storage , The well-known agreement is S3 agreement , Now let's introduce it in detail S3.

What is? S3？

• English full name ：
  Amazon Simple Storage Service

• Chinese meaning ： Amazon Simple Storage Services

We can see that S3 yes Amazon Products of the company , Amazon Web Services  (AWS)  Has become the leading service in public cloud computing ,Amazon  stay  2006  First available in S3, Now , The system stores billions of objects , The size of a single object can range from a few kilobytes to  5TB, And the objects are arranged to be called “ bucket ” Set .

S3 agreement

these years ,Amazon S3  The interface has developed into a very powerful data management interface , Different from the traditional file system interface , It provides application developers with a way to  API  The method of setting control data .

These methods slowly developed into S3 agreement , Many cloud storage vendors at home and abroad are based on S3 agreement , And all of them support universal S3 Interface , For example, the famous Alibaba cloud in China oss、 Tencent cloud's cos、 Huawei cloud obs wait .

S3 API

S3 API  Is an application programming interface , Provide in  S3  Storage in 、 retrieval 、 The ability to list and delete objects .

There are other functions , such as ： Metadata 、 multi-tenancy 、 Security and policy 、 Life cycle management 、 Atomic updates 、 Search for 、 logging 、 notice 、 Copy 、 encryption 、 Billing, etc .

It can be said that Alibaba cloud in China 、 Tencent cloud 、 The cloud storage of Huawei cloud and other manufacturers has been compared with the standard S3 Function alignment , Basically, there should be .

S3 SDK

S3 SDK Currently supported ：

So for most companies , It is very convenient for developers to call .

summary

S3 The birth of is no accident , It is the result of the explosive growth of data and the continuous advancement of technology , Amazon is used abroad 、 Gu Geyun and others support S3 There are many agreements , Alibaba cloud is used domestically 、 Tencent cloud 、 There are many Huawei clouds .