Explore cloud native databases and take a broad view of future technological development

Give a small welfare to fans at the beginning ： White whoring hundreds of cloud services

Amazon cloud technology provides 100 Free packages for more than products . among , Computing resources Amazon EC2 First year 12 It's free for three months ,750 Hours / month ; Storage resources Amazon S3 First year 12 It's free for three months ,5GB Standard storage capacity ; Database resources Amazon RDS First year 12 It's free for three months ,750 Hours ;Amazon Dynamo DB 25GB storage capacity Free forever .

Click here to get to

Don't talk much , Welfare knows everything , Take what you need , Start to get to the point ~

One ： The indissoluble relationship between cloud native and database

The concept of cloud

In the eyes of most of us , cloud , That is, the water vapor in the atmosphere is liquefied into small water drops or small ice crystals when it is cooled , A mixture of visible polymers floating in the air . That's it , I used to think so .

  Until I learned and used the virtual machine when I grew up , Cloud computer , Cloud drive , cloud ... Before gradually changing their values , There is no doubt about cloud computing , Has become a IT A synonym for industry , Basically, the current industry situation is Everything can be on the cloud .

With the further development of "everything can be cloud" , The concept of cloud primordial became popular , Database manufacturers are also gradually starting to put computers on the cloud .

DB Database everyone must have heard about oneortwo or some people who are engaged in this industry .

The concept of databases

Databases are used to access data , The data here includes a lot of pictures 、 String, etc. . The storage space of the database is very large , It can store millions of them 、 Tens of millions or even hundreds of millions of data , Users can add data in the database 、 Inquire about 、 to update 、 Delete and other operations .

  everyone Common databases are mysql、oracle、sqlserver、sqlite wait ,

Database free trial link and tutorial click directly >： Database free trial links and tutorials

That is, since we all know the database , What exactly is a cloud native database ？

1. First, what is cloud primordial ？

Have to say , Until today, , There is still no exact and unified definition of cloud primitiveness . After a large number of searches, we found that the world's well-known non-profit organizations CNCF (Cloud Native Computing Foundation) The official definition of cloud native Computing Foundation is as follows ：

Cloud native Computing Foundation CNCF For the definition of yunhara ：

Cloud native technology enables organizations to work in public 、 Build and run scalable applications in modern dynamic environments such as private and hybrid clouds . Containers 、 Service Grid 、 Microservices 、 Immutable infrastructure and declarative API It's an example of this approach .

These technical supports are flexible 、 Manageable and observable loosely coupled systems . Combined with powerful Automation , They enable engineers to make high impact changes frequently and predictably with minimal effort .

I just saw if there was some confusion ？ So am I , Officials use a lot of technical terms to describe , It makes people seem to understand , Seems to know , I don't seem to know , Anyway, I don't know what it is used for .

2. Read cloud primitives literally ：

• After I read the relevant documents , Try to read it literally ：

• In cloud primordial “ cloud ” Indicates that it exists in the cloud , Instead of traditional deployment locally .

• For example, the files in the so and so cloud disk are in the cloud , Instead of storing it on the hard disk of the user's computer .

• “ Native ” It means that the application should consider the factors in the cloud environment from the design stage , So design for the cloud , Running on the cloud .

• That is to say, cloud primordial is Born on the cloud , Grow on the cloud , It also applies to the cloud

• 

• It can also be said to be localized output , like mode in China, As long as we produce things in China , Will be printed mode in China The said , Cloud primordial is like this , On the cloud , Apply on cloud .

• Learned about cloud primitives , So you must know the general meaning of cloud native database here ~

• Next, let's take a look at the fire of cloud native databases ？

Click the cloud native database online conference directly to >： Cloud native database online conference

Two ： Inventory the past and present lives of cloud native databases

a. The meaning of cloud native database ：

Cloud technology includes virtualization technology , Dynamic scalability , According to the need to use , Elastic use , Dynamic scheduling , Automatic scaling and other advantages . The cloud native database fully absorbs the advantages of cloud technology , Cloud native database combines the advantages of traditional database and cloud computing technology , Overcome the limited storage capacity of traditional databases 、 Difficulty in expansion 、 The delay between master and slave is high .

b. The development of cloud native database ：

Because the cloud native database completely exists in the cloud , So it can be accessed from multiple front ends anytime, anywhere , Computing nodes that provide cloud services . Because the cluster is deployed on the cloud , Therefore, the impact of single point of failure on the service is particularly small . And when you need to upgrade or replace Services , The node can be gradually upgraded without interruption of service . It can help individuals and their enterprises engaged in the technology industry greatly reduce IT cost , Improve and create higher efficiency .

c. The cost and efficiency of database force the birth of the separation of storage and calculation ：

With the continuous development of technology, cloud native database , With the deepening of the construction of big data system , The data infrastructure faces two problems ：

• One is the cost , As the amount of accumulated data increases , The increase of big data business , The cost of data storage and processing is getting higher and higher , The investment in data infrastructure becomes larger .

• The other is efficiency , There are many big data processing components , Different components use different data processing formats , Diverse data formats make data storage complex , Deal with different scenarios in the system , Often the same data needs to be stored in multiple copies , A lot of data copying and format conversion are also required between different components , Consume a lot of resources ..

How to solve these two problems ？ At this time, someone put forward Deposit is separate Try to solve these two problems ！

good , Some people will ask ： What is the separation of deposit and settlement ？

3、 ... and ： Separation of storage and computing of cloud native databases ：

1. On the division of the separation of deposit and settlement ：

In fact, the boundary between storage and computation is not clear , Calculation and storage are actually inseparable in the process of calculation , However, with the improvement of network bandwidth and performance , Provides a basis for discussion with a degree of separation . Calculation ” This is what the calculation process requires CPU Memory and so on. ,“ Storage ” It's something that needs persistence

2. Why separate computing from storage ？

• Whether the calculation reaches the bottleneck first , Or the storage reaches the bottleneck first , Although the two situations are different , The time point is also inconsistent . But usually, no matter what the situation is, the machine is added , So there will be a lot of waste .

• It's not easy to expand ： Computing and storage coupling mode , Storage expansion typically migrates large amounts of data , inconvenient .

3. The benefits of separation of deposit and settlement ：

   By separating storage resources 、 Computing resources , Storage can be planned independently 、 Computing resource specifications and capacity . So the expansion of computing resources 、 Shrinkage capacity 、 Release , Can be completed relatively quickly , And there's no extra cost of data relocation . Storage 、 Computing can also better combine their own characteristics , Choose a more suitable resource specification and Design .

Four ： Separation of storage and computing of cloud native databases ：

I have learned what is the separation of deposit and settlement , Similarly, , That is to say 2003 About years ago , from Google Release GFS and MapReduce This paper opens the prelude of big data processing technology for nodes , This paper introduces a method of using common PC Servers build large-scale distributed systems , To solve the problem of massive data storage and calculation .

thereafter ,Apache Distributed software developed by the foundation Hadoop Open source system , It has gradually become a general technical framework for processing big data —— This is a memory computing coupled architecture , Its essential starting point is under the condition of insufficient network bandwidth , Reduce data movement as much as possible . For the first time, this technical framework makes use of the computing and storage capacity of the cluster , Reliable analysis of large amounts of data 、 Efficient 、 Scalable distributed high-speed computing , Widely adopted by enterprises , Become one of the hottest technologies , It is even regarded as a cutting-edge technical standard .

This kind of storage and computing separation architecture standard is now widely used for development and innovation , Promote the continuous progress of science and technology in the future .

5、 ... and ： The intuitive feeling of personal application ：

When an individual works in the company , We all use mysql And other local databases , But after the development of technology and comparison in many aspects, it is found that , The storage capacity of traditional databases is limited 、 Difficulty in expansion 、 The delay between master and slave is high . So , The company asked us to find a cloud database with a separate storage and computing architecture , After many considerations and discussions , Similarly, , We found Amazon's Aurora database ！

6、 ... and ： Amazon launched the "separation of deposit and settlement" Aurora！ A milestone !

  Amazon launched Aurora！ Its milestone appearance laid the foundation for the development of the separation of storage and calculation !

Amazon Aurora The advent of ：

 Aurora On 2014 year 11 month 12 Announced at the Amazon Invention Conference in Las Vegas . It's on 2015 year 7 month 27 Official release , And as a service in AWS Use in , And added to Amazon's relational database service .

Amazon Aurora Characteristics of ：

 1.Aurora Of The compute node and the storage node are separated , They are in different places VPC（Virtual Private Cloud） in . This is a Aurora The highlight of the architecture .

2. And MySQL and PostgreSQL compatible ,Aurora Is a kind of compatibility built specifically for the cloud MySQL and PostgreSQL The relational database , It has both the number of traditional enterprises

Library performance and availability , It also has the simplicity and cost-effectiveness of open source databases .

3. High performance ,Aurora The speed can reach the standard MySQL Five times the database 、 standard PostgreSQL Three times the database .Amazon Aurora from Amazon Relational Database Service (RDS) Full custody ,Amazon RDS It can automatically perform various time-consuming management tasks , For example, hardware provisioning 、 Database settings 、 Patching and backup .

4. Extensibility ,Amazon Aurora It also adopts distributed 、 A storage system that has fault tolerance and can repair itself , This system can extend each database instance up to 128TB. It enables high performance and high availability , Support up to 15 Low latency read copies 、 Time to recover 、 Continuous backup to Amazon S3, And span three zones (AZ) Copy .

5. Highly secure ,Amazon Aurora You can provide multiple levels of security for your database . These include ： Use Amazon VPC Network isolation , Use you through AWS Key Management Service (KMS) The key created and controlled performs static encryption , And the use of SSL Encrypt dynamic data . In encrypted Amazon Aurora For instance , The data in the underlying storage is encrypted , Automatic backup in the same cluster 、 Snapshots and copies are also encrypted .

Amazon Aurora Application ：

since 2014 Since its launch in , Tens of thousands of Amazon cloud technology customers have chosen to use Amazon Aurora Handling mission critical workloads , For any enterprise application that can use a relational database ,Amazon Aurora All good choices . Compared with other commercial databases ,Amazon Aurora It can help improve the reliability and availability of the database .Amazon Aurora It is a fully managed service , Can help you deal with time-consuming tasks , For example, deployment 、 repair 、 Backup 、 recovery 、 Fault detection and repair , This saves a lot of time .

SaaS Applications typically use a multi tenant architecture , This requires great flexibility in instance and storage scaling 、 High performance and reliability .Amazon Aurora All of these features are available in managed database products , help SaaS The company focuses on building high-quality applications , Don't worry about the underlying database that supports your application .

Network and mobile games built for large-scale operation need a network with high throughput 、 Huge storage scalability and high availability database .Amazon Aurora Meet such demanding application requirements , It can provide enough space for future growth . because Amazon Aurora No license restrictions , Therefore, it fully conforms to the various usage patterns of these applications .

Handover capacity management , Only the capacity consumed by instantaneous and fine expansion is paid , So as to save up to 90% Cost of .

Amazon Aurora The development of ：

stay AWS Its official website , The statement “ compatible PostgreSQL Of Amazon Aurora” as follows ：

AmazonRelational Database Service (Amazon RDS) Providing Aurora(PostgreSQL) preview , It's compatible PostgreSQL Of Amazon Aurora.Aurora It's a fully managed 、 compatible PostgreSQL and MySQL The relational database engine of .

Literally speaking ,Aurora No more MySQL, It is MySQL+PostgreSQL, So the future will be “MySQL+PostgreSQL+...+...”, Various databases will be integrated into Aurora among . This provides powerful cloud database services , This is very important , Users do not need to modify the application code based on any database , Seamless access Aurora.

In the future, all databases can be integrated into Amazon Aurora,

 Amazon Aurora And MySQL A comparative experiment of ：

  After our company's use and testing, it is concluded that ：

1. In terms of compatibility ： Fully compatible with , Connect ⽅ Fadhen ⾄ Configuration parameters are ⼀ Cause .

2. In terms of reading and writing performance ：Aurora yes Mysql Of 8 About times .

3. Deploy ⽅ In terms of formula ：Aurora and Mysql⽀ Single region and multi region deployment .

4. storage ：Aurora There is no need to specify the storage size and IOPS, According to the actual amount of data, each 10GB Automatic extension , The maximum storage capacity can reach 64TB. This saves disk capacity or IO When it's not enough , The impact of capacity expansion .

Aurora Only support Innodb Storage engine . If you need to use MyISAM, Then it is still suitable for use RDS Mysql.

5. extensibility ：Aurora Most support 15 A read-only copy , comparison Mysql 5 Copies have been greatly improved .Aurora The read-only copies of are reader endpoint, Be able to load balance read-only requests . For applications , Just specify read-only endpoint, There is no need to consider the traffic balancing and failover of read-only replicas . and Mysql Load balancing for read-only replicas is not yet available , Between the application and the database , Add middleware , Or add logic to the application , Try to distribute the requests equally among the read-only copies of the database . otherwise , once Mysql Read only copy failed , Domain name or IP Will change , The application side also needs to be adjusted .

Aurora And support Autoscaling Automatic extension , according to CPU Usage or number of connections , When a specified threshold is exceeded , Automatically add read-only copies , To meet the needs of business changes .

6. In terms of reliability ：Aurora Automatically copy data to when writing 3 individual AZ Of 6 Copies , Continuously back up logs and data to more reliable S3, Data will not be lost . Automatic fault recovery , When the primary node fails , Automatically promote the read-only replica to the primary node , High availability of database .

Aurora There are also functions such as rapid recovery , Even when the database needs to be restored , It can also start the database faster .

The backtracking function can recover to a previous point in time in a short time , There is no need to restore the new database , This requires changing the application to point to the new database .

Aurora and Mysql Both support cross region replication .Aurora Also launched Global Database function , Data replication at the physical level , Relative to Mysql binlog Sync , More efficient , The cross region master-slave delay can reach 1 Within seconds .

7. Cost ：Aurora and Mysql The cost includes traffic and backup , These prices are similar .

At present, it is only tested from these aspects . In general Amazon Aurora Cloud native databases are better ~

Amazon Aurora Cloud native database , It is promoting the development of future science and technology step by step ！

See here , Go to the fan welfare at the end of the article to experience Amazon Aurora？ In addition, you will get free ECS for one year ~

7、 ... and ： Fan welfare at the end of the article

Amazon cloud technology has created a variety of learning platforms for developers ：

1. Getting started Resource Center ： from 0 To 1 Easy to get started with cloud services , Content covered ： Cost management , Start training , Development resources .

Click on direct benefits

2. Architecture Center ： Amazon cloud Technology Architecture Center provides cloud platform reference architecture chart 、 Reviewed architectural solutions 、Well-Architected Best practices 、 Pattern 、 Icon, etc . Click on direct benefits

3. Builder Library ： Learn how Amazon cloud builds and operates software . Click on direct benefits

4. Toolkit for developing and managing applications on Amazon cloud technology platform ： Click on direct benefits

【 Exclusive benefits for fans 】

Fukuichi ：100 Free packages for more than products . among , Computing resources Amazon EC2 First year 12 It's free for three months ,750 Hours / month ; Storage resources Amazon S3 First year 12 It's free for three months ,5GB Standard storage capacity .

Click on direct benefits

Welfare II ： The latest discount gift bag ,200$ Data and analysis deduction voucher ,200$ Machine learning voucher ,200$ Micro service and application development deduction voucher . Click on direct benefits

Welfare three ： Solution CloudFormation One click deployment template library

Click on direct benefits