Cloud native database is in full swing, and the future can be expected

Amazon cloud technology provides 100 Free packages for more than products . among , Computing resources Amazon EC2 First year 12 It's free for three months ,750 Hours / month ; Storage resources Amazon S3 First year 12 It's free for three months ,5GB Standard storage capacity ; Database resources Amazon RDS First year 12 It's free for three months ,750 Hours ;Amazon Dynamo DB 25GB storage capacity Free forever .
【 Dot link 】
https://aws.amazon.com/cn/free/?nc2=h_ql_pr_ft&all-free-tier.sort-by=item.additionalFields.SortRank&all-free-tier.sort-order=asc&awsf.Free%20Tier%20Types=*all&awsf.Free%20Tier%20Categories=*all&trk=e0213267-9c8c-4534-bf9b-ecb1c06e4ac6&sc_channel=el

One 、 Interpretation of cloud native database

1.1 What is Yunyuan

A container based microservice application , The idea of deploying on an elastic cloud infrastructure through continuous delivery .
Experts and scholars in the field of cloud computing and security generally agree , Cloud native is more secure 、 Pratt & Whitney's emerging model .
actually , Cloud native is a best path or best practice . More on that , Cloud native specifies a low mental burden for users 、 Agile 、 Be able to extend 、 Replicable ways to maximize the power of the cloud 、 The best way to play the value of the cloud .

Cloud primitives are a set of architectures born for the cloud , In the previous era of virtual machines , Did not maximize the value of the cloud , The primary cloud did it .
First, from the perspective of technical characteristics , Yunyuansheng has the ultimate flexibility 、 Service autonomy 、 Fault self-healing ability and large-scale replicability ;
Second, from the perspective of application value , Standardization of cloud native heterogeneous resources , Accelerate digital infrastructure and liberate productivity , Improve the iteration speed of business applications , Enabling business innovation has important value ;
Third, from the perspective of industrial utility , Cloud primitives have greatly released the dividends of the cloud , Become an important engine driving business .

1.2 What is a cloud database

Cloud native database , It is built through the cloud platform 、 Deployed and distributed services . This cloud native attribute is its biggest feature compared with other types of databases . As a cloud platform , The cloud native database uses PaaS( Platform as a service , Platform-as-a-Service) In the form of , Often called DBaaS( Database as a service , DataBase-as-a-Service). Users can use the platform for a variety of purposes , Such as storage , Manage and extract data .
With the rapid development of Cloud Computing ,IT Applications turn to the cloud , Cloud services have the following characteristics ：

1. Provide on-demand services .
2. Users are only willing to pay operating expenses rather than asset expenses .
3. The cloud service provider cluster is becoming larger and larger , Even all over the world , The cluster has reached cloud scale （Cloud-Scale）.
   According to the above characteristics , Cloud products are required to provide certain services “ elastic ”（Elastic）, And reach cloud scale ; Node failure is like “ noise ” As inevitable , This in turn requires cloud services to have a certain “ self-healing ”（Resilience） Ability .
   At first , By means of IaaS, Directly integrate the traditional database “ Move ” To the clouds , Therefore, relational database services appear （RDS）. Although this can be partially realized “ elastic ” And “ self-healing ”, However, this scheme has low resource utilization , Maintenance costs are high , Low availability . therefore , It is very important to design a cloud native database that adapts to the characteristics of the cloud .
   To solve the above problems , We need to focus on the characteristics of cloud services , Transform or develop a new generation of cloud database , This is the cloud native database .

1.3 Cloud database VS Traditional database

Cloud native databases are usually implemented by installing database software on the cloud infrastructure , This approach makes the cloud native database have the direct access and runtime scalability that traditional databases do not have .
The advantages of cloud native database over traditional data are as follows ：
(1) Disposability in simple terms , Disposability means that the database can be disposed of without prior notice , The ability to instantly handle crashes or start processes . Although there are advanced technologies , But like disk failure 、 Network isolation failure , And virtual machine exceptions , Still inevitable .
(2) For traditional databases , These faults are particularly harmful , Because running the entire database on a single machine , Even a small problem can affect all functions . The design of the cloud native database is remarkably easy to handle , That is, the virtual machine is allowed to restart or reschedule immediately under instant notification . actually , Manageability has expanded from a single virtual machine to the entire data center . As our environment continues to develop in a more stable direction , The cloud native database will develop to a state of being insensitive to such failures .
(3) Enhanced security DBaaS Operate in a highly monitored and secure environment , Anti malware 、 Anti virus software and firewall protection . In addition to 24x7 monitoring and regular software upgrades , The cloud environment also provides additional security . contrary , Traditional databases are vulnerable to data loss and unrestricted access . Based on the data capabilities provided by service providers through instant snapshot replicas , Users can achieve “RPO=0,RTO<60 second ” The goal of .
(4) Scalability the ability to scale on demand at run time is a prerequisite for any enterprise to grow . Because this ability allows enterprises to focus on pursuing business goals , Don't worry about the size of storage space .
(5) Traditional databases store all files and resources on the same host , Cloud native databases are different , It not only allows you to store in different ways , And not affected by storage issues .
(6) Better accessibility is one of the most important limitations of traditional databases , It can only be accessed by connecting to the database system itself . The cloud native database provides round the clock access to the database , So that you can make any changes at any time , And you only need one that can access internet The computer . thus , The potential delay that may occur is eliminated , At the same time, it also opens up a way for collaboration among multiple developers .
(7) Significant cost savings building a data center is an independent and complete project , A lot of hardware investment is required , We also need well-trained operation and maintenance personnel who can reliably manage and maintain the data center . Besides , Continuous operation and maintenance will bring considerable pressure to your finance . Using cloud native DBaaS platform , You can do it at a lower upfront cost , Get an extensible database , This will free your hands , Achieve more optimal resource allocation .
The cloud first benefits from the application side , Under the traditional framework, it used to “ God ” Is the expansion of the unit , The cloud can achieve “ Second level ” Capacity expansion , Reduce the cost of software and hardware , It improves the rapid capacity expansion capability of the system , To cope with the image “ A double tenth ” This predictable and short-term peak in requests . But some cloud applications still access the traditional database architecture , The database layer doesn't get the benefits of the cloud . Now this cloud native database , That solves the problem , Separation of computing and storage , So that database resources can be flexibly expanded from the cloud 、 Quick recovery 、 Higher reliability 、 Rapid data migration, etc , Meet the needs of the business faster .

Two 、 Cloud database technology

Common cloud database products in the market are as follows , Next, I will introduce some core technologies of cloud database

2.1 Containerization Technology

Container plays a very important role in ensuring the consistency of the code running environment . Containers provide lightweight functionality by packaging and deploying applications 、 Immutable infrastructure to solve the problem that applications cannot function normally when they are moved to other environments , Apply an application or service 、 Its dependencies and their configurations are packaged as container images . Container technology for developers and IT Professionals only need to make a few changes , You don't even need to make any changes , Applications can be deployed across environments , Easy to use .

The ultimate goal of the container platform is to shield the resource management details of the distributed system , Provide a standard operating environment for distributed applications , At the same time, define a distributed application package, For developers, reduce the development cost of distributed systems , For users, reduce the maintenance cost of distributed applications , For manufacturers, reduce the distribution cost of distributed applications , That is to say DataCenter OS or Distributed OS, It can be abbreviated to DCOS.
in other words , Just make the database a container image , This is just the first step , It serves the following purposes . With this step , It is possible to rely on the container scheduling system to encapsulate more advanced general services .
With this ability , The experience of operation and maintenance can be precipitated into code , Accumulate into specific tools and services . The value of software lies in reuse , The higher the reusable frequency, the wider the range , The greater the value produced , The more worthwhile it is . such as RDS This service , The complexity of R & D itself is not high , The key lies in the accumulation of experience in handling various abnormal situations . There must be a limited number of anomalies that a company encounters , Only by gradually accumulating and improving in the community can it be gradually completed .IaaS The cloud RDS In fact, this is also the advantage of , Accumulated various usage scenarios and exception handling experience of various users on the cloud , Whether it is the business growth or the abnormality caused by incorrect use . Two days before Instapaper because MySQL The data file is too large 、 achieve ext3 Of 2TB File size limit , And cause its database failure , Business interruption 31 Hours , It's used AWS Upper RDS . Although the use of RDS Failure cannot be avoided , But after this failure ,AWS It will certainly improve RDS, The experience of dealing with this kind of fault is precipitated into the product , Other users can avoid stepping on the pit again .
Of course , It just has a standardized operating environment , It doesn't necessarily lead to rich applications , It also depends on the business model . The original business model of this infrastructure service can only be on-premise Private deployment mode , Sales and implementation costs are very high . Is it possible for the enterprise application field to have a similar Apple Of AppStore To reduce sales and implementation costs ？ Many manufacturers are trying to , Each container platform is trying to launch its own application specification ,IaaS Vendors are also considering providing declarative choreography API, Relinquish infrastructure services , Implemented by a third party （ such as QingCloud Upcoming AppCenter）. If this business model is mature , Not only will independent infrastructure services and middleware companies emerge , At the same time, the basic R & D Department of each company may change from the original supporting department , Turn into 2B The Revenue Department of the business .

2.2 Deposit is separate

2.2.1 On the division of the separation of deposit and settlement

In fact, the boundary between storage and computation is not clear , Calculation and storage are actually inseparable in the process of calculation , However, with the improvement of network bandwidth and performance , Provides a basis for discussion with a degree of separation . Calculation ” This is what the calculation process requires CPU Memory and so on. ,“ Storage ” It's something that needs persistence

2.2.2. Why separate computing from storage

• Whether the calculation reaches the bottleneck first , Or the storage reaches the bottleneck first , Although the two situations are different , The time point is also inconsistent . But usually, no matter what the situation is, the machine is added , So there will be a lot of waste .
• It's not easy to expand ： Computing and storage coupling mode , Storage expansion typically migrates large amounts of data , inconvenient .

2.2.3 The benefits of separation of deposit and settlement

By separating storage resources 、 Computing resources , Storage can be planned independently 、 Computing resource specifications and capacity . So the expansion of computing resources 、 Shrinkage capacity 、 Release , Can be completed relatively quickly , And there's no extra cost of data relocation . Storage 、 Computing can also better combine their own characteristics , Choose a more suitable resource specification and Design .

3、 ... and 、 Cloud database trends

3.1 The future cloud native distributed database

As businesses become more digital 、 Intelligent , The amount of data storage faced by enterprises will be even greater , Facing the challenges brought by more emergencies . According to the IDC forecast ,2025 year , Two thirds of enterprises will release software versions every day , Innovation and delivery through agile development capabilities , To form differentiated market competitiveness .
In this business trend , The database needs to fully enter the cloud native + The age of distribution , Realize intelligent upgrade , Fully release the dividend of Cloud Computing .
The so-called distributed , It is a concept for business expansion , Distributed databases , It is a kind of database to solve the problem of storage scalability .
It is composed of multiple interconnected databases , These databases are distributed in various data centers , Communicate through the central server , Then they are combined to form a single user oriented database . be based on Shared Nothing The architecture of , Distributed database can realize the horizontal partition of data 、 Horizontal expansion . The cloud native database is based on Shared Everything + Shared Storage Storage computing separation architecture , It can realize efficient resource pooling management . therefore , Advantages of cloud native databases + Efficiency of distributed databases , It can perfectly combine the characteristics of the two , Represents a future solution . in fact , Cloud native and distributed are now integrated . If the underlying infrastructure is all cloud , People's perspective of thinking about technical problems naturally becomes “ Cloud native ” angle .
In the future, cloud native and distributed will be combined , The database of the new cloud native distributed architecture will have high scalability 、 Ease of use 、 Fast iteration 、 Cost reduction, etc , To be specific ：

3.1.1 High scalability

The cloud native distributed database is separated from the underlying cloud computing infrastructure , So we can flexibly and timely mobilize resources to expand and shrink capacity , In order to cope with the pressure of traffic surge , And the waste caused by the surplus of resources in the low flow period . The characteristics of ecological compatibility , It also makes the cloud native database have strong migratability .

3.1.2 Ease of use

Cloud native distributed database is very easy to use , Its computing nodes are deployed in the cloud , Access from multiple front ends anytime, anywhere . Because the cluster is deployed on the cloud , Through automated disaster recovery and high availability , The impact of a single point of failure on the service is very small . When services need to be upgraded or replaced , The node can also be upgraded without interruption of service .

3.1.3 Fast iteration

The services in the cloud native distributed database are independent of each other , Updates to individual services have no impact on other parts . Besides , Cloud based R & D testing and operation and maintenance tools are highly automated , So you can achieve more agile updates and iterations .

3.1.4 Cost savings

The establishment of data center is an independent and complete project , It needs a lot of hardware investment and professional operation and maintenance personnel to manage and maintain the data center . Besides , Continuous operation and maintenance will cause great financial pressure . Cloud native distributed database with low upfront cost , Get an extensible database , Achieve more optimal resource allocation .

3.2 Digital transformation trend

The larger the amount of data , The greater the significance of digital transformation , However, transformation is closely related to multiple technical departments within the enterprise , It is not a task that a single team can accomplish independently , It requires the business unit of the enterprise 、 Data asset management 、 More departments such as development and application work together , therefore , The more large-scale enterprises, the more difficult the digital transformation will be . Enterprises need to break the traditional chimney architecture design , Realize digital transformation with a new data cloud model .
The future of the enterprise 5-10 Digital transformation in , Only with data as the core , Realize the interconnection of data , To continuously reconstruct and upgrade the new construction mode of digital infrastructure , As a support for innovation and change , Realize the upgrading and iteration of enterprise digital transformation , The whole life cycle process of data from record to value is as follows ：

3.2.1 Integration with big data

For big data technology , From unified data collection to big data 3.0 Pattern , From data assets to value to data service . The current requirement for infrastructure is to be able to host different applications of enterprises through a set of cloud native infrastructure , Collect all the data of the enterprise , Construction of big data base for enterprise data transformation .
Data is a very important factor of production for enterprises , The evolution of data and data value has also gone through four stages ： The stage of data unification in which data is collected and sorted through data warehouse and database 、 The data business stage of forming high-quality data through data governance 、 The stage of realizing data capitalization through data intelligence and analysis and the stage of realizing data ecology through data sharing transactions .

3.2.2 Data cloud

With the progress of technology and the evolution of business requirements , Enterprise applications 、 data 、 The infrastructure is constantly iterating , This iteration also makes the data cloud move from concept to implementation . The star ring is based on the cloud's native data cloud TDC It realizes data PaaS、 application PaaS、 analysis PaaS Three clouds merge , Developers of future enterprises , In this standardized PaaS Services SaaS Application development , And this is the future 5-10 The new mode of enterprise digital infrastructure construction in .

Four 、Amazon Cloud database

Amazon Cloud database includes the following ：

• Amazon RDS： Relational databases in the cloud
• Amazon SimpleDB： Key value database in cloud
• Amazon DynamoDB： In the clouds NoSQL database
• Amazon Redshift： Data warehouse in the cloud
• Amazon ElastiCache： Distributed memory caching in the cloud
  Here I would like to introduce Amazon DynamoDB, Fast 、 agile NoSQL Database services , It can achieve single digit millisecond performance at any scale .

4.1 working principle

Amazon DynamoDB It is a fully managed 、 serverless NoSQL Key value database , Designed to run high-performance applications of any size .DynamoDB Provide built-in security 、 Continuous backup 、 Automatic multi region replication 、 Memory caching and data export tools .

4.2 Use cases

1） Developing software applications
Build Internet level applications that support user content metadata and caching , These applications need to meet the high concurrency and connectivity of millions of users , And millions of requests per second .
2） Create a media metadata store
For media and entertainment workloads （ Such as real-time video streaming and interactive content ） Extend throughput and concurrency , And cross AWS Multi region replication of regions provides lower latency .
3） Provide a seamless retail experience
Using design patterns to deploy shopping carts 、 Workflow engine 、 Inventory tracking and customer profile .DynamoDB Support high traffic 、 Extreme scale events , It can process millions of queries per second .
4） Expand the game platform
No operational overhead , Focus on driving innovation . Use player data 、 Build your gaming platform with session history and millions of concurrent users .

5、 ... and 、 summary

Big data era , The amount of data is growing explosively , Data storage structures are becoming more and more flexible , The ever-changing emerging business requirements have led to the existence of more and more abundant forms of databases and application systems , These changes are constantly challenging the various capabilities of the database , Promote the database technology to expand towards the model 、 The direction of architecture decoupling evolves , And cloud computing 、 Artificial intelligence 、 Blockchain 、 Privacy computing 、 New hardware and other technologies are learning from each other 、 The development trend of continuous integration . The generation of cloud database solves these problems , The future cloud native distributed database , Digital transformation trend , Containerization technology will further open a new mode of enterprise digital infrastructure construction , Cloud native databases are in full swing , Future period .

Fan benefits

Amazon cloud technology has created a variety of learning platforms for developers ：

1. Getting started Resource Center ： from 0 To 1 Easy to get started with cloud services , Content covered ： Cost management , Start training , Development resources .https://aws.amazon.com/cn/getting-started/?nc1=h_ls&trk=32540c74-46f0-46dc-940d-621a1efeedd0&sc_channel=el
2. Architecture Center ： Amazon cloud Technology Architecture Center provides cloud platform reference architecture chart 、 Reviewed architectural solutions 、Well-Architected Best practices 、 Pattern 、 Icon, etc .
   https://aws.amazon.com/cn/architecture/?intClick=dev-center-2021_main&trk=3fa608de-d954-4355-a20a-324daa58bbeb&sc_channel=el
3. Builder Library ： Learn how Amazon cloud builds and operates software .
   https://aws.amazon.com/cn/builders-library/?cards-body.sort-by=item.additionalFields.sortDate&cards-body.sort-order=desc&awsf.filter-content-category=*all&awsf.filter-content-type=*all&awsf.filter-content-level=*all&trk=835e6894-d909-4691-aee1-3831428c04bd&sc_channel=el
4. Toolkit for developing and managing applications on Amazon cloud technology platform ：
   https://aws.amazon.com/cn/tools/?intClick=dev-center-2021_main&trk=972c69e1-55ec-43af-a503-d458708bb645&sc_channel=el

【 Exclusive benefits 】
Fukuichi ：100 Free packages for more than products . among , Computing resources Amazon EC2 First year 12 It's free for three months ,750 Hours / month ; Storage resources Amazon S3 First year 12 It's free for three months ,5GB Standard storage capacity .
https://aws.amazon.com/cn/free/?nc2=h_ql_pr_ft&all-free-tier.sort-by=item.additionalFields.SortRank&all-free-tier.sort-order=asc&awsf.Free%20Tier%20Types=*all&awsf.Free%20Tier%20Categories=*all&trk=e0213267-9c8c-4534-bf9b-ecb1c06e4ac6&sc_channel=el
Welfare II ： The latest discount gift bag ,200$CountAccording\; to\; theAndbranchAnalysisOffsetbuckleCoupon,200$ Machine learning voucher ,200$ Micro service and application development deduction voucher .https://www.amazonaws.cn/campaign/?sc_channel=el&sc_campaign=credit-acts-ldr&sc_country=cn&sc_geo=chna&sc_category=mult&sc_outcome=field&trkCampaign=request-credit-glb-ldr&trk=f45email&trk=02faebcb-3f61-4bcb-b68e-c63f3ae33c99&sc_channel=el
Welfare three ： Solution CloudFormation One click deployment template library
https://aws.amazon.com/cn/quickstart/