当前位置:网站首页>Talk about the future of cloud native database

Talk about the future of cloud native database

2022-06-25 08:04:00 They call me technical director

Catalog

Preface

1、 Claims the melon , Eat and boast

2、 It starts with beauty , Finally talent

advantage :

2.1 No need to manage servers

2.2、 Continue to expand

2.3、 Sub second measurement

shortcoming :

3、 Personal advice

One 、 Cloud native , From the well at the entrance of the village to the sea of stars

1、 Birth background

2、 cloud

3、 Native

4、 Cloud native

Two 、 database , From beard and eyebrows to morning glory nose

1、 What is a database

2、 Change of data management mode

3、 Talk about databases Serverless

3.1 Unlimited refills + Optimal energy consumption

3.2 Global layout , Highly disaster tolerant

3、 ... and 、AWS Cloud native database

1、 It's special for the special warehouse , First take a look at their family bucket

2、 The earth is my home , The global database depends on it

3、AI+ database , Easily train your data model

4、 Hua Shan talks about swords , Strength responsibility

5、 summary

Four 、 Fan benefits

Preface

         This topic , Let's talk about what cloud primitives are ? What is a database ? Finally, I will take you to the Amazon cloud native database , Find the cloud native database that suits you .

1、 Claims the melon , Eat and boast

        “ Gold has a price , Data is priceless ”, Database development to the present , The importance is self-evident . Data as an asset of an enterprise , At the same time, it is also the digitalization of enterprises 、 The indispensable energy for information operation . Its energy efficiency is equivalent to that of coal 、 oil 、 The changes that natural gas brings to people .

         As an important carrier of data , database . We certainly want to spend the least effort , Choose what suits you , No , It should be a database product that surprises us . In order to let us quickly get familiar with the cloud native database and actually experience , Specially sorted out relevant trial products , I invite you to have a look at this melon ! Whether it is crisp and refreshing , You can't count until you eat .

1、 Amazon cloud technology provides 100 Free packages for more than products . among , Computing resources Amazon EC2 First year 12 It's free for three months ,750 Hours / month ; Storage resources Amazon S3 First year 12 It's free for three months ,5GB Standard storage capacity ; Database resources Amazon RDS First year 12 It's free for three months ,750 Hours ;Amazon Dynamo DB 25GB storage capacity Free forever .

2、 Database free trial links and tutorials

3、 Cloud native database online conference

2、 It starts with beauty , Finally talent

advantage :

2.1 No need to manage servers

         The cloud native database can automatically run your code , No need to preset or manage servers . You just need to write code and upload it to the cloud native database .

2.2、 Continue to expand

         By running code in response to each trigger , To automatically extend your application . Your code will run in parallel and handle each trigger independently , Make it scale precisely according to the size of the workload .

2.3、 Sub second measurement

         When using cloud native databases , According to the code execution time ( per 1 Milliseconds ) And code trigger times . When the code is not running , No cost .

shortcoming :

         The only drawback is that some professional videos and documents are in English , But for students who have a certain foundation in English, this is not a thing , Ha ha ha , I can't. We still have a translator .

3、 Personal advice

         When the following problems or scenarios occur in the enterprise , choice AWS Cloud native database , It will give a satisfactory complete solution .

        1、 At present, enterprises are facing serious infrastructure obsolescence 、 Low level of Automation 、 Lack of special tools and heavy capital expenditure .

        2、 Enterprises are bound by traditional commercial databases , And it's hard to innovate , But we still need the performance of commercial databases .

        3、 Operation and maintenance is time-consuming, but the value output is low , But enterprises have to spend energy and cost in this regard .

        4、 Enterprises have TB level 、PB Level structured data and several times the unstructured data , Globally distributed users , And process millions of requests per second with very low latency .

One 、 Cloud native , From the well at the entrance of the village to the sea of stars

         To understand cloud computing, we need to understand two key words ——「 cloud 」 and 「 Native 」.

1、 Birth background

         In a non cloud database architecture , We will build the database according to the application system , And it must be a tightly coupled design , To maximize the effectiveness of the system . Let me give you an example from life , We go through several stages of using water , From the well shared by everyone at the entrance of the village , To every household's well , The tap water we use now . Why did such an evolution occur ?

         At the beginning, everyone solved the problem of drinking water , Therefore, crowdfunding is under the old locust tree at the entrance of the village , Dig a well to solve the problem of drinking water . Soon found out , There is a need to queue up for shared wells 、 The quality of water is not well controlled 、 When the weather is dry, you often can't drink water, etc . Therefore, each household will drill a well according to the water consumption , Solved the queuing problem , But there will still be water shortage 、 It is difficult to control the water quality of wells . This is because traditional database systems use computing 、 The way resources are stored is the same , It's a tightly coupled way .

         What if there's not enough water ? Corresponding , This is the business expansion often mentioned in the traditional database system . In order to expand the capacity 、 Shrinkage capacity . The traditional expansion process is very long , And it's painful to shrink after the business peak , It often leads to a great waste of resources , It's also hard to cope with the fast changing capabilities required by the business layer , This is one of the biggest drawbacks of traditional architecture . At this time, people urgently hope that we don't need to drill wells by ourselves , There is no need to consider the water quality 、 Water quantity and whether there is water . Just want to take it and use it , Charge on demand . This is how the cloud native database was born .

 

2、 cloud

         The cloud is relative to the local , Traditional applications have to run on local servers , Now popular applications are running in the cloud , The cloud contains IaaS,、PaaS and SaaS.「 cloud 」 It is to pool resources with virtualization technology . Water is a resource , No tightly coupled way to deploy and use , You don't have to drill wells , But many villages 、 Cities Unite “ hit ” A lake or sea , Repair the pipeline to every household , This is resource pooling . After pooling resources, they can be used on demand , Flexible scheduling .

         The present ,IT The best combination of technologies in the world may be “ Cloud computing + Artificial intelligence ”. Cloud computing solves scalability 、 data storage 、 Performance and so on , Artificial intelligence technology greatly improves the efficiency of data analysis and processing .

         Cloud computing can provide the peak demand for modern applications “ Unlimited refills ” And when running smoothly “ Optimal energy consumption ”. As one of the cloud computing models Serverless, In theory, it can automatically adapt to the peak demand from zero to infinity , Better at solving scalability problems ( Peak shaving and valley filling ).Serverless The advantage of architecture is that it can be loaded on demand , In this way, the application will not continue to occupy resources , Only when a request arrives or an event occurs will it be deployed and started , Avoid cost waste . meanwhile ,Serverless Native applications support high availability , It can better deal with sudden high traffic . When the database is also Serverless turn , It can achieve high scalability and automatic capacity expansion , Pay as you go 、 Reduce expenditure costs , further Emancipate the management, operation and maintenance of database .2012 Amazon launched Amazon DynamoDB Namely Serverless database .

3、 Native

         Being native means being native , When we start to design the application, we consider that the application will run in the cloud environment in the future , Make full use of the advantages of cloud resources , such as ️ Cloud services elastic and Distributed advantage .

         So when enterprises design applications , Fully consider the cloud environment , Give full play to the advantages of the cloud , Jean Yun “ native ” The ability to apply to the entire lifecycle of enterprise applications , Including the rapid deployment of cloud 、 Flex as needed 、 On line delivery, etc . Let enterprise applications Born in the cloud , Longer than clouds .

4、 Cloud native

         in general , As shown in the following figure, the cloud is native =DevOps+ Continuous delivery + Microservices + Containers . That is, applications that conform to the cloud native architecture should be : Using the open source stack (K8S+Docker) Containerization , Improve flexibility and maintainability based on microservice architecture , With agile methods 、DevOps Support continuous iteration and operation and maintenance automation , Using cloud platform facilities to achieve elastic scaling 、 Dynamic scheduling 、 Optimize resource utilization . Cloud primordial can be favored by everyone , Because of this “ Four Heavenly Kings ” Help endorse behind your back . If you are interested, you can take a look at the self introduction of the four heavenly kings , It can help you better understand cloud primitives .

Microservices : Almost every cloud native definition includes microservices , The opposite of microservices is single application , Microservice has a theoretical basis , That's Conway's law , Guide the service how to segment , Very mysterious , Anyone who can be called a theoretical law simply can't understand , Otherwise, there will be no b grid , Organizational structure determines product form , I wonder if it has anything to do with Marx's relations of production affecting productivity .

The benefit of the microservice architecture is to function After cutting , Service decoupling , Better cohesion , Change is easier ; Another technique for dividing services is said to be based on DDD Come on .

Containerization :Docker It is the most widely used container engine , It is widely used in the infrastructure of companies such as Cisco and Google , Is based on LXC Technology , Containerization provides implementation guarantee for microservices , Play the role of application isolation ,K8S It's a container choreography system , For container management , Load balancing between containers , Google did it ,Docker and K8S All use Go To write , It's all good stuff .

DevOps: This is a compound word ,Dev+Ops, Is the combination of development and operation and maintenance , Unlike development and products , Often meet with the blade , actually DevOps Testing should also be included ,DevOps Is an agile mind , It's a culture of communication , It's also the form of organization , Provide continuous delivery capabilities for cloud natives .

Continuous delivery : Continuous delivery is timely development , Keep updating , Small step run , Anti traditional waterfall development model , This requires both the development version and the stable version , In fact, it needs a lot of processes and tools to support .

Two 、 database , From beard and eyebrows to morning glory nose

1、 What is a database

         For database professionals , In fact, it is an electronic warehouse , It is a special place for storing and managing data , Users can add, update or delete data in the database . Database is the middle layer between application and hardware , Software application for data management . Take a chestnut . Your phone's address book is a database , Used to keep friends 、 How to contact students .

         The history of database development is about 50 year , front 30 Over the years, the main development direction is centralized database , In the direction of centralized database IBM、Oracle、 Microsoft and other giants . Develop open source database products from closed source products , Open source database is developing rapidly , And there is a trend to catch up with and surpass the closed source database . The increase of business volume leads to the transformation of database to distributed direction , meanwhile , The rapid development of cloud computing makes databases cloud .

         To 2022 Up to, the database is in the ascendant , A number of excellent database products and database suppliers have emerged . Among them, the open source database is based on MySQL、PostgresSQL As a representative , Excellent database supplier AWS、 Oracle bone inscriptions represent .

2、 Change of data management mode

         Data as an application system “ blood ”, Good blood circulation will make our system run smoothly , Support the rapid and vigorous development of the business , conversely , Bad blood circulation , It will make the database the bottleneck of our application , Poor circulation , Resulting in poor application experience , The application is blocked , Finally, it will lead to application bankruptcy . In order to solve this situation , We must solve two major problems , One is “ It works ” Two is “ To use ”.

        “ It works ” That is, we should do a good job in daily maintenance, backup and isolation, etc ,“ To use ” High performance , Low latency, etc , So that users can not experience the delay caused by the database . Because in the traditional self-management mode , Achieve “ It works ” Amitabha already .

         Because just to make sure it works , We must do a good job of routine maintenance 、 patch up 、 Database backup 、 Data isolation and security 、 Optimal configuration adjustment, etc . But the boss and users are only concerned about the value behind the data , Therefore, customers must pay more attention to pattern design 、 Query build 、 Query and optimize these applications .

         In such an environment , The customer hopes that the hard and tired work at the bottom trusteeship get out , Or better yet Intelligent operation and maintenance . So as AWS Cloud vendors have launched relevant hosting and Serverless( There is no server ) service , Liberate the customer's hands , Let customers focus on applications , Reduce cost and increase efficiency for enterprise development . No more beard and eyebrows , Just grab the app's nose . In their own business areas to bloom more brilliant glory . Use as shown in the picture AWS After the cloud native database, our database management only needs to focus on the small red area behind it . Do you feel like you have caught the straw , Can't wait to buy . Don't worry. Listen to me slowly , Take your time to appreciate AWS The charm of .(PS: I have also sorted out the related purchase benefits at the end of the article , Welcome to buy .)

3、 Talk about databases Serverless

         At present, there is no server in the database , Because of its flexibility , Get unanimous praise , Like Sunwukong's Ruyi golden cudgel , As you wish , Listen to me . Let's say Aurora Serverless V2 For example , Specifically speaking Serverless Several characteristics of .                

3.1 Unlimited refills + Optimal energy consumption

        Aurora Serverless V2 Support instant in place expansion feature , When we hold similar promotions , For large-scale stress tests , We certainly hope that our application will be like the usual night 2 Click the performance of a low application scenario , At this time, our server needs to have sufficient resources to support these high application scenarios . As shown in the figure below Aurora Serverless You can complete the server configuration adaptation in seconds , Without affecting existing applications . This is exactly what I mentioned earlier “ Unlimited refills ” The operation of .

         Generally speaking, upward expansion is relatively simple , Just add configuration . But when we need to zoom , How to do this without affecting the application , Skillfully complete the scaling of the configuration ? For example, buffer pool is used least frequently (LFU) And the least recently used (LRU) A combination of algorithms to smooth scaling . In this way, the application can be ensured at the same time , keep “ Optimal energy consumption ”.

3.2 Global layout , Highly disaster tolerant

         When we do business globally , Or when we need to quickly deal with the downtime of the primary database , How to ensure that when the database service in our main area goes down , Fast switching ? At the same time, in order to save costs , The configuration of the slave region is generally that of the master region 1/5 about , In this case, under the traditional database architecture , It is difficult to quickly switch and tolerate disasters . It is because Serverless Also support read log By reading the operation log of the main area , Keep the data on both sides consistent , add Serverless Rapid expansion of , You can guarantee that in the second level , The configuration from the area to the main area ensures the application , This will minimize the risk of system application .

3、 ... and 、AWS Cloud native database

1、 It's special for the special warehouse , First take a look at their family bucket

chart 3.1AWS Cloud native database family bucket

chart 3.2AWS Cloud database service

         At present, there is no database that can meet all our needs , For example, we wear beautiful skirts in summer and wear them in snowy winter , It's probably enough . So we will choose our clothes according to our needs . Similarly, we can also select the appropriate database service according to our application needs , For example, when our enterprise takes the traditional ERP Application oriented , At this time, we can choose AWS Of Aurora/RDS To host our relational database ; When our application focuses on specific scenarios , But there is a very high flow , E-commerce shopping , At this time, we can choose AWS Of DynamoDB Or memory servers to meet our high-frequency application scenarios, etc .

2、 The earth is my home , The global database depends on it

         Today's economy 、 The rapid development of Internet and industry , Many enterprises have expanded their business abroad , In order to cope with the rapid development of international business . At this time, if the enterprise plans to deploy its own localized server applications abroad , Well, when you're done , Others have already started to reduce the dimension and hit you , The same company boss 、 I'm afraid the financial department will often ask you to drink tea to settle accounts . At this time, select a mature international supplier to assist , One key deployment , Why not do it ? Save countless troubles behind you , Cut off thousands of troubles .

 

         As shown in the figure ,AWS Global database , Cross region replication latency is in the order of seconds , Cross region failover does not exceed 1 minute , And support the use of backbone network , One key deployment , Are you in love .

3、AI+ database , Easily train your data model

        AI At present, it is a mess of fire , But our enterprise wants to do , But he was timid , Because of this thing , It needs a strong talent reserve , It's easy to beat a dog with meat buns . Of course AI The benefits brought to the enterprise , It is undeniable , Through the existing database resources and AI Algorithm to continuously optimize their own data model , Make the corresponding data model more suitable for enterprise applications , To assist in decision making , Guide production . This is exactly what countless enterprises are pursuing , Therefore, enterprises urgently need a low threshold AI Development services . ha-ha , you 're right AWS It also helped us think of , Let's take a look at AWS stay AI What have you done in terms of integration .

         As shown in the figure , Database developers do not need expertise in machine learning , The machine learning operation can be carried out . adopt AI Component and database integration , take AI The results are fed back to the database , Through a simple SQL Statement to query and apply .

4、 Hua Shan talks about swords , Strength responsibility

          As shown in the figure AWS Of Aurora contrast MySQL In terms of performance 5 Times promotion , a PostgreSQL Yes 3 Times promotion . Support cross regional disaster recovery , Support the most 15 Copies , Automatic extension , While improving the performance of commercial databases , The cost is only that of commercial databases 1/10, And according to Pay for usage , Who's here , Who doesn't . arrange !!!

5、 summary

        1、AWS It is very convenient to use the components of , The whole development process can also be monitored , Whole process visual configuration .AWS The default configuration of is set according to common development scenarios , Therefore, it can greatly improve the development efficiency . and AWS The high integration of components has to give people a thumbs up .

        2、 We can according to the actual situation of our business , Choose different products to better adapt to the development of the business .

        3、 No matter which product ,AWS Both provide managed services and infrastructure components . Structural modernization is the cornerstone of all innovation , The most important idea is “The right tool for the job”, That is, using specially built tools in different scenarios , Special tools need professional modern hosting platform , These can save a lot of time for enterprises 、 Money and energy . AWS It is undoubtedly one of the best choices .

Four 、 Fan benefits

Amazon cloud technology has created a variety of learning platforms for developers :

        1. Getting started Resource Center : from 0 To 1 Easy to get started with cloud services , Content covered : Cost management , Start training , Development resources .AWS introduction _AWS Getting started _AWS Cloud computing resources -AWS The cloud service

        2. Architecture Center : Amazon cloud Technology Architecture Center provides cloud platform reference architecture chart 、 Reviewed architectural solutions 、Well-Architected Best practices 、 Pattern 、 Icon, etc .AWS Architecture Center deployment description _AWS Cloud Architecture white paper -AWS The cloud service

        3. Builder Library : Learn how Amazon cloud builds and operates software .Amazon Builders' Library*all&awsf.filter-content-type=*all&awsf.filter-content-level=*all&trk=835e6894-d909-4691-aee1-3831428c04bd&sc_channel=el

        4. Toolkit for developing and managing applications on Amazon cloud technology platform :aws Download tool _aws development tool _ Download resources -AWS The cloud service

【 Exclusive benefits 】

         Fukuichi :100 Free packages for more than products . among , Computing resources Amazon EC2 First year 12 It's free for three months ,750 Hours / month ; Storage resources Amazon S3 First year 12 It's free for three months ,5GB Standard storage capacity .

https://aws.amazon.com/cn/free/?nc2=h_ql_pr_ft&all-free-tier.sort-by=item.additionalFields.SortRank&all-free-tier.sort-order=asc&awsf.Free%20Tier%20Types=*all&awsf.Free%20Tier%20Categories=*all&trk=e0213267-9c8c-4534-bf9b-ecb1c06e4ac6&sc_channel=el

         Welfare II : The latest discount gift bag ,200$ Data and analysis deduction voucher ,200$ Machine learning voucher ,200$ Micro service and application development deduction voucher . The latest offer _ Cloud server Promotion - Amazon cloud technology

         Welfare three : Solution CloudFormation One click deployment template library

Quick start to cloud service solution deployment _ Cloud service deployment -AWS The cloud service

原网站

版权声明
本文为[They call me technical director]所创,转载请带上原文链接,感谢
https://yzsam.com/2022/176/202206250630187331.html