当前位置:网站首页>Talk about the future of cloud native database
Talk about the future of cloud native database
2022-06-25 08:04:00 【They call me technical director】
Catalog
1、 Claims the melon , Eat and boast
2、 It starts with beauty , Finally talent
One 、 Cloud native , From the well at the entrance of the village to the sea of stars
Two 、 database , From beard and eyebrows to morning glory nose
2、 Change of data management mode
3、 Talk about databases Serverless
3.1 Unlimited refills + Optimal energy consumption
3.2 Global layout , Highly disaster tolerant
3、 ... and 、AWS Cloud native database
1、 It's special for the special warehouse , First take a look at their family bucket
2、 The earth is my home , The global database depends on it
3、AI+ database , Easily train your data model
4、 Hua Shan talks about swords , Strength responsibility
Preface
This topic , Let's talk about what cloud primitives are ? What is a database ? Finally, I will take you to the Amazon cloud native database , Find the cloud native database that suits you .

1、 Claims the melon , Eat and boast
“ Gold has a price , Data is priceless ”, Database development to the present , The importance is self-evident . Data as an asset of an enterprise , At the same time, it is also the digitalization of enterprises 、 The indispensable energy for information operation . Its energy efficiency is equivalent to that of coal 、 oil 、 The changes that natural gas brings to people .
As an important carrier of data , database . We certainly want to spend the least effort , Choose what suits you , No , It should be a database product that surprises us . In order to let us quickly get familiar with the cloud native database and actually experience , Specially sorted out relevant trial products , I invite you to have a look at this melon ! Whether it is crisp and refreshing , You can't count until you eat .
2、 Database free trial links and tutorials
3、 Cloud native database online conference
2、 It starts with beauty , Finally talent
advantage :
2.1 No need to manage servers
The cloud native database can automatically run your code , No need to preset or manage servers . You just need to write code and upload it to the cloud native database .

2.2、 Continue to expand
By running code in response to each trigger , To automatically extend your application . Your code will run in parallel and handle each trigger independently , Make it scale precisely according to the size of the workload .

2.3、 Sub second measurement
When using cloud native databases , According to the code execution time ( per 1 Milliseconds ) And code trigger times . When the code is not running , No cost .

shortcoming :
The only drawback is that some professional videos and documents are in English , But for students who have a certain foundation in English, this is not a thing , Ha ha ha , I can't. We still have a translator .
3、 Personal advice
When the following problems or scenarios occur in the enterprise , choice AWS Cloud native database , It will give a satisfactory complete solution .
1、 At present, enterprises are facing serious infrastructure obsolescence 、 Low level of Automation 、 Lack of special tools and heavy capital expenditure .
2、 Enterprises are bound by traditional commercial databases , And it's hard to innovate , But we still need the performance of commercial databases .
3、 Operation and maintenance is time-consuming, but the value output is low , But enterprises have to spend energy and cost in this regard .
4、 Enterprises have TB level 、PB Level structured data and several times the unstructured data , Globally distributed users , And process millions of requests per second with very low latency .
One 、 Cloud native , From the well at the entrance of the village to the sea of stars
To understand cloud computing, we need to understand two key words ——「 cloud 」 and 「 Native 」.
1、 Birth background
In a non cloud database architecture , We will build the database according to the application system , And it must be a tightly coupled design , To maximize the effectiveness of the system . Let me give you an example from life , We go through several stages of using water , From the well shared by everyone at the entrance of the village , To every household's well , The tap water we use now . Why did such an evolution occur ?
At the beginning, everyone solved the problem of drinking water , Therefore, crowdfunding is under the old locust tree at the entrance of the village , Dig a well to solve the problem of drinking water . Soon found out , There is a need to queue up for shared wells 、 The quality of water is not well controlled 、 When the weather is dry, you often can't drink water, etc . Therefore, each household will drill a well according to the water consumption , Solved the queuing problem , But there will still be water shortage 、 It is difficult to control the water quality of wells . This is because traditional database systems use computing 、 The way resources are stored is the same , It's a tightly coupled way .
What if there's not enough water ? Corresponding , This is the business expansion often mentioned in the traditional database system . In order to expand the capacity 、 Shrinkage capacity . The traditional expansion process is very long , And it's painful to shrink after the business peak , It often leads to a great waste of resources , It's also hard to cope with the fast changing capabilities required by the business layer , This is one of the biggest drawbacks of traditional architecture . At this time, people urgently hope that we don't need to drill wells by ourselves , There is no need to consider the water quality 、 Water quantity and whether there is water . Just want to take it and use it , Charge on demand . This is how the cloud native database was born .



2、 cloud
The cloud is relative to the local , Traditional applications have to run on local servers , Now popular applications are running in the cloud , The cloud contains IaaS,、PaaS and SaaS.「 cloud 」 It is to pool resources with virtualization technology . Water is a resource , No tightly coupled way to deploy and use , You don't have to drill wells , But many villages 、 Cities Unite “ hit ” A lake or sea , Repair the pipeline to every household , This is resource pooling . After pooling resources, they can be used on demand , Flexible scheduling .
The present ,IT The best combination of technologies in the world may be “ Cloud computing + Artificial intelligence ”. Cloud computing solves scalability 、 data storage 、 Performance and so on , Artificial intelligence technology greatly improves the efficiency of data analysis and processing .
Cloud computing can provide the peak demand for modern applications “ Unlimited refills ” And when running smoothly “ Optimal energy consumption ”. As one of the cloud computing models Serverless, In theory, it can automatically adapt to the peak demand from zero to infinity , Better at solving scalability problems ( Peak shaving and valley filling ).Serverless The advantage of architecture is that it can be loaded on demand , In this way, the application will not continue to occupy resources , Only when a request arrives or an event occurs will it be deployed and started , Avoid cost waste . meanwhile ,Serverless Native applications support high availability , It can better deal with sudden high traffic . When the database is also Serverless turn , It can achieve high scalability and automatic capacity expansion , Pay as you go 、 Reduce expenditure costs , further Emancipate the management, operation and maintenance of database .2012 Amazon launched Amazon DynamoDB Namely Serverless database .
3、 Native
Being native means being native , When we start to design the application, we consider that the application will run in the cloud environment in the future , Make full use of the advantages of cloud resources , such as ️ Cloud services elastic and Distributed advantage .
So when enterprises design applications , Fully consider the cloud environment , Give full play to the advantages of the cloud , Jean Yun “ native ” The ability to apply to the entire lifecycle of enterprise applications , Including the rapid deployment of cloud 、 Flex as needed 、 On line delivery, etc . Let enterprise applications Born in the cloud , Longer than clouds .
4、 Cloud native
in general , As shown in the following figure, the cloud is native =DevOps+ Continuous delivery + Microservices + Containers . That is, applications that conform to the cloud native architecture should be : Using the open source stack (K8S+Docker) Containerization , Improve flexibility and maintainability based on microservice architecture , With agile methods 、DevOps Support continuous iteration and operation and maintenance automation , Using cloud platform facilities to achieve elastic scaling 、 Dynamic scheduling 、 Optimize resource utilization . Cloud primordial can be favored by everyone , Because of this “ Four Heavenly Kings ” Help endorse behind your back . If you are interested, you can take a look at the self introduction of the four heavenly kings , It can help you better understand cloud primitives .
Microservices : Almost every cloud native definition includes microservices , The opposite of microservices is single application , Microservice has a theoretical basis , That's Conway's law , Guide the service how to segment , Very mysterious , Anyone who can be called a theoretical law simply can't understand , Otherwise, there will be no b grid , Organizational structure determines product form , I wonder if it has anything to do with Marx's relations of production affecting productivity .
The benefit of the microservice architecture is to function After cutting , Service decoupling , Better cohesion , Change is easier ; Another technique for dividing services is said to be based on DDD Come on .
Containerization :Docker It is the most widely used container engine , It is widely used in the infrastructure of companies such as Cisco and Google , Is based on LXC Technology , Containerization provides implementation guarantee for microservices , Play the role of application isolation ,K8S It's a container choreography system , For container management , Load balancing between containers , Google did it ,Docker and K8S All use Go To write , It's all good stuff .
DevOps: This is a compound word ,Dev+Ops, Is the combination of development and operation and maintenance , Unlike development and products , Often meet with the blade , actually DevOps Testing should also be included ,DevOps Is an agile mind , It's a culture of communication , It's also the form of organization , Provide continuous delivery capabilities for cloud natives .
Continuous delivery : Continuous delivery is timely development , Keep updating , Small step run , Anti traditional waterfall development model , This requires both the development version and the stable version , In fact, it needs a lot of processes and tools to support .

Two 、 database , From beard and eyebrows to morning glory nose
1、 What is a database
For database professionals , In fact, it is an electronic warehouse , It is a special place for storing and managing data , Users can add, update or delete data in the database . Database is the middle layer between application and hardware , Software application for data management . Take a chestnut . Your phone's address book is a database , Used to keep friends 、 How to contact students .
The history of database development is about 50 year , front 30 Over the years, the main development direction is centralized database , In the direction of centralized database IBM、Oracle、 Microsoft and other giants . Develop open source database products from closed source products , Open source database is developing rapidly , And there is a trend to catch up with and surpass the closed source database . The increase of business volume leads to the transformation of database to distributed direction , meanwhile , The rapid development of cloud computing makes databases cloud .
To 2022 Up to, the database is in the ascendant , A number of excellent database products and database suppliers have emerged . Among them, the open source database is based on MySQL、PostgresSQL As a representative , Excellent database supplier AWS、 Oracle bone inscriptions represent .

2、 Change of data management mode
Data as an application system “ blood ”, Good blood circulation will make our system run smoothly , Support the rapid and vigorous development of the business , conversely , Bad blood circulation , It will make the database the bottleneck of our application , Poor circulation , Resulting in poor application experience , The application is blocked , Finally, it will lead to application bankruptcy . In order to solve this situation , We must solve two major problems , One is “ It works ” Two is “ To use ”.
“ It works ” That is, we should do a good job in daily maintenance, backup and isolation, etc ,“ To use ” High performance , Low latency, etc , So that users can not experience the delay caused by the database . Because in the traditional self-management mode , Achieve “ It works ” Amitabha already .
Because just to make sure it works , We must do a good job of routine maintenance 、 patch up 、 Database backup 、 Data isolation and security 、 Optimal configuration adjustment, etc . But the boss and users are only concerned about the value behind the data , Therefore, customers must pay more attention to pattern design 、 Query build 、 Query and optimize these applications .
In such an environment , The customer hopes that the hard and tired work at the bottom trusteeship get out , Or better yet Intelligent operation and maintenance . So as AWS Cloud vendors have launched relevant hosting and Serverless( There is no server ) service , Liberate the customer's hands , Let customers focus on applications , Reduce cost and increase efficiency for enterprise development . No more beard and eyebrows , Just grab the app's nose . In their own business areas to bloom more brilliant glory . Use as shown in the picture AWS After the cloud native database, our database management only needs to focus on the small red area behind it . Do you feel like you have caught the straw , Can't wait to buy . Don't worry. Listen to me slowly , Take your time to appreciate AWS The charm of .(PS: I have also sorted out the related purchase benefits at the end of the article , Welcome to buy .)

3、 Talk about databases Serverless
At present, there is no server in the database , Because of its flexibility , Get unanimous praise , Like Sunwukong's Ruyi golden cudgel , As you wish , Listen to me . Let's say Aurora Serverless V2 For example , Specifically speaking Serverless Several characteristics of .
3.1 Unlimited refills + Optimal energy consumption
Aurora Serverless V2 Support instant in place expansion feature , When we hold similar promotions , For large-scale stress tests , We certainly hope that our application will be like the usual night 2 Click the performance of a low application scenario , At this time, our server needs to have sufficient resources to support these high application scenarios . As shown in the figure below Aurora Serverless You can complete the server configuration adaptation in seconds , Without affecting existing applications . This is exactly what I mentioned earlier “ Unlimited refills ” The operation of .

Generally speaking, upward expansion is relatively simple , Just add configuration . But when we need to zoom , How to do this without affecting the application , Skillfully complete the scaling of the configuration ? For example, buffer pool is used least frequently (LFU) And the least recently used (LRU) A combination of algorithms to smooth scaling . In this way, the application can be ensured at the same time , keep “ Optimal energy consumption ”.

3.2 Global layout , Highly disaster tolerant
When we do business globally , Or when we need to quickly deal with the downtime of the primary database , How to ensure that when the database service in our main area goes down , Fast switching ? At the same time, in order to save costs , The configuration of the slave region is generally that of the master region 1/5 about , In this case, under the traditional database architecture , It is difficult to quickly switch and tolerate disasters . It is because Serverless Also support read log By reading the operation log of the main area , Keep the data on both sides consistent , add Serverless Rapid expansion of , You can guarantee that in the second level , The configuration from the area to the main area ensures the application , This will minimize the risk of system application .

3、 ... and 、AWS Cloud native database
1、 It's special for the special warehouse , First take a look at their family bucket

chart 3.1AWS Cloud native database family bucket

chart 3.2AWS Cloud database service
At present, there is no database that can meet all our needs , For example, we wear beautiful skirts in summer and wear them in snowy winter , It's probably enough . So we will choose our clothes according to our needs . Similarly, we can also select the appropriate database service according to our application needs , For example, when our enterprise takes the traditional ERP Application oriented , At this time, we can choose AWS Of Aurora/RDS To host our relational database ; When our application focuses on specific scenarios , But there is a very high flow , E-commerce shopping , At this time, we can choose AWS Of DynamoDB Or memory servers to meet our high-frequency application scenarios, etc .
2、 The earth is my home , The global database depends on it
Today's economy 、 The rapid development of Internet and industry , Many enterprises have expanded their business abroad , In order to cope with the rapid development of international business . At this time, if the enterprise plans to deploy its own localized server applications abroad , Well, when you're done , Others have already started to reduce the dimension and hit you , The same company boss 、 I'm afraid the financial department will often ask you to drink tea to settle accounts . At this time, select a mature international supplier to assist , One key deployment , Why not do it ? Save countless troubles behind you , Cut off thousands of troubles .


As shown in the figure ,AWS Global database , Cross region replication latency is in the order of seconds , Cross region failover does not exceed 1 minute , And support the use of backbone network , One key deployment , Are you in love .
3、AI+ database , Easily train your data model
AI At present, it is a mess of fire , But our enterprise wants to do , But he was timid , Because of this thing , It needs a strong talent reserve , It's easy to beat a dog with meat buns . Of course AI The benefits brought to the enterprise , It is undeniable , Through the existing database resources and AI Algorithm to continuously optimize their own data model , Make the corresponding data model more suitable for enterprise applications , To assist in decision making , Guide production . This is exactly what countless enterprises are pursuing , Therefore, enterprises urgently need a low threshold AI Development services . ha-ha , you 're right AWS It also helped us think of , Let's take a look at AWS stay AI What have you done in terms of integration .

As shown in the figure , Database developers do not need expertise in machine learning , The machine learning operation can be carried out . adopt AI Component and database integration , take AI The results are fed back to the database , Through a simple SQL Statement to query and apply .
4、 Hua Shan talks about swords , Strength responsibility

As shown in the figure AWS Of Aurora contrast MySQL In terms of performance 5 Times promotion , a PostgreSQL Yes 3 Times promotion . Support cross regional disaster recovery , Support the most 15 Copies , Automatic extension , While improving the performance of commercial databases , The cost is only that of commercial databases 1/10, And according to Pay for usage , Who's here , Who doesn't . arrange !!!

5、 summary
1、AWS It is very convenient to use the components of , The whole development process can also be monitored , Whole process visual configuration .AWS The default configuration of is set according to common development scenarios , Therefore, it can greatly improve the development efficiency . and AWS The high integration of components has to give people a thumbs up .
2、 We can according to the actual situation of our business , Choose different products to better adapt to the development of the business .
3、 No matter which product ,AWS Both provide managed services and infrastructure components . Structural modernization is the cornerstone of all innovation , The most important idea is “The right tool for the job”, That is, using specially built tools in different scenarios , Special tools need professional modern hosting platform , These can save a lot of time for enterprises 、 Money and energy . AWS It is undoubtedly one of the best choices .
Four 、 Fan benefits
Amazon cloud technology has created a variety of learning platforms for developers :
1. Getting started Resource Center : from 0 To 1 Easy to get started with cloud services , Content covered : Cost management , Start training , Development resources .AWS introduction _AWS Getting started _AWS Cloud computing resources -AWS The cloud service
2. Architecture Center : Amazon cloud Technology Architecture Center provides cloud platform reference architecture chart 、 Reviewed architectural solutions 、Well-Architected Best practices 、 Pattern 、 Icon, etc .AWS Architecture Center deployment description _AWS Cloud Architecture white paper -AWS The cloud service
3. Builder Library : Learn how Amazon cloud builds and operates software .Amazon Builders' Library*all&awsf.filter-content-type=*all&awsf.filter-content-level=*all&trk=835e6894-d909-4691-aee1-3831428c04bd&sc_channel=el
4. Toolkit for developing and managing applications on Amazon cloud technology platform :aws Download tool _aws development tool _ Download resources -AWS The cloud service
【 Exclusive benefits 】
Fukuichi :100 Free packages for more than products . among , Computing resources Amazon EC2 First year 12 It's free for three months ,750 Hours / month ; Storage resources Amazon S3 First year 12 It's free for three months ,5GB Standard storage capacity .
https://aws.amazon.com/cn/free/?nc2=h_ql_pr_ft&all-free-tier.sort-by=item.additionalFields.SortRank&all-free-tier.sort-order=asc&awsf.Free%20Tier%20Types=*all&awsf.Free%20Tier%20Categories=*all&trk=e0213267-9c8c-4534-bf9b-ecb1c06e4ac6&sc_channel=el
Welfare II : The latest discount gift bag ,200$ Data and analysis deduction voucher ,200$ Machine learning voucher ,200$ Micro service and application development deduction voucher . The latest offer _ Cloud server Promotion - Amazon cloud technology
Welfare three : Solution CloudFormation One click deployment template library
Quick start to cloud service solution deployment _ Cloud service deployment -AWS The cloud service
边栏推荐
- 电子学:第010课——实验 8:继电振荡器
- [daily training] 207 Class Schedule Card
- [deep learning lightweight backbone] 2022 edgevits CVPR
- php数组函数大全
- 剑指offer刷题(简单等级)
- 洛谷P2486 [SDOI2011]染色(树链+线段树 + 树上区间合并 )
- Black dot = = white dot (MST)
- 取消word文档中某些页面的页眉
- MySQL interview - the response of executing SQL is relatively slow, and the troubleshooting ideas.
- [supplementary question] 2021 Niuke summer multi school training camp 1-3
猜你喜欢

电子学:第008课——实验 6:非常简单的开关

Take you through the normalization flow of GaN

Electronics: Lesson 010 - Experiment 8: relay oscillator

socket问题记录

【论文学习】《VQMIVC》

用函数的递归来解决几道有趣的题

To understand the difference between Gram-positive and Gram-negative bacteria and the difference in pathogenicity

Force buckle 272 Closest binary search tree value II recursion

PH neutralization process modeling

allgero报错:Program has encountered a problem and must exit. The design will be saved as a .SAV file
随机推荐
【Unexpected token o in JSON at position 1出错原因及解决方法】
The fourth floor is originally the fourth floor. Let's have a look
Luogu p1073 [noip2009 improvement group] optimal trade (layered diagram + shortest path)
417-二叉树的层序遍历1(102. 二叉树的层序遍历、107.二叉树的层次遍历 II、199.二叉树的右视图、637.二叉树的层平均值)
洛谷P2839 [国家集训队]middle(二分 + 主席树 + 区间合并)
FM信号、调制信号和载波
Share the process requirements for single-layer flexible circuit board
Opencv daily function structure analysis and shape descriptor (8) Fitline function fitting line
How to resize an image in C #
Mining microbial dark matter -- a new idea
Startup, shutdown and restart of Oracle and MySQL on Linux
唐老师讲运算放大器(第七讲)——运放的应用
Luogu p6822 [pa2012]tax (shortest circuit + edge change point)
Force deduction 76 questions, minimum covering string
牛客:飞行路线(分层图+最短路)
Drawing of clock dial
Can transparent cloud gateway caniot and candtu record can messages and send and receive can data remotely
饮食干预减轻癌症治疗相关症状和毒性
云计算考试版本1.0
Import data into Matlab