当前位置:网站首页>Talk about the future of cloud native database
Talk about the future of cloud native database
2022-06-25 08:04:00 【They call me technical director】
Catalog
1、 Claims the melon , Eat and boast
2、 It starts with beauty , Finally talent
One 、 Cloud native , From the well at the entrance of the village to the sea of stars
Two 、 database , From beard and eyebrows to morning glory nose
2、 Change of data management mode
3、 Talk about databases Serverless
3.1 Unlimited refills + Optimal energy consumption
3.2 Global layout , Highly disaster tolerant
3、 ... and 、AWS Cloud native database
1、 It's special for the special warehouse , First take a look at their family bucket
2、 The earth is my home , The global database depends on it
3、AI+ database , Easily train your data model
4、 Hua Shan talks about swords , Strength responsibility
Preface
This topic , Let's talk about what cloud primitives are ? What is a database ? Finally, I will take you to the Amazon cloud native database , Find the cloud native database that suits you .
1、 Claims the melon , Eat and boast
“ Gold has a price , Data is priceless ”, Database development to the present , The importance is self-evident . Data as an asset of an enterprise , At the same time, it is also the digitalization of enterprises 、 The indispensable energy for information operation . Its energy efficiency is equivalent to that of coal 、 oil 、 The changes that natural gas brings to people .
As an important carrier of data , database . We certainly want to spend the least effort , Choose what suits you , No , It should be a database product that surprises us . In order to let us quickly get familiar with the cloud native database and actually experience , Specially sorted out relevant trial products , I invite you to have a look at this melon ! Whether it is crisp and refreshing , You can't count until you eat .
2、 Database free trial links and tutorials
3、 Cloud native database online conference
2、 It starts with beauty , Finally talent
advantage :
2.1 No need to manage servers
The cloud native database can automatically run your code , No need to preset or manage servers . You just need to write code and upload it to the cloud native database .
2.2、 Continue to expand
By running code in response to each trigger , To automatically extend your application . Your code will run in parallel and handle each trigger independently , Make it scale precisely according to the size of the workload .
2.3、 Sub second measurement
When using cloud native databases , According to the code execution time ( per 1 Milliseconds ) And code trigger times . When the code is not running , No cost .
shortcoming :
The only drawback is that some professional videos and documents are in English , But for students who have a certain foundation in English, this is not a thing , Ha ha ha , I can't. We still have a translator .
3、 Personal advice
When the following problems or scenarios occur in the enterprise , choice AWS Cloud native database , It will give a satisfactory complete solution .
1、 At present, enterprises are facing serious infrastructure obsolescence 、 Low level of Automation 、 Lack of special tools and heavy capital expenditure .
2、 Enterprises are bound by traditional commercial databases , And it's hard to innovate , But we still need the performance of commercial databases .
3、 Operation and maintenance is time-consuming, but the value output is low , But enterprises have to spend energy and cost in this regard .
4、 Enterprises have TB level 、PB Level structured data and several times the unstructured data , Globally distributed users , And process millions of requests per second with very low latency .
One 、 Cloud native , From the well at the entrance of the village to the sea of stars
To understand cloud computing, we need to understand two key words ——「 cloud 」 and 「 Native 」.
1、 Birth background
In a non cloud database architecture , We will build the database according to the application system , And it must be a tightly coupled design , To maximize the effectiveness of the system . Let me give you an example from life , We go through several stages of using water , From the well shared by everyone at the entrance of the village , To every household's well , The tap water we use now . Why did such an evolution occur ?
At the beginning, everyone solved the problem of drinking water , Therefore, crowdfunding is under the old locust tree at the entrance of the village , Dig a well to solve the problem of drinking water . Soon found out , There is a need to queue up for shared wells 、 The quality of water is not well controlled 、 When the weather is dry, you often can't drink water, etc . Therefore, each household will drill a well according to the water consumption , Solved the queuing problem , But there will still be water shortage 、 It is difficult to control the water quality of wells . This is because traditional database systems use computing 、 The way resources are stored is the same , It's a tightly coupled way .
What if there's not enough water ? Corresponding , This is the business expansion often mentioned in the traditional database system . In order to expand the capacity 、 Shrinkage capacity . The traditional expansion process is very long , And it's painful to shrink after the business peak , It often leads to a great waste of resources , It's also hard to cope with the fast changing capabilities required by the business layer , This is one of the biggest drawbacks of traditional architecture . At this time, people urgently hope that we don't need to drill wells by ourselves , There is no need to consider the water quality 、 Water quantity and whether there is water . Just want to take it and use it , Charge on demand . This is how the cloud native database was born .
2、 cloud
The cloud is relative to the local , Traditional applications have to run on local servers , Now popular applications are running in the cloud , The cloud contains IaaS,、PaaS and SaaS.「 cloud 」 It is to pool resources with virtualization technology . Water is a resource , No tightly coupled way to deploy and use , You don't have to drill wells , But many villages 、 Cities Unite “ hit ” A lake or sea , Repair the pipeline to every household , This is resource pooling . After pooling resources, they can be used on demand , Flexible scheduling .
The present ,IT The best combination of technologies in the world may be “ Cloud computing + Artificial intelligence ”. Cloud computing solves scalability 、 data storage 、 Performance and so on , Artificial intelligence technology greatly improves the efficiency of data analysis and processing .
Cloud computing can provide the peak demand for modern applications “ Unlimited refills ” And when running smoothly “ Optimal energy consumption ”. As one of the cloud computing models Serverless, In theory, it can automatically adapt to the peak demand from zero to infinity , Better at solving scalability problems ( Peak shaving and valley filling ).Serverless The advantage of architecture is that it can be loaded on demand , In this way, the application will not continue to occupy resources , Only when a request arrives or an event occurs will it be deployed and started , Avoid cost waste . meanwhile ,Serverless Native applications support high availability , It can better deal with sudden high traffic . When the database is also Serverless turn , It can achieve high scalability and automatic capacity expansion , Pay as you go 、 Reduce expenditure costs , further Emancipate the management, operation and maintenance of database .2012 Amazon launched Amazon DynamoDB Namely Serverless database .
3、 Native
Being native means being native , When we start to design the application, we consider that the application will run in the cloud environment in the future , Make full use of the advantages of cloud resources , such as ️ Cloud services elastic and Distributed advantage .
So when enterprises design applications , Fully consider the cloud environment , Give full play to the advantages of the cloud , Jean Yun “ native ” The ability to apply to the entire lifecycle of enterprise applications , Including the rapid deployment of cloud 、 Flex as needed 、 On line delivery, etc . Let enterprise applications Born in the cloud , Longer than clouds .
4、 Cloud native
in general , As shown in the following figure, the cloud is native =DevOps+ Continuous delivery + Microservices + Containers . That is, applications that conform to the cloud native architecture should be : Using the open source stack (K8S+Docker) Containerization , Improve flexibility and maintainability based on microservice architecture , With agile methods 、DevOps Support continuous iteration and operation and maintenance automation , Using cloud platform facilities to achieve elastic scaling 、 Dynamic scheduling 、 Optimize resource utilization . Cloud primordial can be favored by everyone , Because of this “ Four Heavenly Kings ” Help endorse behind your back . If you are interested, you can take a look at the self introduction of the four heavenly kings , It can help you better understand cloud primitives .
Microservices : Almost every cloud native definition includes microservices , The opposite of microservices is single application , Microservice has a theoretical basis , That's Conway's law , Guide the service how to segment , Very mysterious , Anyone who can be called a theoretical law simply can't understand , Otherwise, there will be no b grid , Organizational structure determines product form , I wonder if it has anything to do with Marx's relations of production affecting productivity .
The benefit of the microservice architecture is to function After cutting , Service decoupling , Better cohesion , Change is easier ; Another technique for dividing services is said to be based on DDD Come on .
Containerization :Docker It is the most widely used container engine , It is widely used in the infrastructure of companies such as Cisco and Google , Is based on LXC Technology , Containerization provides implementation guarantee for microservices , Play the role of application isolation ,K8S It's a container choreography system , For container management , Load balancing between containers , Google did it ,Docker and K8S All use Go To write , It's all good stuff .
DevOps: This is a compound word ,Dev+Ops, Is the combination of development and operation and maintenance , Unlike development and products , Often meet with the blade , actually DevOps Testing should also be included ,DevOps Is an agile mind , It's a culture of communication , It's also the form of organization , Provide continuous delivery capabilities for cloud natives .
Continuous delivery : Continuous delivery is timely development , Keep updating , Small step run , Anti traditional waterfall development model , This requires both the development version and the stable version , In fact, it needs a lot of processes and tools to support .
Two 、 database , From beard and eyebrows to morning glory nose
1、 What is a database
For database professionals , In fact, it is an electronic warehouse , It is a special place for storing and managing data , Users can add, update or delete data in the database . Database is the middle layer between application and hardware , Software application for data management . Take a chestnut . Your phone's address book is a database , Used to keep friends 、 How to contact students .
The history of database development is about 50 year , front 30 Over the years, the main development direction is centralized database , In the direction of centralized database IBM、Oracle、 Microsoft and other giants . Develop open source database products from closed source products , Open source database is developing rapidly , And there is a trend to catch up with and surpass the closed source database . The increase of business volume leads to the transformation of database to distributed direction , meanwhile , The rapid development of cloud computing makes databases cloud .
To 2022 Up to, the database is in the ascendant , A number of excellent database products and database suppliers have emerged . Among them, the open source database is based on MySQL、PostgresSQL As a representative , Excellent database supplier AWS、 Oracle bone inscriptions represent .
2、 Change of data management mode
Data as an application system “ blood ”, Good blood circulation will make our system run smoothly , Support the rapid and vigorous development of the business , conversely , Bad blood circulation , It will make the database the bottleneck of our application , Poor circulation , Resulting in poor application experience , The application is blocked , Finally, it will lead to application bankruptcy . In order to solve this situation , We must solve two major problems , One is “ It works ” Two is “ To use ”.
“ It works ” That is, we should do a good job in daily maintenance, backup and isolation, etc ,“ To use ” High performance , Low latency, etc , So that users can not experience the delay caused by the database . Because in the traditional self-management mode , Achieve “ It works ” Amitabha already .
Because just to make sure it works , We must do a good job of routine maintenance 、 patch up 、 Database backup 、 Data isolation and security 、 Optimal configuration adjustment, etc . But the boss and users are only concerned about the value behind the data , Therefore, customers must pay more attention to pattern design 、 Query build 、 Query and optimize these applications .
In such an environment , The customer hopes that the hard and tired work at the bottom trusteeship get out , Or better yet Intelligent operation and maintenance . So as AWS Cloud vendors have launched relevant hosting and Serverless( There is no server ) service , Liberate the customer's hands , Let customers focus on applications , Reduce cost and increase efficiency for enterprise development . No more beard and eyebrows , Just grab the app's nose . In their own business areas to bloom more brilliant glory . Use as shown in the picture AWS After the cloud native database, our database management only needs to focus on the small red area behind it . Do you feel like you have caught the straw , Can't wait to buy . Don't worry. Listen to me slowly , Take your time to appreciate AWS The charm of .(PS: I have also sorted out the related purchase benefits at the end of the article , Welcome to buy .)
3、 Talk about databases Serverless
At present, there is no server in the database , Because of its flexibility , Get unanimous praise , Like Sunwukong's Ruyi golden cudgel , As you wish , Listen to me . Let's say Aurora Serverless V2 For example , Specifically speaking Serverless Several characteristics of .
3.1 Unlimited refills + Optimal energy consumption
Aurora Serverless V2 Support instant in place expansion feature , When we hold similar promotions , For large-scale stress tests , We certainly hope that our application will be like the usual night 2 Click the performance of a low application scenario , At this time, our server needs to have sufficient resources to support these high application scenarios . As shown in the figure below Aurora Serverless You can complete the server configuration adaptation in seconds , Without affecting existing applications . This is exactly what I mentioned earlier “ Unlimited refills ” The operation of .
Generally speaking, upward expansion is relatively simple , Just add configuration . But when we need to zoom , How to do this without affecting the application , Skillfully complete the scaling of the configuration ? For example, buffer pool is used least frequently (LFU) And the least recently used (LRU) A combination of algorithms to smooth scaling . In this way, the application can be ensured at the same time , keep “ Optimal energy consumption ”.
3.2 Global layout , Highly disaster tolerant
When we do business globally , Or when we need to quickly deal with the downtime of the primary database , How to ensure that when the database service in our main area goes down , Fast switching ? At the same time, in order to save costs , The configuration of the slave region is generally that of the master region 1/5 about , In this case, under the traditional database architecture , It is difficult to quickly switch and tolerate disasters . It is because Serverless Also support read log By reading the operation log of the main area , Keep the data on both sides consistent , add Serverless Rapid expansion of , You can guarantee that in the second level , The configuration from the area to the main area ensures the application , This will minimize the risk of system application .
3、 ... and 、AWS Cloud native database
1、 It's special for the special warehouse , First take a look at their family bucket
chart 3.1AWS Cloud native database family bucket
chart 3.2AWS Cloud database service
At present, there is no database that can meet all our needs , For example, we wear beautiful skirts in summer and wear them in snowy winter , It's probably enough . So we will choose our clothes according to our needs . Similarly, we can also select the appropriate database service according to our application needs , For example, when our enterprise takes the traditional ERP Application oriented , At this time, we can choose AWS Of Aurora/RDS To host our relational database ; When our application focuses on specific scenarios , But there is a very high flow , E-commerce shopping , At this time, we can choose AWS Of DynamoDB Or memory servers to meet our high-frequency application scenarios, etc .
2、 The earth is my home , The global database depends on it
Today's economy 、 The rapid development of Internet and industry , Many enterprises have expanded their business abroad , In order to cope with the rapid development of international business . At this time, if the enterprise plans to deploy its own localized server applications abroad , Well, when you're done , Others have already started to reduce the dimension and hit you , The same company boss 、 I'm afraid the financial department will often ask you to drink tea to settle accounts . At this time, select a mature international supplier to assist , One key deployment , Why not do it ? Save countless troubles behind you , Cut off thousands of troubles .
As shown in the figure ,AWS Global database , Cross region replication latency is in the order of seconds , Cross region failover does not exceed 1 minute , And support the use of backbone network , One key deployment , Are you in love .
3、AI+ database , Easily train your data model
AI At present, it is a mess of fire , But our enterprise wants to do , But he was timid , Because of this thing , It needs a strong talent reserve , It's easy to beat a dog with meat buns . Of course AI The benefits brought to the enterprise , It is undeniable , Through the existing database resources and AI Algorithm to continuously optimize their own data model , Make the corresponding data model more suitable for enterprise applications , To assist in decision making , Guide production . This is exactly what countless enterprises are pursuing , Therefore, enterprises urgently need a low threshold AI Development services . ha-ha , you 're right AWS It also helped us think of , Let's take a look at AWS stay AI What have you done in terms of integration .
As shown in the figure , Database developers do not need expertise in machine learning , The machine learning operation can be carried out . adopt AI Component and database integration , take AI The results are fed back to the database , Through a simple SQL Statement to query and apply .
4、 Hua Shan talks about swords , Strength responsibility
As shown in the figure AWS Of Aurora contrast MySQL In terms of performance 5 Times promotion , a PostgreSQL Yes 3 Times promotion . Support cross regional disaster recovery , Support the most 15 Copies , Automatic extension , While improving the performance of commercial databases , The cost is only that of commercial databases 1/10, And according to Pay for usage , Who's here , Who doesn't . arrange !!!
5、 summary
1、AWS It is very convenient to use the components of , The whole development process can also be monitored , Whole process visual configuration .AWS The default configuration of is set according to common development scenarios , Therefore, it can greatly improve the development efficiency . and AWS The high integration of components has to give people a thumbs up .
2、 We can according to the actual situation of our business , Choose different products to better adapt to the development of the business .
3、 No matter which product ,AWS Both provide managed services and infrastructure components . Structural modernization is the cornerstone of all innovation , The most important idea is “The right tool for the job”, That is, using specially built tools in different scenarios , Special tools need professional modern hosting platform , These can save a lot of time for enterprises 、 Money and energy . AWS It is undoubtedly one of the best choices .
Four 、 Fan benefits
Amazon cloud technology has created a variety of learning platforms for developers :
1. Getting started Resource Center : from 0 To 1 Easy to get started with cloud services , Content covered : Cost management , Start training , Development resources .AWS introduction _AWS Getting started _AWS Cloud computing resources -AWS The cloud service
2. Architecture Center : Amazon cloud Technology Architecture Center provides cloud platform reference architecture chart 、 Reviewed architectural solutions 、Well-Architected Best practices 、 Pattern 、 Icon, etc .AWS Architecture Center deployment description _AWS Cloud Architecture white paper -AWS The cloud service
3. Builder Library : Learn how Amazon cloud builds and operates software .Amazon Builders' Library*all&awsf.filter-content-type=*all&awsf.filter-content-level=*all&trk=835e6894-d909-4691-aee1-3831428c04bd&sc_channel=el
4. Toolkit for developing and managing applications on Amazon cloud technology platform :aws Download tool _aws development tool _ Download resources -AWS The cloud service
【 Exclusive benefits 】
Fukuichi :100 Free packages for more than products . among , Computing resources Amazon EC2 First year 12 It's free for three months ,750 Hours / month ; Storage resources Amazon S3 First year 12 It's free for three months ,5GB Standard storage capacity .
https://aws.amazon.com/cn/free/?nc2=h_ql_pr_ft&all-free-tier.sort-by=item.additionalFields.SortRank&all-free-tier.sort-order=asc&awsf.Free%20Tier%20Types=*all&awsf.Free%20Tier%20Categories=*all&trk=e0213267-9c8c-4534-bf9b-ecb1c06e4ac6&sc_channel=el
Welfare II : The latest discount gift bag ,200$ Data and analysis deduction voucher ,200$ Machine learning voucher ,200$ Micro service and application development deduction voucher . The latest offer _ Cloud server Promotion - Amazon cloud technology
Welfare three : Solution CloudFormation One click deployment template library
Quick start to cloud service solution deployment _ Cloud service deployment -AWS The cloud service
边栏推荐
- FM信号、调制信号和载波
- c#ColorDialog更改文本颜色和FontDialog更改文本字体的使用示例
- RMQ区间最大值下标查询,区间最值
- 线程+线程问题记录
- PHP array function Encyclopedia
- c#中设置lable控件的TextAlign属性控制文字居中的方法
- Electronics: Lesson 012 - Experiment 11: light and sound
- c#磁盘驱动器及文件夹还有文件类的操作
- 洛谷P2048 [NOI2010] 超级钢琴(RMQ+优先队列)
- Machine learning notes linear regression of time series
猜你喜欢
How to use ad wiring for PCB design?
基于RBAC 的SAAS系统权限设计
PH neutralization process modeling
C examples of using colordialog to change text color and fontdialog to change text font
Drawing of clock dial
Electronics: Lesson 010 - Experiment 9: time and capacitors
Can bus working condition and signal quality "physical examination"
To understand the difference between Gram-positive and Gram-negative bacteria and the difference in pathogenicity
417-二叉树的层序遍历1(102. 二叉树的层序遍历、107.二叉树的层次遍历 II、199.二叉树的右视图、637.二叉树的层平均值)
Use the frame statistics function of the message and waveform recording analyzer royalscope to troubleshoot the accidental faults of the CAN bus
随机推荐
allgero报错:Program has encountered a problem and must exit. The design will be saved as a .SAV file
Luogu p1073 [noip2009 improvement group] optimal trade (layered diagram + shortest path)
Electronics: Lesson 012 - Experiment 11: light and sound
What are the problems with traditional IO? Why is zero copy introduced?
Logu P2486 [sdoi2011] coloring (tree chain + segment tree + merging of intervals on the tree)
Electronics: Lesson 014 - Experiment 15: intrusion alarm (Part I)
Basic use of ActiveMQ in Message Oriented Middleware
Pcb|about FPC reinforcement type
c#ColorDialog更改文本颜色和FontDialog更改文本字体的使用示例
Application of can optical transceiver of ring network redundant can/ optical fiber converter in fire alarm system
Black dot = = white dot (MST)
挖掘微生物暗物质——新思路
Import data into Matlab
2265. number of nodes with statistical value equal to the average value of subtree
1742. maximum number of small balls in the box
Three Siemens fire-fighting hosts fc18 are equipped with can optical transceiver for optical fiber redundant ring network networking test
Requirements for Power PCB circuit board design 2021-11-09
Drawing of clock dial
How to create a new branch with SVN
剑指offer刷题(中等等级)