[log service CLS] a taste of Tencent cloud log service CLS

【 Reading guide 】 Students who know about Tencent cloud must know , The product types of Tencent cloud are very rich , among , The log service CLS Is one of the very basic underlying services . Again , The logging function of any cloud product should also be the most basic function . When you plan to develop a new cloud product , You can think about CLS As its own basic log service .

chart 1- Tencent cloud products

Text

One 、 Basic service information

Tencent cloud products have many categories , Generally, there are primary categories and secondary classifications , among , The log service CLS Yes, as a general category “ Storage ” Medium “ Data processing and analysis ” Under category . If we want to experience CLS service , You can enter from this entrance in the figure below , Address ： Portal .

chart 2- Log service entry

After entering the page , As shown in the figure below ：

chart 3- The log service

Introduce through the page , We can know , The log service （CLS） It is a one-stop log service platform provided by Tencent cloud , Provides data collection from logs 、 Log storage to log retrieval , Chart analysis 、 Monitoring alarm 、 Log delivery and other services , Assist users to solve business operation and maintenance through operation logs 、 Service monitoring 、 Log audit and other scenarios .

Two 、 Service base features

Tencent cloud's log service CLS It has very rich functional features , Next , Briefly introduce it from six aspects .

1. Rich in functions

Tencent cloud log service CLS It provides users with real-time log collection 、 Content structuring 、 Stable storage 、 Fast search 、 Multidimensional analysis 、 Regular delivery and other functions , It also provides a sound API And console to facilitate user management and use of logs .

2. Stable and reliable

Tencent cloud CLS Adopt highly available distributed architecture design , The log data is backed up and stored in multiple redundancy , Prevent single node service downtime and data unavailability , Provide up to 99.9% Service availability of , Provide stable and reliable service guarantee for log data .

3. Stretch and stretch

Tencent cloud CLS Adopt distributed system architecture , High scalability , Supports elastic scaling , Meet the daily log data traffic of 100 million levels . Users don't have to worry about complex resource planning , You can process 100 million level log files every day , Easily handle massive logs .

4. Respond quickly

Log real-time collection and transmission , write in CLS Can be queried and analyzed , The 100 million level log retrieval supports the second level return results , At the same time, log analysis can aggregate 100 million level log data in one second , It is convenient for users to quickly analyze and process massive log data .

5. Easy access

adopt Agent/API/SDK And other rich log collection methods , Users can easily collect log data to CLS For centralized management . The log service has opened the logs of several cloud products on Tencent cloud , Simple configuration can deliver cloud product logs to the log service . 

6. The cost is low

Users do not need to be based on ELK And so on , There is no need to worry about resources being idle and wasted , Eliminate high hardware costs . Access CLS after , Will pay according to the actual usage , The price is low .

3、 ... and 、 Service application scenarios

Tencent cloud's log service CLS It can support many application scenarios , Basically, it can cover most of the log usage modes in the market .

Next , Separately .

1. Background operation and maintenance management

In the operation and maintenance of large clusters , Self research can be provided through the log service Agent：LogListener Collect the important log data scattered in each node of the cluster to the log service platform for unified management , The log of abnormal events can be quickly searched through keyword search , Locate the problem node , Combine the context query ability to restore the call chain of the exception event completely , And deliver it to the object storage to enjoy centralized data storage and life cycle management .

chart 4- Background operation and maintenance management

2. End user behavior analysis

Provided through the log service platform API and SDK Collect and summarize multi terminal logs to the log service platform , Real time retrieval and analysis can be carried out according to business requirements , And deliver key data to object storage COS To achieve long-term storage and centralized management , And through EMR Our big data analysis capability can analyze and model massive log data , Create user portraits , Understand end user behavior , Combining visualization capabilities to help enterprises make business decisions .

chart 5- End user behavior analysis

3. Log audit

Through the log service Agent Collect logs to the log service , Through log query capability , Quickly analyze its access behavior , For example, an account number 、 Operation records of an object, etc , Determine whether there is any illegal operation , Store through log delivery object COS Log data can also be stored for a long time to meet compliance audit requirements .

chart 6- Log audit

Four 、 Service usage guide

So much has been said about Tencent cloud log service CLS The content of , So how to use it ？

Today, I will lead you to experience the logging service of Tencent cloud CLS.

1. Enter the service main panel

Click on the image above 3 Medium “ Immediate use ” Button , Enter the user interface , As shown in the figure below ：

chart 7- Service Overview

On the log service overview page , We can see that the log service provides us with overview data 、 Resource Statistics 、 Traffic statistics 、 Storage statistics four statistics pages . We can also click on the... In the upper right corner “ View bill details ” Options to learn more .

At the same time, it can support various forms of fast access , Including container services TKE、 Content distribution network CDN、 Load balancing CLB、 Cloud functions SCF、Linux/Unix Text log 、Nginx journal 、JSON Format log, etc .

in addition , It also supports the display of consumption statistics charts , Including traffic 、 Storage capacity 、 The number of service requests has three dimensions , It also supports time granularity settings , The default is one hour . however , The statistical charts here are not real-time , There is a delay of about twenty minutes .

2. Journal topics

chart 8- Journal topics

Now look at , There are two log topics , One in Guangzhou , Beijing one . The default is Guangzhou , We adopt the principle of proximity , Switch to the theme of Beijing blog . Each region can create up to log sets 20 individual . The log service CLS After commercialization ,CLS Provide a certain amount of free quota for all users , It is convenient for you to try for free .

In this interface , We can manage our own blog topics , Including editing 、 retrieval 、 Delete 、 Edit label .

2. Machine group management

chart 9- Machine group management

There are currently no machine groups here , But we can create it ourselves . In the process of creating the machine group , We can set the machine group name , Configure the... Of the machine group IP Address segment , The log service is enabled by default , But the automatic upgrade of the log module can be dynamically configured .

Note that the machine group does not support windows The machine of the system .

3. Search analysis

chart 10- Index analysis

Retrieval analysis should be one of the most important uses of log statistics , We can find the corresponding log information as needed , For example, when a service exception occurs , We want to see what happened , It is to retrieve the corresponding log records according to the error information or time period information , It can greatly improve the efficiency of troubleshooting .

It should be noted that the log information also supports chart analysis , The search results can be listed 、 Broken line diagram 、 Histogram 、 Display in the form of pie chart .

4. Delivery task management

chart 11- Delivery task

The delivery task management function is to save the old log records to Tencent cloud COS Objects are stored in the service , It may not be easy for you to understand , Why does it have this function . because , As the product service cycle gets longer , Especially the products and services with a large number of users , It is easy to generate a large number of log records . however , We can't delete these logs , therefore , We need to find a place to store these logs , So there is the delivery management task module .

5. Monitoring alarm

chart 12- Monitoring alarm

The monitoring alarm module should be one of the most commonly used functions of the log service , When a service exception occurs , You can notify us in time for handling . This module supports alarm policy settings 、 Historical alarm record query 、 Notice template settings three sub functions .

chart 13- New alarm

When creating a new alarm strategy , We can set the log theme , That is, the display form of the log , And monitoring objects , Monitoring cycle , Trigger conditions, etc .

chart 14- Alarm History

Alarm history you can view the historical alarm records of a service , Including the number of alarm strategy execution 、 Information such as the number of times the alarm strategy is executed . meanwhile , It can also display Top10 Alarm record of , Let's make a targeted analysis of the main contradictions .

chart 15- New template

The function of the notification template is to set the notification mechanism for service exceptions and warning penalties , Tell the operation and maintenance personnel that an alarm has occurred in the current service . The notification template supports two forms of notification , On the one hand, it supports user notification , Error message 、 SMS 、 WeChat 、 There are four forms of telephone , On the other hand, it also supports interface callback , We can set the corresponding listening service interface , It is used to automatically process some alarm information .

6. The dashboard

chart 16- The dashboard

Instrument panel module , It supports us to query logs in a customized way and present the results in the form of charts . This design is to facilitate users to view the customized content they want .

ending

Okay , Today, about Tencent cloud log service CLS That's the end of the introduction , It would be perfect if the government could provide a free log machine group , Now we still need to find the machine by ourselves . Last , Welcome interested friends to experience . in addition , You can also pay attention “ Cloud native log service CLS“ official account , Learn about log services for the first time CLS Product trends .