Log blacklist can really save you money!

summary

 “ Observation cloud ” It provides you with a comprehensive log collection capability , Support collection Windows/Linux/MacOS host 、Web The server 、 virtual machine 、 Network devices 、 Safety equipment 、 Log data generated by database , However, the collected logs will contain some logs you don't need , therefore “ Observation cloud ” For you 「 Log blacklist 」 function , That is, by adding log filtering rules , Filter the log data that conforms to this rule 、 Prevent reporting to the workspace , Help you save the cost of log data storage .

precondition

• You need to create a 【  Observation cloud account  】
• https://auth.guance.com
• 
  

• install  DataKit 【DataKit  Installation document  】
• https://www.yuque.com/dataflux/datakit/datakit-how-to

• Start the operation of relevant integration , Data collection .

The role of log blacklist ：

a. To save money

stay “ Observation cloud ” in , The billing method for log data is as follows ：

With “ Availability dial test ” Take the generated log data as an example , We create a node in Beijing , Dial and test our website every minute . At this time, a log will be generated and uploaded to the workspace every minute , What we pay more attention to is the dial test timeout of this node 、 When you fail , So you can use our log blacklist function , Will dial test  status  by  OK  Filter the logs of , Thus, the data cost is greatly saved .

b. worry

The log blacklist configuration takes effect immediately , Common to all users in the whole workspace , And you only need to configure it once , permanent . Standard members and above can be created 、 Edit blacklist configuration .

c. To save time

Use the log blacklist function , It can reduce the collection of invalid logs , Present more effective information in the workspace , It is convenient for you to find the target log faster .

How to use the log blacklist function

a. Check the blacklist

stay  “ Observation cloud ”  working space , Click on 「 journal 」-「 The blacklist 」, You can 「 Log blacklist 」, View all log filtering rules .

b. newly build 、 Edit blacklist

newly build ： In the top left corner of the log blacklist , Click on 「 New blacklist 」, You can create a new log filter rule .

edit ： On the right side of the log blacklist , Click on 「 edit 」, You can edit the created log filter rules .

For example, select the log source

http_dail_testing

, Screening filtration

status=OK

And

city=hangzhou

Log data for .

Be careful ： Two conditions are supported ,“ arbitrarily ” and “ all ”.“ arbitrarily ” by  “ or （OR）” Conditions ,“ all ” by “ And （AND）” Conditions .

c. Delete the blacklist

On the right side of the log blacklist , Click on 「 Delete 」, You can delete the existing log filtering rules . After deleting the filter rule , Log data will be reported to the workspace normally .